2024-04-24T08:10:33.761 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-24T08:10:33.761 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --verbose --description fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} --name rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215 -- /home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215/orig.config.yaml 2024-04-24T08:10:33.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T08:10:33.884 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215 branch: rishabh-main-apr17-a654945 description: fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} email: null first_in_suite: false job_id: '7671215' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-main-apr17-a654945 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 1f81fb397ae98da7563d451a78c61574c8f4e6e0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1f81fb397ae98da7563d451a78c61574c8f4e6e0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-main-apr17-a654945 sha1: 1f81fb397ae98da7563d451a78c61574c8f4e6e0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 7954 sha1: 1f81fb397ae98da7563d451a78c61574c8f4e6e0 sleep_before_teardown: 0 subset: 364/512 suite: fs suite_branch: rishabh-main-apr17-a654945 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1f81fb397ae98da7563d451a78c61574c8f4e6e0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1f81fb397ae98da7563d451a78c61574c8f4e6e0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7KnOPcHZcxJTfUZiHBPafRwYDiWQ6t/KQSznzuP2z3g3T+5hgDmN2FKhIsGWtisn5RqLj8XbNhanRM5TU/1KU= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDRtOf/tckZAVCMYlgMVPlD+8iO7z9o0CmZkJOZPeGRAR5DDfG+kBXyBP5hJL2JdCMFcgzlRpMfh26NaoDbIYc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_cephfs_shell teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_07:32:23 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-24T08:10:33.884 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1f81fb397ae98da7563d451a78c61574c8f4e6e0/qa; will attempt to use it 2024-04-24T08:10:33.885 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1f81fb397ae98da7563d451a78c61574c8f4e6e0/qa/tasks 2024-04-24T08:10:33.885 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-24T08:10:33.886 INFO:teuthology.task.internal:Checking packages... 2024-04-24T08:10:33.910 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '1f81fb397ae98da7563d451a78c61574c8f4e6e0' 2024-04-24T08:10:33.910 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-24T08:10:33.910 INFO:teuthology.packaging:ref: None 2024-04-24T08:10:33.910 INFO:teuthology.packaging:tag: None 2024-04-24T08:10:33.910 INFO:teuthology.packaging:branch: rishabh-main-apr17-a654945 2024-04-24T08:10:33.910 INFO:teuthology.packaging:sha1: 1f81fb397ae98da7563d451a78c61574c8f4e6e0 2024-04-24T08:10:33.911 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-main-apr17-a654945 2024-04-24T08:10:34.132 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3116-g1f81fb39-1jammy 2024-04-24T08:10:34.134 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-24T08:10:34.142 INFO:teuthology.task.internal:no buildpackages task found 2024-04-24T08:10:34.142 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-24T08:10:34.156 INFO:teuthology.task.internal:Saving configuration 2024-04-24T08:10:34.172 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-24T08:10:34.183 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-24T08:10:34.207 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 08:04:31.706671', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKd1sdowhrP+sGWo6QH2nXkXPLBowfB8qV/5gubwMiNb'} 2024-04-24T08:10:34.233 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 08:04:31.704844', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICKruZd/bInFxl6aVtgSxiFqY4vOX41Jxs0m/skjMvNS'} 2024-04-24T08:10:34.233 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-24T08:10:34.245 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-24T08:10:34.245 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-24T08:10:34.245 INFO:teuthology.run_tasks:Running task console_log... 2024-04-24T08:10:34.323 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f696619d4c0>, signals=[15]) 2024-04-24T08:10:34.323 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-24T08:10:34.332 INFO:teuthology.task.internal:Opening connections... 2024-04-24T08:10:34.333 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:10:34.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T08:10:34.420 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T08:10:34.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T08:10:34.498 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-24T08:10:34.507 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-04-24T08:10:34.512 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-04-24T08:10:34.512 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-04-24T08:10:34.560 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-24T08:10:34.560 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2024-04-24T08:10:34.560 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="22.04" 2024-04-24T08:10:34.560 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-24T08:10:34.560 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=jammy 2024-04-24T08:10:34.560 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2024-04-24T08:10:34.560 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2024-04-24T08:10:34.560 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-24T08:10:34.560 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-24T08:10:34.560 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-24T08:10:34.560 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-24T08:10:34.561 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=jammy 2024-04-24T08:10:34.561 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-04-24T08:10:34.584 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-04-24T08:10:34.589 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-04-24T08:10:34.589 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-24T08:10:34.635 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-24T08:10:34.635 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu" 2024-04-24T08:10:34.635 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="22.04" 2024-04-24T08:10:34.636 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-24T08:10:34.636 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=jammy 2024-04-24T08:10:34.636 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu 2024-04-24T08:10:34.636 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian 2024-04-24T08:10:34.636 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-24T08:10:34.636 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-24T08:10:34.636 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-24T08:10:34.636 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-24T08:10:34.636 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=jammy 2024-04-24T08:10:34.636 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-24T08:10:34.658 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-24T08:10:34.672 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-24T08:10:34.685 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-24T08:10:34.685 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-04-24T08:10:34.687 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-04-24T08:10:34.692 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-24T08:10:34.703 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-24T08:10:34.703 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-04-24T08:10:34.733 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-04-24T08:10:34.754 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-24T08:10:34.802 INFO:teuthology.run_tasks:Running task kernel... 2024-04-24T08:10:34.821 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-24T08:10:34.821 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-24T08:10:34.821 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T08:10:34.822 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T08:10:34.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:10:34.826 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T08:10:34.826 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-24T08:10:34.827 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-04-24T08:10:34.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:10:34.828 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T08:10:34.828 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-24T08:10:34.828 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-04-24T08:10:34.872 INFO:teuthology.orchestra.run.smithi088.stdout:5.15.0-56-generic 2024-04-24T08:10:34.872 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T08:10:34.873 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-24T08:10:34.873 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T08:10:34.877 INFO:teuthology.orchestra.run.smithi142.stdout:5.15.0-56-generic 2024-04-24T08:10:34.877 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T08:10:34.877 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-24T08:10:34.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T08:10:35.023 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-04-24T08:10:35.023 DEBUG:teuthology.orchestra.run.smithi088:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-24T08:10:35.042 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-24T08:10:35.102 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-04-24T08:10:35.102 DEBUG:teuthology.orchestra.run.smithi142:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-24T08:10:35.137 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-24T08:10:35.174 INFO:teuthology.orchestra.run.smithi088.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-24T08:10:35.174 INFO:teuthology.orchestra.run.smithi088.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-24T08:10:35.174 INFO:teuthology.orchestra.run.smithi088.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-24T08:10:35.174 INFO:teuthology.orchestra.run.smithi088.stderr:hint: 2024-04-24T08:10:35.174 INFO:teuthology.orchestra.run.smithi088.stderr:hint: git config --global init.defaultBranch 2024-04-24T08:10:35.174 INFO:teuthology.orchestra.run.smithi088.stderr:hint: 2024-04-24T08:10:35.174 INFO:teuthology.orchestra.run.smithi088.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-24T08:10:35.174 INFO:teuthology.orchestra.run.smithi088.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-24T08:10:35.174 INFO:teuthology.orchestra.run.smithi088.stderr:hint: 2024-04-24T08:10:35.174 INFO:teuthology.orchestra.run.smithi088.stderr:hint: git branch -m 2024-04-24T08:10:35.175 INFO:teuthology.orchestra.run.smithi088.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-24T08:10:35.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-24T08:10:35.243 DEBUG:teuthology.orchestra.run.smithi088:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-24T08:10:35.275 INFO:teuthology.orchestra.run.smithi142.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-24T08:10:35.275 INFO:teuthology.orchestra.run.smithi142.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-24T08:10:35.275 INFO:teuthology.orchestra.run.smithi142.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-24T08:10:35.276 INFO:teuthology.orchestra.run.smithi142.stderr:hint: 2024-04-24T08:10:35.276 INFO:teuthology.orchestra.run.smithi142.stderr:hint: git config --global init.defaultBranch 2024-04-24T08:10:35.276 INFO:teuthology.orchestra.run.smithi142.stderr:hint: 2024-04-24T08:10:35.276 INFO:teuthology.orchestra.run.smithi142.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-24T08:10:35.276 INFO:teuthology.orchestra.run.smithi142.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-24T08:10:35.276 INFO:teuthology.orchestra.run.smithi142.stderr:hint: 2024-04-24T08:10:35.276 INFO:teuthology.orchestra.run.smithi142.stderr:hint: git branch -m 2024-04-24T08:10:35.277 INFO:teuthology.orchestra.run.smithi142.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-24T08:10:35.280 DEBUG:teuthology.orchestra.run.smithi142:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-24T08:10:35.297 DEBUG:teuthology.orchestra.run.smithi088:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-24T08:10:35.345 DEBUG:teuthology.orchestra.run.smithi142:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-24T08:10:35.402 DEBUG:teuthology.orchestra.run.smithi142:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-24T08:11:11.127 INFO:teuthology.orchestra.run.smithi088.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-24T08:11:11.127 INFO:teuthology.orchestra.run.smithi088.stderr: * [new branch] main -> origin/main 2024-04-24T08:11:11.163 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190312 -> 20190312 2024-04-24T08:11:11.163 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190416 -> 20190416 2024-04-24T08:11:11.163 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190514 -> 20190514 2024-04-24T08:11:11.163 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190618 -> 20190618 2024-04-24T08:11:11.163 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190717 -> 20190717 2024-04-24T08:11:11.163 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190815 -> 20190815 2024-04-24T08:11:11.163 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190923 -> 20190923 2024-04-24T08:11:11.163 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20191022 -> 20191022 2024-04-24T08:11:11.163 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20191215 -> 20191215 2024-04-24T08:11:11.163 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200122 -> 20200122 2024-04-24T08:11:11.163 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200316 -> 20200316 2024-04-24T08:11:11.165 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200421 -> 20200421 2024-04-24T08:11:11.165 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200519 -> 20200519 2024-04-24T08:11:11.165 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200619 -> 20200619 2024-04-24T08:11:11.165 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200721 -> 20200721 2024-04-24T08:11:11.165 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200817 -> 20200817 2024-04-24T08:11:11.165 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200918 -> 20200918 2024-04-24T08:11:11.165 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20201022 -> 20201022 2024-04-24T08:11:11.166 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20201118 -> 20201118 2024-04-24T08:11:11.166 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20201218 -> 20201218 2024-04-24T08:11:11.166 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210208 -> 20210208 2024-04-24T08:11:11.166 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210315 -> 20210315 2024-04-24T08:11:11.166 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210511 -> 20210511 2024-04-24T08:11:11.166 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210716 -> 20210716 2024-04-24T08:11:11.166 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210818 -> 20210818 2024-04-24T08:11:11.166 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210919 -> 20210919 2024-04-24T08:11:11.166 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20211027 -> 20211027 2024-04-24T08:11:11.166 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20211216 -> 20211216 2024-04-24T08:11:11.168 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220209 -> 20220209 2024-04-24T08:11:11.168 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220310 -> 20220310 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220411 -> 20220411 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220509 -> 20220509 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220610 -> 20220610 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220708 -> 20220708 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220815 -> 20220815 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220913 -> 20220913 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20221012 -> 20221012 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20221109 -> 20221109 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20221214 -> 20221214 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230117 -> 20230117 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230210 -> 20230210 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230310 -> 20230310 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230404 -> 20230404 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230515 -> 20230515 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230625 -> 20230625 2024-04-24T08:11:11.169 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230804 -> 20230804 2024-04-24T08:11:11.170 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230919 -> 20230919 2024-04-24T08:11:11.170 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20231030 -> 20231030 2024-04-24T08:11:11.170 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20231111 -> 20231111 2024-04-24T08:11:11.170 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20231211 -> 20231211 2024-04-24T08:11:11.170 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20240115 -> 20240115 2024-04-24T08:11:11.170 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20240220 -> 20240220 2024-04-24T08:11:11.170 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20240312 -> 20240312 2024-04-24T08:11:11.170 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20240410 -> 20240410 2024-04-24T08:11:13.662 INFO:teuthology.orchestra.run.smithi142.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-24T08:11:13.662 INFO:teuthology.orchestra.run.smithi142.stderr: * [new branch] main -> origin/main 2024-04-24T08:11:13.695 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190312 -> 20190312 2024-04-24T08:11:13.695 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190416 -> 20190416 2024-04-24T08:11:13.695 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190514 -> 20190514 2024-04-24T08:11:13.695 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190618 -> 20190618 2024-04-24T08:11:13.696 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190717 -> 20190717 2024-04-24T08:11:13.696 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190815 -> 20190815 2024-04-24T08:11:13.696 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190923 -> 20190923 2024-04-24T08:11:13.696 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20191022 -> 20191022 2024-04-24T08:11:13.697 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20191215 -> 20191215 2024-04-24T08:11:13.697 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200122 -> 20200122 2024-04-24T08:11:13.697 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200316 -> 20200316 2024-04-24T08:11:13.697 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200421 -> 20200421 2024-04-24T08:11:13.697 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200519 -> 20200519 2024-04-24T08:11:13.698 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200619 -> 20200619 2024-04-24T08:11:13.698 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200721 -> 20200721 2024-04-24T08:11:13.698 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200817 -> 20200817 2024-04-24T08:11:13.699 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200918 -> 20200918 2024-04-24T08:11:13.699 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20201022 -> 20201022 2024-04-24T08:11:13.699 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20201118 -> 20201118 2024-04-24T08:11:13.699 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20201218 -> 20201218 2024-04-24T08:11:13.699 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20210208 -> 20210208 2024-04-24T08:11:13.699 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20210315 -> 20210315 2024-04-24T08:11:13.699 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20210511 -> 20210511 2024-04-24T08:11:13.699 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20210716 -> 20210716 2024-04-24T08:11:13.699 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20210818 -> 20210818 2024-04-24T08:11:13.699 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20210919 -> 20210919 2024-04-24T08:11:13.699 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20211027 -> 20211027 2024-04-24T08:11:13.701 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20211216 -> 20211216 2024-04-24T08:11:13.701 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220209 -> 20220209 2024-04-24T08:11:13.701 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220310 -> 20220310 2024-04-24T08:11:13.701 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220411 -> 20220411 2024-04-24T08:11:13.701 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220509 -> 20220509 2024-04-24T08:11:13.701 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220610 -> 20220610 2024-04-24T08:11:13.701 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220708 -> 20220708 2024-04-24T08:11:13.701 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220815 -> 20220815 2024-04-24T08:11:13.701 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220913 -> 20220913 2024-04-24T08:11:13.702 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20221012 -> 20221012 2024-04-24T08:11:13.702 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20221109 -> 20221109 2024-04-24T08:11:13.702 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20221214 -> 20221214 2024-04-24T08:11:13.702 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230117 -> 20230117 2024-04-24T08:11:13.702 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230210 -> 20230210 2024-04-24T08:11:13.702 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230310 -> 20230310 2024-04-24T08:11:13.702 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230404 -> 20230404 2024-04-24T08:11:13.702 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230515 -> 20230515 2024-04-24T08:11:13.703 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230625 -> 20230625 2024-04-24T08:11:13.703 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230804 -> 20230804 2024-04-24T08:11:13.703 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230919 -> 20230919 2024-04-24T08:11:13.703 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20231030 -> 20231030 2024-04-24T08:11:13.703 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20231111 -> 20231111 2024-04-24T08:11:13.704 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20231211 -> 20231211 2024-04-24T08:11:13.704 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20240115 -> 20240115 2024-04-24T08:11:13.704 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20240220 -> 20240220 2024-04-24T08:11:13.704 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20240312 -> 20240312 2024-04-24T08:11:13.704 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20240410 -> 20240410 2024-04-24T08:11:15.410 INFO:teuthology.orchestra.run.smithi088.stderr:Updating files: 45% (1532/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 59% (1995/3381) Updating files: 59% (2013/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 69% (2333/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 74% (2519/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 83% (2807/3381) Updating files: 83% (2817/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-24T08:11:15.415 INFO:teuthology.orchestra.run.smithi088.stdout:HEAD is now at a7acbf5c Merge branch 'robot/pr-0-1713880828' into 'main' 2024-04-24T08:11:15.438 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-24T08:11:15.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T08:11:15.672 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-24T08:11:15.672 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-24T08:11:15.675 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi088.front.sepia.ceph.com to complete... 2024-04-24T08:11:17.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24 08:11:17 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-24T08:11:17.378 INFO:teuthology.orchestra.run.smithi088.stderr:FINISHED --2024-04-24 08:11:17-- 2024-04-24T08:11:17.378 INFO:teuthology.orchestra.run.smithi088.stderr:Total wall clock time: 1.7s 2024-04-24T08:11:17.379 INFO:teuthology.orchestra.run.smithi088.stderr:Downloaded: 1 files, 43M in 1.5s (27.6 MB/s) 2024-04-24T08:11:17.383 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-24T08:11:17.383 DEBUG:teuthology.orchestra.run.smithi088:> sudo dpkg -i /tmp/linux-image.deb 2024-04-24T08:11:17.633 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-24T08:11:17.971 INFO:teuthology.orchestra.run.smithi142.stderr:Updating files: 44% (1521/3381) Updating files: 45% (1522/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 59% (1995/3381) Updating files: 59% (2006/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 69% (2333/3381) Updating files: 69% (2362/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 83% (2807/3381) Updating files: 83% (2812/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-24T08:11:17.976 INFO:teuthology.orchestra.run.smithi142.stdout:HEAD is now at a7acbf5c Merge branch 'robot/pr-0-1713880828' into 'main' 2024-04-24T08:11:17.997 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-24T08:11:17.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T08:11:18.154 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-24T08:11:18.154 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-24T08:11:18.157 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi142.front.sepia.ceph.com to complete... 2024-04-24T08:11:19.596 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-24T08:11:19.601 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-24T08:11:19.708 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-24T08:11:19.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24 08:11:19 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-24T08:11:19.856 INFO:teuthology.orchestra.run.smithi142.stderr:FINISHED --2024-04-24 08:11:19-- 2024-04-24T08:11:19.856 INFO:teuthology.orchestra.run.smithi142.stderr:Total wall clock time: 1.7s 2024-04-24T08:11:19.856 INFO:teuthology.orchestra.run.smithi142.stderr:Downloaded: 1 files, 43M in 1.5s (27.7 MB/s) 2024-04-24T08:11:19.861 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-24T08:11:19.861 DEBUG:teuthology.orchestra.run.smithi142:> sudo dpkg -i /tmp/linux-image.deb 2024-04-24T08:11:20.123 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-24T08:11:22.072 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-24T08:11:22.076 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-24T08:11:22.258 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-24T08:11:23.319 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-24T08:11:23.416 INFO:teuthology.orchestra.run.smithi088.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:26.412 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-24T08:11:26.518 INFO:teuthology.orchestra.run.smithi142.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:45.490 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub' 2024-04-24T08:11:45.508 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T08:11:45.569 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2024-04-24T08:11:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:45.920 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:46.276 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T08:11:46.283 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T08:11:46.347 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T08:11:46.353 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T08:11:46.504 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T08:11:46.504 INFO:teuthology.orchestra.run.smithi088.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T08:11:46.504 INFO:teuthology.orchestra.run.smithi088.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T08:11:46.566 INFO:teuthology.orchestra.run.smithi088.stderr:done 2024-04-24T08:11:46.764 DEBUG:teuthology.orchestra.run.smithi088:> dpkg-deb -c /tmp/linux-image.deb 2024-04-24T08:11:46.772 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-24T08:11:46.772 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-24T08:11:46.772 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:46.789 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:46.790 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:46.812 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-24T08:11:46.812 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-24T08:11:46.812 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-24T08:11:46.812 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-24T08:11:46.812 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-24T08:11:46.812 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-24T08:11:46.812 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-24T08:11:46.813 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-24T08:11:46.813 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-24T08:11:46.813 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-24T08:11:46.813 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-24T08:11:46.813 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-24T08:11:46.813 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-24T08:11:46.813 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-24T08:11:46.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-24T08:11:46.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-24T08:11:46.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-24T08:11:46.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-24T08:11:46.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-24T08:11:46.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-24T08:11:46.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-24T08:11:46.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-24T08:11:46.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-24T08:11:46.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-24T08:11:46.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-24T08:11:46.818 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-24T08:11:46.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-24T08:11:46.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-24T08:11:46.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-24T08:11:46.840 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-24T08:11:46.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-24T08:11:46.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-24T08:11:46.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-24T08:11:46.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-24T08:11:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-24T08:11:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-24T08:11:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-24T08:11:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-24T08:11:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-24T08:11:46.846 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-24T08:11:46.846 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-24T08:11:46.846 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-24T08:11:46.846 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-24T08:11:46.846 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-24T08:11:46.846 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-24T08:11:46.846 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-24T08:11:46.846 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-24T08:11:46.846 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-24T08:11:46.846 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-24T08:11:46.846 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-24T08:11:46.846 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-24T08:11:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-24T08:11:46.848 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-24T08:11:46.849 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-24T08:11:46.850 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-24T08:11:46.851 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-24T08:11:46.852 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-24T08:11:46.853 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-24T08:11:46.854 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-24T08:11:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-24T08:11:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-24T08:11:46.894 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-24T08:11:46.895 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-24T08:11:46.896 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-24T08:11:46.897 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-24T08:11:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-24T08:11:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-24T08:11:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-24T08:11:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-24T08:11:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-24T08:11:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-24T08:11:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-24T08:11:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-24T08:11:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-24T08:11:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-24T08:11:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-24T08:11:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-24T08:11:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-24T08:11:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-24T08:11:46.901 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-24T08:11:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-24T08:11:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-24T08:11:46.904 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-24T08:11:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-24T08:11:46.906 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-24T08:11:46.907 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-24T08:11:46.908 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-24T08:11:46.909 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-24T08:11:46.910 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-24T08:11:46.911 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-24T08:11:46.912 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-24T08:11:46.913 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-24T08:11:46.914 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-24T08:11:46.915 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-24T08:11:46.916 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-24T08:11:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-24T08:11:46.918 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-24T08:11:46.919 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-24T08:11:46.920 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-24T08:11:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-24T08:11:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-24T08:11:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-24T08:11:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-24T08:11:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-24T08:11:46.926 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-24T08:11:46.927 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-24T08:11:46.927 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-24T08:11:46.927 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-24T08:11:46.927 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-24T08:11:46.943 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-24T08:11:46.943 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-24T08:11:46.943 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-24T08:11:46.944 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-24T08:11:46.945 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-24T08:11:46.946 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-24T08:11:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-24T08:11:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-24T08:11:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-24T08:11:46.950 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-24T08:11:46.951 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-24T08:11:46.952 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-24T08:11:46.953 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-24T08:11:46.954 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-24T08:11:46.955 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-24T08:11:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-24T08:11:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-24T08:11:46.958 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-24T08:11:46.959 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-24T08:11:46.960 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-24T08:11:46.985 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-24T08:11:46.985 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-24T08:11:46.985 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-24T08:11:46.985 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-24T08:11:46.985 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-24T08:11:46.985 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-24T08:11:46.985 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-24T08:11:46.985 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-24T08:11:46.985 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-24T08:11:46.985 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-24T08:11:46.986 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-24T08:11:46.987 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-24T08:11:46.988 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-24T08:11:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-24T08:11:46.990 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-24T08:11:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-24T08:11:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-24T08:11:46.993 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-24T08:11:46.994 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-24T08:11:46.995 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-24T08:11:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-24T08:11:46.997 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-24T08:11:46.998 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-24T08:11:46.999 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-24T08:11:47.000 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-24T08:11:47.001 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-24T08:11:47.002 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-24T08:11:47.003 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-24T08:11:47.004 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-24T08:11:47.005 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-24T08:11:47.006 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-24T08:11:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-24T08:11:47.008 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-24T08:11:47.009 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-24T08:11:47.009 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-24T08:11:47.009 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-24T08:11:47.040 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-24T08:11:47.040 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-24T08:11:47.040 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-24T08:11:47.040 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-24T08:11:47.040 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-24T08:11:47.040 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-24T08:11:47.040 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-24T08:11:47.040 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-24T08:11:47.041 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-24T08:11:47.042 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-24T08:11:47.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-24T08:11:47.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-24T08:11:47.045 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-24T08:11:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-24T08:11:47.047 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-24T08:11:47.048 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-24T08:11:47.049 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-24T08:11:47.050 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-24T08:11:47.051 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-24T08:11:47.052 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-24T08:11:47.053 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-24T08:11:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-24T08:11:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-24T08:11:47.056 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-24T08:11:47.057 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-24T08:11:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-24T08:11:47.059 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-24T08:11:47.060 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-24T08:11:47.061 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-24T08:11:47.062 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-24T08:11:47.062 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-24T08:11:47.062 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-24T08:11:47.062 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-24T08:11:47.062 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-24T08:11:47.062 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-24T08:11:47.062 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-24T08:11:47.062 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-24T08:11:47.062 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-24T08:11:47.062 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-24T08:11:47.062 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-24T08:11:47.063 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-24T08:11:47.064 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-24T08:11:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-24T08:11:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-24T08:11:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-24T08:11:47.068 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-24T08:11:47.069 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-24T08:11:47.069 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-24T08:11:47.069 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-24T08:11:47.069 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-24T08:11:47.069 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-24T08:11:47.069 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-24T08:11:47.069 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-24T08:11:47.069 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-24T08:11:47.069 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-24T08:11:47.069 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-24T08:11:47.069 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-24T08:11:47.076 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-24T08:11:47.077 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-24T08:11:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-24T08:11:47.079 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-24T08:11:47.080 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-24T08:11:47.081 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-24T08:11:47.082 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-24T08:11:47.083 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-24T08:11:47.084 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-24T08:11:47.084 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-24T08:11:47.084 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-24T08:11:47.084 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-24T08:11:47.084 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-24T08:11:47.084 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-24T08:11:47.084 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-24T08:11:47.084 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-24T08:11:47.084 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-24T08:11:47.084 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-24T08:11:47.084 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-24T08:11:47.085 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-24T08:11:47.085 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-24T08:11:47.085 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-24T08:11:47.085 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-24T08:11:47.085 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-24T08:11:47.085 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-24T08:11:47.086 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-24T08:11:47.086 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-24T08:11:47.086 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-24T08:11:47.086 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-24T08:11:47.086 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-24T08:11:47.086 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-24T08:11:47.086 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-24T08:11:47.089 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-24T08:11:47.089 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-24T08:11:47.089 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-24T08:11:47.089 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-24T08:11:47.089 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-24T08:11:47.089 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-24T08:11:47.089 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-24T08:11:47.089 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-24T08:11:47.089 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-24T08:11:47.090 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-24T08:11:47.091 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-24T08:11:47.091 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-24T08:11:47.091 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-24T08:11:47.091 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-24T08:11:47.091 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-24T08:11:47.091 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-24T08:11:47.091 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-24T08:11:47.091 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-24T08:11:47.091 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-24T08:11:47.091 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-24T08:11:47.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-24T08:11:47.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-24T08:11:47.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-24T08:11:47.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-24T08:11:47.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-24T08:11:47.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-24T08:11:47.094 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-24T08:11:47.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-24T08:11:47.094 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-24T08:11:47.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-24T08:11:47.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-24T08:11:47.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-24T08:11:47.096 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-24T08:11:47.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-24T08:11:47.096 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-24T08:11:47.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-24T08:11:47.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-24T08:11:47.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-24T08:11:47.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-24T08:11:47.096 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-24T08:11:47.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-24T08:11:47.098 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-24T08:11:47.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-24T08:11:47.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-24T08:11:47.098 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-24T08:11:47.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-24T08:11:47.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-24T08:11:47.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-24T08:11:47.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-24T08:11:47.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-24T08:11:47.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-24T08:11:47.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-24T08:11:47.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-24T08:11:47.100 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-24T08:11:47.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-24T08:11:47.101 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-24T08:11:47.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-24T08:11:47.101 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-24T08:11:47.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-24T08:11:47.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-24T08:11:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-24T08:11:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-24T08:11:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-24T08:11:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-24T08:11:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-24T08:11:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-24T08:11:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-24T08:11:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-24T08:11:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-24T08:11:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-24T08:11:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-24T08:11:47.102 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-24T08:11:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-24T08:11:47.103 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-24T08:11:47.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-24T08:11:47.115 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-24T08:11:47.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-24T08:11:47.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-24T08:11:47.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-24T08:11:47.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-24T08:11:47.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-24T08:11:47.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-24T08:11:47.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-24T08:11:47.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-24T08:11:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-24T08:11:47.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-24T08:11:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-24T08:11:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-24T08:11:47.122 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-24T08:11:47.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-24T08:11:47.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-24T08:11:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-24T08:11:47.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-24T08:11:47.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-24T08:11:47.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-24T08:11:47.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-24T08:11:47.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-24T08:11:47.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-24T08:11:47.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-24T08:11:47.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-24T08:11:47.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-24T08:11:47.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-24T08:11:47.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-24T08:11:47.141 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-24T08:11:47.141 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-24T08:11:47.141 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-24T08:11:47.141 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-24T08:11:47.141 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-24T08:11:47.141 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-24T08:11:47.141 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-24T08:11:47.141 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-24T08:11:47.141 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-24T08:11:47.141 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-24T08:11:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-24T08:11:47.143 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-24T08:11:47.144 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-24T08:11:47.145 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-24T08:11:47.146 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-24T08:11:47.147 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-24T08:11:47.148 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-24T08:11:47.149 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-24T08:11:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-24T08:11:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-24T08:11:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-24T08:11:47.153 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-24T08:11:47.154 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-24T08:11:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-24T08:11:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-24T08:11:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-24T08:11:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-24T08:11:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-24T08:11:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-24T08:11:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-24T08:11:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-24T08:11:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-24T08:11:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-24T08:11:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-24T08:11:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-24T08:11:47.160 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:47.160 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:47.161 DEBUG:teuthology.orchestra.run.smithi088:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-24T08:11:47.189 INFO:teuthology.orchestra.run.smithi088.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-24T08:11:47.189 INFO:teuthology.orchestra.run.smithi088.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-24T08:11:47.189 INFO:teuthology.orchestra.run.smithi088.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-24T08:11:47.190 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-24T08:11:47.190 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:47.190 DEBUG:teuthology.orchestra.run.smithi088:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-24T08:11:47.232 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi088.front.sepia.ceph.com to complete... 2024-04-24T08:11:47.685 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub' 2024-04-24T08:11:47.687 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T08:11:47.706 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2024-04-24T08:11:47.931 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:47.937 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:48.161 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub' 2024-04-24T08:11:48.177 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T08:11:48.206 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-04-24T08:11:48.239 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T08:11:48.244 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T08:11:48.287 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T08:11:48.292 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T08:11:48.436 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T08:11:48.436 INFO:teuthology.orchestra.run.smithi088.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T08:11:48.436 INFO:teuthology.orchestra.run.smithi088.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T08:11:48.456 INFO:teuthology.orchestra.run.smithi088.stderr:done 2024-04-24T08:11:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:48.563 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T08:11:48.871 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T08:11:48.935 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T08:11:48.940 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T08:11:49.094 INFO:teuthology.orchestra.run.smithi142.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T08:11:49.095 INFO:teuthology.orchestra.run.smithi142.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T08:11:49.095 INFO:teuthology.orchestra.run.smithi142.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T08:11:49.134 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-04-24T08:11:49.341 DEBUG:teuthology.orchestra.run.smithi142:> dpkg-deb -c /tmp/linux-image.deb 2024-04-24T08:11:49.390 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-24T08:11:49.390 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-24T08:11:49.390 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:49.408 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:49.408 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:49.428 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-24T08:11:49.429 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-24T08:11:49.429 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-24T08:11:49.429 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-24T08:11:49.429 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-24T08:11:49.429 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-24T08:11:49.429 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-24T08:11:49.429 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-24T08:11:49.429 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-24T08:11:49.429 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-24T08:11:49.429 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-24T08:11:49.429 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-24T08:11:49.429 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-24T08:11:49.430 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-24T08:11:49.432 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-24T08:11:49.433 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-24T08:11:49.434 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-24T08:11:49.435 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-24T08:11:49.450 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-24T08:11:49.450 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-24T08:11:49.450 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-24T08:11:49.450 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-24T08:11:49.450 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-24T08:11:49.450 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-24T08:11:49.451 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-24T08:11:49.452 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-24T08:11:49.453 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-24T08:11:49.454 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-24T08:11:49.455 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-24T08:11:49.456 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-24T08:11:49.456 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-24T08:11:49.456 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-24T08:11:49.456 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-24T08:11:49.456 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-24T08:11:49.456 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-24T08:11:49.456 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-24T08:11:49.456 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-24T08:11:49.456 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-24T08:11:49.456 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-24T08:11:49.456 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-24T08:11:49.456 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-24T08:11:49.457 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-24T08:11:49.458 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-24T08:11:49.459 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-24T08:11:49.460 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-24T08:11:49.460 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-24T08:11:49.460 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-24T08:11:49.460 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-24T08:11:49.460 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-24T08:11:49.460 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-24T08:11:49.460 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-24T08:11:49.460 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-24T08:11:49.460 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-24T08:11:49.460 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-24T08:11:49.520 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-24T08:11:49.520 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-24T08:11:49.520 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-24T08:11:49.520 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-24T08:11:49.520 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-24T08:11:49.520 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-24T08:11:49.520 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-24T08:11:49.520 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-24T08:11:49.521 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-24T08:11:49.521 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-24T08:11:49.521 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-24T08:11:49.521 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-24T08:11:49.521 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-24T08:11:49.521 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-24T08:11:49.522 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-24T08:11:49.523 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-24T08:11:49.524 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-24T08:11:49.525 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-24T08:11:49.526 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-24T08:11:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-24T08:11:49.528 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-24T08:11:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-24T08:11:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-24T08:11:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-24T08:11:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-24T08:11:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-24T08:11:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-24T08:11:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-24T08:11:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-24T08:11:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-24T08:11:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-24T08:11:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-24T08:11:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-24T08:11:49.530 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-24T08:11:49.531 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-24T08:11:49.531 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-24T08:11:49.531 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-24T08:11:49.531 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-24T08:11:49.531 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-24T08:11:49.531 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-24T08:11:49.531 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-24T08:11:49.531 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-24T08:11:49.531 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-24T08:11:49.531 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-24T08:11:49.531 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-24T08:11:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-24T08:11:49.533 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-24T08:11:49.533 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-24T08:11:49.533 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-24T08:11:49.533 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-24T08:11:49.533 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-24T08:11:49.533 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-24T08:11:49.533 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-24T08:11:49.533 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-24T08:11:49.533 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-24T08:11:49.533 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-24T08:11:49.533 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-24T08:11:49.533 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-24T08:11:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-24T08:11:49.535 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-24T08:11:49.536 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-24T08:11:49.536 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-24T08:11:49.536 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-24T08:11:49.536 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-24T08:11:49.536 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-24T08:11:49.536 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-24T08:11:49.536 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-24T08:11:49.536 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-24T08:11:49.536 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-24T08:11:49.536 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-24T08:11:49.536 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-24T08:11:49.536 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-24T08:11:49.537 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-24T08:11:49.538 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-24T08:11:49.538 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-24T08:11:49.538 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-24T08:11:49.538 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-24T08:11:49.538 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-24T08:11:49.538 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-24T08:11:49.538 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-24T08:11:49.538 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-24T08:11:49.538 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-24T08:11:49.538 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-24T08:11:49.538 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-24T08:11:49.538 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-24T08:11:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-24T08:11:49.540 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-24T08:11:49.541 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-24T08:11:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-24T08:11:49.543 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-24T08:11:49.544 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-24T08:11:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-24T08:11:49.546 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-24T08:11:49.546 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-24T08:11:49.546 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-24T08:11:49.546 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-24T08:11:49.546 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-24T08:11:49.546 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-24T08:11:49.546 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-24T08:11:49.546 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-24T08:11:49.546 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-24T08:11:49.546 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-24T08:11:49.546 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-24T08:11:49.546 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-24T08:11:49.547 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-24T08:11:49.547 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-24T08:11:49.547 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-24T08:11:49.547 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-24T08:11:49.547 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-24T08:11:49.547 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-24T08:11:49.548 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-24T08:11:49.548 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-24T08:11:49.548 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-24T08:11:49.548 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-24T08:11:49.548 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-24T08:11:49.548 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-24T08:11:49.548 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-24T08:11:49.549 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-24T08:11:49.549 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-24T08:11:49.549 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-24T08:11:49.549 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-24T08:11:49.549 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-24T08:11:49.549 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-24T08:11:49.549 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-24T08:11:49.550 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-24T08:11:49.550 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-24T08:11:49.550 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-24T08:11:49.550 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-24T08:11:49.550 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-24T08:11:49.551 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-24T08:11:49.551 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-24T08:11:49.551 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-24T08:11:49.551 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-24T08:11:49.551 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-24T08:11:49.551 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-24T08:11:49.551 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-24T08:11:49.552 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-24T08:11:49.552 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-24T08:11:49.552 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-24T08:11:49.552 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-24T08:11:49.552 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-24T08:11:49.552 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-24T08:11:49.552 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-24T08:11:49.552 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-24T08:11:49.553 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-24T08:11:49.553 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-24T08:11:49.553 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-24T08:11:49.553 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-24T08:11:49.553 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-24T08:11:49.553 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-24T08:11:49.553 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-24T08:11:49.554 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-24T08:11:49.554 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-24T08:11:49.554 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-24T08:11:49.554 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-24T08:11:49.554 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-24T08:11:49.554 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-24T08:11:49.555 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-24T08:11:49.555 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-24T08:11:49.555 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-24T08:11:49.555 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-24T08:11:49.555 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-24T08:11:49.555 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-24T08:11:49.555 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-24T08:11:49.556 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-24T08:11:49.556 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-24T08:11:49.556 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-24T08:11:49.556 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-24T08:11:49.556 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-24T08:11:49.556 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-24T08:11:49.556 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-24T08:11:49.556 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-24T08:11:49.557 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-24T08:11:49.557 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-24T08:11:49.557 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-24T08:11:49.557 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-24T08:11:49.557 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-24T08:11:49.557 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-24T08:11:49.557 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-24T08:11:49.557 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-24T08:11:49.557 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-24T08:11:49.558 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-24T08:11:49.558 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-24T08:11:49.558 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-24T08:11:49.558 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-24T08:11:49.558 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-24T08:11:49.558 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-24T08:11:49.559 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-24T08:11:49.559 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-24T08:11:49.559 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-24T08:11:49.559 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-24T08:11:49.559 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-24T08:11:49.559 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-24T08:11:49.559 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-24T08:11:49.559 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-24T08:11:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-24T08:11:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-24T08:11:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-24T08:11:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-24T08:11:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-24T08:11:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-24T08:11:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-24T08:11:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-24T08:11:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-24T08:11:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-24T08:11:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-24T08:11:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-24T08:11:49.561 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-24T08:11:49.562 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-24T08:11:49.562 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-24T08:11:49.562 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-24T08:11:49.562 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-24T08:11:49.562 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-24T08:11:49.562 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-24T08:11:49.562 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-24T08:11:49.562 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-24T08:11:49.562 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-24T08:11:49.562 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-24T08:11:49.562 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-24T08:11:49.562 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-24T08:11:49.563 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-24T08:11:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-24T08:11:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-24T08:11:49.566 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-24T08:11:49.566 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-24T08:11:49.566 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-24T08:11:49.566 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-24T08:11:49.566 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-24T08:11:49.566 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-24T08:11:49.566 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-24T08:11:49.566 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-24T08:11:49.566 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-24T08:11:49.566 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-24T08:11:49.566 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-24T08:11:49.566 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-24T08:11:49.567 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-24T08:11:49.567 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-24T08:11:49.567 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-24T08:11:49.567 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-24T08:11:49.567 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-24T08:11:49.567 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-24T08:11:49.568 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-24T08:11:49.569 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-24T08:11:49.570 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-24T08:11:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-24T08:11:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-24T08:11:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-24T08:11:49.574 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-24T08:11:49.574 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-24T08:11:49.574 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-24T08:11:49.574 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-24T08:11:49.574 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-24T08:11:49.574 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-24T08:11:49.574 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-24T08:11:49.574 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-24T08:11:49.574 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-24T08:11:49.574 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-24T08:11:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-24T08:11:49.576 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-24T08:11:49.577 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-24T08:11:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-24T08:11:49.579 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-24T08:11:49.580 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-24T08:11:49.652 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-24T08:11:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-24T08:11:49.654 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-24T08:11:49.655 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-24T08:11:49.656 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-24T08:11:49.657 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-24T08:11:49.658 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-24T08:11:49.658 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-24T08:11:49.658 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-24T08:11:49.658 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-24T08:11:49.658 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-24T08:11:49.658 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-24T08:11:49.658 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-24T08:11:49.658 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-24T08:11:49.658 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-24T08:11:49.658 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-24T08:11:49.658 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-24T08:11:49.658 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-24T08:11:49.659 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-24T08:11:49.660 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-24T08:11:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-24T08:11:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-24T08:11:49.663 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-24T08:11:49.664 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-24T08:11:49.665 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-24T08:11:49.666 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-24T08:11:49.667 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-24T08:11:49.668 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-24T08:11:49.669 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-24T08:11:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-24T08:11:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-24T08:11:49.672 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-24T08:11:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-24T08:11:49.674 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-24T08:11:49.674 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-24T08:11:49.674 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-24T08:11:49.674 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-24T08:11:49.674 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-24T08:11:49.674 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-24T08:11:49.674 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-24T08:11:49.674 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-24T08:11:49.674 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-24T08:11:49.674 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-24T08:11:49.674 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-24T08:11:49.675 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-24T08:11:49.676 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-24T08:11:49.677 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-24T08:11:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-24T08:11:49.679 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-24T08:11:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-24T08:11:49.681 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-24T08:11:49.681 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-24T08:11:49.681 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-24T08:11:49.681 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-24T08:11:49.681 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-24T08:11:49.681 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-24T08:11:49.681 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-24T08:11:49.681 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-24T08:11:49.681 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-24T08:11:49.681 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-24T08:11:49.681 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-24T08:11:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-24T08:11:49.683 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-24T08:11:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-24T08:11:49.685 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-24T08:11:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-24T08:11:49.687 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-24T08:11:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-24T08:11:49.689 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-24T08:11:49.690 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-24T08:11:49.690 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-24T08:11:49.690 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-24T08:11:49.690 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-24T08:11:49.690 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-24T08:11:49.690 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-24T08:11:49.690 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-24T08:11:49.690 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-24T08:11:49.690 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-24T08:11:49.690 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-24T08:11:49.691 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-24T08:11:49.692 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-24T08:11:49.693 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-24T08:11:49.694 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-24T08:11:49.695 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-24T08:11:49.696 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-24T08:11:49.697 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-24T08:11:49.698 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-24T08:11:49.699 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-24T08:11:49.700 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-24T08:11:49.701 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-24T08:11:49.702 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-24T08:11:49.703 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-24T08:11:49.704 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-24T08:11:49.705 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-24T08:11:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-24T08:11:49.707 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-24T08:11:49.707 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-24T08:11:49.707 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-24T08:11:49.707 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-24T08:11:49.707 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-24T08:11:49.707 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-24T08:11:49.707 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-24T08:11:49.707 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-24T08:11:49.707 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-24T08:11:49.707 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-24T08:11:49.707 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-24T08:11:49.707 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-24T08:11:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-24T08:11:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-24T08:11:49.710 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-24T08:11:49.711 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-24T08:11:49.712 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-24T08:11:49.712 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-24T08:11:49.712 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-24T08:11:49.712 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-24T08:11:49.712 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-24T08:11:49.712 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-24T08:11:49.712 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-24T08:11:49.712 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-24T08:11:49.712 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-24T08:11:49.712 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-24T08:11:49.712 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-24T08:11:49.713 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-24T08:11:49.713 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-24T08:11:49.713 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-24T08:11:49.713 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-24T08:11:49.713 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-24T08:11:49.713 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-24T08:11:49.713 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-24T08:11:49.714 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-24T08:11:49.714 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-24T08:11:49.714 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-24T08:11:49.714 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-24T08:11:49.714 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-24T08:11:49.714 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-24T08:11:49.715 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-24T08:11:49.715 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-24T08:11:49.715 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-24T08:11:49.715 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-24T08:11:49.715 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-24T08:11:49.715 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-24T08:11:49.715 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-24T08:11:49.715 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-24T08:11:49.715 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-24T08:11:49.715 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-24T08:11:49.716 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-24T08:11:49.716 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-24T08:11:49.716 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-24T08:11:49.716 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-24T08:11:49.716 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-24T08:11:49.716 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-24T08:11:49.764 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-24T08:11:49.764 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-24T08:11:49.764 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-24T08:11:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-24T08:11:49.766 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-24T08:11:49.767 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-24T08:11:49.768 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-24T08:11:49.769 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-24T08:11:49.770 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-24T08:11:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-24T08:11:49.772 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-24T08:11:49.773 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-24T08:11:49.774 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-24T08:11:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-24T08:11:49.776 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-24T08:11:49.777 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-24T08:11:49.778 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-24T08:11:49.779 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-24T08:11:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-24T08:11:49.781 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-24T08:11:49.781 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-24T08:11:49.781 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-24T08:11:49.781 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-24T08:11:49.781 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-24T08:11:49.781 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-24T08:11:49.781 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-24T08:11:49.781 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-24T08:11:49.781 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-24T08:11:49.781 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-24T08:11:49.781 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-24T08:11:49.781 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-24T08:11:49.782 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-24T08:11:49.783 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-24T08:11:49.784 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-24T08:11:49.785 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-24T08:11:49.786 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-24T08:11:49.787 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-24T08:11:49.788 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-24T08:11:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-24T08:11:49.790 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-24T08:11:49.790 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-24T08:11:49.790 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-24T08:11:49.790 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-24T08:11:49.790 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-24T08:11:49.790 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-24T08:11:49.790 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-24T08:11:49.790 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-24T08:11:49.790 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-24T08:11:49.790 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-24T08:11:49.790 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-24T08:11:49.790 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-24T08:11:49.791 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-24T08:11:49.791 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-24T08:11:49.791 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-24T08:11:49.791 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-24T08:11:49.791 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-24T08:11:49.791 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-24T08:11:49.791 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-24T08:11:49.791 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-24T08:11:49.791 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-24T08:11:49.791 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-24T08:11:49.791 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-24T08:11:49.791 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-24T08:11:49.792 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-24T08:11:49.793 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-24T08:11:49.794 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-24T08:11:49.795 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-24T08:11:49.796 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-24T08:11:49.797 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-24T08:11:49.798 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-24T08:11:49.799 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-24T08:11:49.800 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-24T08:11:49.801 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-24T08:11:49.802 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-24T08:11:49.803 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-24T08:11:49.804 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-24T08:11:49.805 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-24T08:11:49.806 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-24T08:11:49.807 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-24T08:11:49.808 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-24T08:11:49.808 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-24T08:11:49.808 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-24T08:11:49.808 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-24T08:11:49.808 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-24T08:11:49.808 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-24T08:11:49.812 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:49.812 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:49.812 DEBUG:teuthology.orchestra.run.smithi142:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-24T08:11:49.819 INFO:teuthology.orchestra.run.smithi142.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-24T08:11:49.819 INFO:teuthology.orchestra.run.smithi142.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-24T08:11:49.819 INFO:teuthology.orchestra.run.smithi142.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-24T08:11:49.820 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-24T08:11:49.820 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:49.820 DEBUG:teuthology.orchestra.run.smithi142:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-24T08:11:49.864 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi142.front.sepia.ceph.com to complete... 2024-04-24T08:11:50.338 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub' 2024-04-24T08:11:50.339 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T08:11:50.344 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-04-24T08:11:50.586 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:50.593 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-24T08:11:50.810 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T08:11:50.815 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T08:11:50.855 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T08:11:50.860 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T08:11:51.013 INFO:teuthology.orchestra.run.smithi142.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T08:11:51.013 INFO:teuthology.orchestra.run.smithi142.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T08:11:51.013 INFO:teuthology.orchestra.run.smithi142.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T08:11:51.028 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-04-24T08:12:19.621 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-24T08:12:19.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T08:12:19.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T08:12:22.123 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-24T08:12:22.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-24T08:12:22.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T08:12:38.046 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-24T08:12:47.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T08:12:47.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T08:12:50.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-24T08:12:56.734 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-24T08:13:02.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T08:13:02.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T08:13:05.214 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-24T08:13:05.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-24T08:13:05.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T08:13:20.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T08:13:20.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T08:13:24.126 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-24T08:13:36.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-24T08:13:36.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T08:13:36.734 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-24T08:13:37.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-24T08:13:37.598 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-24T08:13:37.598 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-04-24T08:13:37.653 INFO:teuthology.orchestra.run.smithi142.stdout:6.9.0-rc3-g806ec36b2112 2024-04-24T08:13:37.653 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-24T08:13:37.653 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T08:13:37.653 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-24T08:13:38.654 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-24T08:13:38.654 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T08:13:38.718 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-24T08:13:38.739 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-04-24T08:13:38.793 DEBUG:teuthology.parallel:result is None 2024-04-24T08:13:56.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T08:13:56.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T08:13:56.936 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-04-24T08:13:57.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T08:13:57.535 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-24T08:13:57.535 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-04-24T08:13:57.583 INFO:teuthology.orchestra.run.smithi088.stdout:6.9.0-rc3-g806ec36b2112 2024-04-24T08:13:57.583 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-24T08:13:57.583 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T08:13:57.583 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-24T08:13:58.584 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-24T08:13:58.585 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T08:13:58.650 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2024-04-24T08:13:58.723 DEBUG:teuthology.parallel:result is None 2024-04-24T08:13:58.723 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-24T08:13:58.735 INFO:teuthology.task.internal:Creating test directory... 2024-04-24T08:13:58.735 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T08:13:58.738 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T08:13:58.747 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-24T08:13:58.757 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-24T08:13:58.770 INFO:teuthology.task.internal:Creating archive directory... 2024-04-24T08:13:58.771 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T08:13:58.791 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T08:13:58.825 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-24T08:13:58.835 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-24T08:13:58.835 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T08:13:58.850 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T08:13:58.871 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T08:13:58.885 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T08:13:58.907 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T08:13:58.920 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T08:13:58.923 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-24T08:13:58.931 INFO:teuthology.task.internal:Configuring sudo... 2024-04-24T08:13:58.931 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T08:13:58.934 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T08:13:58.991 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-24T08:13:59.000 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-24T08:13:59.000 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T08:13:59.003 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T08:13:59.046 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T08:13:59.059 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T08:13:59.107 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:13:59.108 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T08:13:59.184 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T08:13:59.193 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T08:13:59.242 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:13:59.242 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T08:13:59.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-04-24T08:13:59.328 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-04-24T08:13:59.456 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-24T08:13:59.467 INFO:teuthology.task.internal:Starting timer... 2024-04-24T08:13:59.467 INFO:teuthology.run_tasks:Running task pcp... 2024-04-24T08:13:59.479 INFO:teuthology.run_tasks:Running task selinux... 2024-04-24T08:13:59.489 DEBUG:teuthology.task.selinux:Excluding smithi088: OS 'ubuntu' does not support SELinux 2024-04-24T08:13:59.489 DEBUG:teuthology.task.selinux:Excluding smithi142: OS 'ubuntu' does not support SELinux 2024-04-24T08:13:59.489 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-24T08:13:59.489 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-24T08:13:59.489 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-24T08:13:59.490 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-24T08:13:59.501 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-24T08:13:59.507 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-24T08:13:59.632 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-24T08:13:59.649 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-24T08:13:59.650 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-24T08:21:34.009 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-04-24T08:21:34.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T08:21:34.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T08:21:34.095 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-04-24T08:21:34.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T08:21:34.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-24T08:21:34.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T08:21:34.287 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-24T08:21:34.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-24T08:21:34.413 INFO:teuthology.run_tasks:Running task clock... 2024-04-24T08:21:34.425 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-24T08:21:34.425 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T08:21:34.426 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T08:21:34.429 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T08:21:34.429 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T08:21:34.464 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-24T08:21:34.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: Command line: ntpd -gq 2024-04-24T08:21:34.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: ---------------------------------------------------- 2024-04-24T08:21:34.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: ntp-4 is maintained by Network Time Foundation, 2024-04-24T08:21:34.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-24T08:21:34.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: corporation. Support and training for ntp-4 are 2024-04-24T08:21:34.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: available at https://www.nwtime.org/support 2024-04-24T08:21:34.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: ---------------------------------------------------- 2024-04-24T08:21:34.466 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: proto: precision = 0.042 usec (-24) 2024-04-24T08:21:34.466 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: basedate set to 2022-02-04 2024-04-24T08:21:34.466 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: gps base set to 2022-02-06 (week 2196) 2024-04-24T08:21:34.466 INFO:teuthology.orchestra.run.smithi088.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T08:21:34.467 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T08:21:34.467 INFO:teuthology.orchestra.run.smithi088.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-24T08:21:34.468 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: restrict ::: KOD does nothing without LIMITED. 2024-04-24T08:21:34.468 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: Listen and drop on 0 v6wildcard [::]:123 2024-04-24T08:21:34.468 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-24T08:21:34.468 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: Listen normally on 2 lo 127.0.0.1:123 2024-04-24T08:21:34.468 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: Listen normally on 3 enp3s0f1 172.21.15.88:123 2024-04-24T08:21:34.468 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: Listen normally on 4 lo [::1]:123 2024-04-24T08:21:34.468 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d42d%5]:123 2024-04-24T08:21:34.468 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:34 ntpd[17226]: Listening on routing socket on fd #22 for interface updates 2024-04-24T08:21:34.499 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-24T08:21:34.500 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: Command line: ntpd -gq 2024-04-24T08:21:34.500 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: ---------------------------------------------------- 2024-04-24T08:21:34.500 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: ntp-4 is maintained by Network Time Foundation, 2024-04-24T08:21:34.500 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-24T08:21:34.500 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: corporation. Support and training for ntp-4 are 2024-04-24T08:21:34.500 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: available at https://www.nwtime.org/support 2024-04-24T08:21:34.500 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: ---------------------------------------------------- 2024-04-24T08:21:34.501 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: proto: precision = 0.045 usec (-24) 2024-04-24T08:21:34.501 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: basedate set to 2022-02-04 2024-04-24T08:21:34.501 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: gps base set to 2022-02-06 (week 2196) 2024-04-24T08:21:34.501 INFO:teuthology.orchestra.run.smithi142.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T08:21:34.501 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T08:21:34.502 INFO:teuthology.orchestra.run.smithi142.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-24T08:21:34.503 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: restrict ::: KOD does nothing without LIMITED. 2024-04-24T08:21:34.503 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: Listen and drop on 0 v6wildcard [::]:123 2024-04-24T08:21:34.503 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-24T08:21:34.503 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: Listen normally on 2 lo 127.0.0.1:123 2024-04-24T08:21:34.503 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: Listen normally on 3 enp3s0f1 172.21.15.142:123 2024-04-24T08:21:34.503 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: Listen normally on 4 lo [::1]:123 2024-04-24T08:21:34.503 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e0d%5]:123 2024-04-24T08:21:34.503 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:34 ntpd[17207]: Listening on routing socket on fd #22 for interface updates 2024-04-24T08:21:35.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:35 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:35.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:35 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:35.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:35 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:35.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:35 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:35.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:35 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:35.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:35 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:35.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:35 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:35.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:35 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:35.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:35 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:35.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:35 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:35.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:35 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:35.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:35 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:35.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:35 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:35.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:35 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:35.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:35 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:35.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:35 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:35.502 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:35 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:35.502 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:35 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:36.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:36 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:36.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:36 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:36.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:36 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:36.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:36 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:36.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:36 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:36.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:36 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:36.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:36 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:36.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:36 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:36.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:36 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:36.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:36 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:36.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:36 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:36.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:36 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:36.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:36 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:36.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:36 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:37.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:37 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:37 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:37 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:37 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:37 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:37.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:37 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:37.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:37 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:37.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:37 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:37.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:37 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:37.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:37 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:37.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:37 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:37.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:37 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:37.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:37 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:37.502 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:37 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:37.502 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:37 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:37.502 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:37 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:37.502 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:37 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:37.502 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:37 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:38.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:38.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:38.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:38.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:38.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:38 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:38.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:38 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:38.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:38 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:38.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:38 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:38.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:38 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:38.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:38 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:38.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:38 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:39 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:39 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:39 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:39 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:39 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:39 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:39 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:39 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:39 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:39 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:39 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:39 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:39 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:39 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:39 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:39 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:39 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:39 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:40.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:40 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:40.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:40 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:40.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:40 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:40.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:40 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:40.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:40 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:40.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:40 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:40.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:40 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:40.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:40 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:40.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:40 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:40.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:40 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:40.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:40 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:40.467 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:40 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:40.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:40 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:40.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:40 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:40.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:40 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:40.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:40 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:40.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:40 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:40.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:40 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:41 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:41 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:41 ntpd[17226]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:41 ntpd[17226]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:41 ntpd[17226]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:41 ntpd[17226]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:41.466 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 08:21:41 ntpd[17226]: ntpd: time slew -0.000683 s 2024-04-24T08:21:41.466 INFO:teuthology.orchestra.run.smithi088.stdout:ntpd: time slew -0.000683s 2024-04-24T08:21:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:41 ntpd[17226]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-24T08:21:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 08:21:41 ntpd[17226]: can't open /var/log/ntpstats/loopstats.20240424: Permission denied 2024-04-24T08:21:41.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:41 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:41.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:41 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:41.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:41 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:41.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:41 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:41.500 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:41 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T08:21:41.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:41 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T08:21:41.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:41 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T08:21:41.501 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:41 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T08:21:41.501 INFO:teuthology.orchestra.run.smithi142.stdout:24 Apr 08:21:41 ntpd[17207]: ntpd: time slew -0.000512 s 2024-04-24T08:21:41.501 INFO:teuthology.orchestra.run.smithi142.stdout:ntpd: time slew -0.000512s 2024-04-24T08:21:41.502 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:41 ntpd[17207]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-24T08:21:41.502 INFO:teuthology.orchestra.run.smithi142.stderr:24 Apr 08:21:41 ntpd[17207]: can't open /var/log/ntpstats/loopstats.20240424: Permission denied 2024-04-24T08:21:41.561 INFO:teuthology.orchestra.run.smithi088.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T08:21:41.561 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================== 2024-04-24T08:21:41.561 INFO:teuthology.orchestra.run.smithi088.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T08:21:41.561 INFO:teuthology.orchestra.run.smithi088.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T08:21:41.561 INFO:teuthology.orchestra.run.smithi088.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T08:21:41.561 INFO:teuthology.orchestra.run.smithi088.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T08:21:41.609 INFO:teuthology.orchestra.run.smithi142.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T08:21:41.609 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================== 2024-04-24T08:21:41.609 INFO:teuthology.orchestra.run.smithi142.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T08:21:41.609 INFO:teuthology.orchestra.run.smithi142.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T08:21:41.609 INFO:teuthology.orchestra.run.smithi142.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T08:21:41.609 INFO:teuthology.orchestra.run.smithi142.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T08:21:41.610 INFO:teuthology.run_tasks:Running task install... 2024-04-24T08:21:41.620 DEBUG:teuthology.task.install:project ceph 2024-04-24T08:21:41.620 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1f81fb397ae98da7563d451a78c61574c8f4e6e0'}} 2024-04-24T08:21:41.620 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1f81fb397ae98da7563d451a78c61574c8f4e6e0'} 2024-04-24T08:21:41.621 INFO:teuthology.task.install:Using flavor: default 2024-04-24T08:21:41.626 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-24T08:21:41.626 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-24T08:21:41.626 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-key list | grep Ceph 2024-04-24T08:21:41.626 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-key list | grep Ceph 2024-04-24T08:21:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-24T08:21:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-24T08:21:41.776 INFO:teuthology.orchestra.run.smithi088.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-24T08:21:41.776 INFO:teuthology.orchestra.run.smithi088.stdout:uid [ unknown] Ceph.com (release key) 2024-04-24T08:21:41.777 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-24T08:21:41.777 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-24T08:21:41.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1f81fb397ae98da7563d451a78c61574c8f4e6e0 2024-04-24T08:21:41.806 INFO:teuthology.orchestra.run.smithi142.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-24T08:21:41.806 INFO:teuthology.orchestra.run.smithi142.stdout:uid [ unknown] Ceph.com (release key) 2024-04-24T08:21:41.806 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-24T08:21:41.807 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-24T08:21:41.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1f81fb397ae98da7563d451a78c61574c8f4e6e0 2024-04-24T08:21:41.946 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default/ 2024-04-24T08:21:41.946 INFO:teuthology.task.install.deb:Package version is 19.0.0-3116-g1f81fb39-1jammy 2024-04-24T08:21:41.988 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default/ 2024-04-24T08:21:41.988 INFO:teuthology.task.install.deb:Package version is 19.0.0-3116-g1f81fb39-1jammy 2024-04-24T08:21:42.056 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:21:42.056 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-24T08:21:42.076 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-get update 2024-04-24T08:21:42.097 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:21:42.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-24T08:21:42.116 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get update 2024-04-24T08:21:42.288 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T08:21:42.288 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T08:21:42.297 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T08:21:42.303 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T08:21:42.303 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T08:21:42.312 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T08:21:42.317 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T08:21:42.332 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T08:21:42.372 INFO:teuthology.orchestra.run.smithi142.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy InRelease 2024-04-24T08:21:42.406 INFO:teuthology.orchestra.run.smithi088.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy InRelease 2024-04-24T08:21:42.410 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-24T08:21:42.443 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-24T08:21:42.450 INFO:teuthology.orchestra.run.smithi142.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-24T08:21:42.480 INFO:teuthology.orchestra.run.smithi088.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-24T08:21:42.492 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-24T08:21:42.517 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,401 B] 2024-04-24T08:21:42.564 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-24T08:21:42.577 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,401 B] 2024-04-24T08:21:42.883 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 29.2 kB in 1s (50.2 kB/s) 2024-04-24T08:21:42.889 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 29.2 kB in 1s (52.9 kB/s) 2024-04-24T08:21:43.864 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2024-04-24T08:21:43.866 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-24T08:21:43.878 DEBUG:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3116-g1f81fb39-1jammy cephadm=19.0.0-3116-g1f81fb39-1jammy ceph-mds=19.0.0-3116-g1f81fb39-1jammy ceph-mgr=19.0.0-3116-g1f81fb39-1jammy ceph-common=19.0.0-3116-g1f81fb39-1jammy ceph-fuse=19.0.0-3116-g1f81fb39-1jammy ceph-test=19.0.0-3116-g1f81fb39-1jammy ceph-volume=19.0.0-3116-g1f81fb39-1jammy radosgw=19.0.0-3116-g1f81fb39-1jammy python3-rados=19.0.0-3116-g1f81fb39-1jammy python3-rgw=19.0.0-3116-g1f81fb39-1jammy python3-cephfs=19.0.0-3116-g1f81fb39-1jammy python3-rbd=19.0.0-3116-g1f81fb39-1jammy libcephfs2=19.0.0-3116-g1f81fb39-1jammy libcephfs-dev=19.0.0-3116-g1f81fb39-1jammy librados2=19.0.0-3116-g1f81fb39-1jammy librbd1=19.0.0-3116-g1f81fb39-1jammy rbd-fuse=19.0.0-3116-g1f81fb39-1jammy python3-cephfs=19.0.0-3116-g1f81fb39-1jammy cephfs-shell=19.0.0-3116-g1f81fb39-1jammy cephfs-top=19.0.0-3116-g1f81fb39-1jammy cephfs-mirror=19.0.0-3116-g1f81fb39-1jammy 2024-04-24T08:21:43.881 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3116-g1f81fb39-1jammy cephadm=19.0.0-3116-g1f81fb39-1jammy ceph-mds=19.0.0-3116-g1f81fb39-1jammy ceph-mgr=19.0.0-3116-g1f81fb39-1jammy ceph-common=19.0.0-3116-g1f81fb39-1jammy ceph-fuse=19.0.0-3116-g1f81fb39-1jammy ceph-test=19.0.0-3116-g1f81fb39-1jammy ceph-volume=19.0.0-3116-g1f81fb39-1jammy radosgw=19.0.0-3116-g1f81fb39-1jammy python3-rados=19.0.0-3116-g1f81fb39-1jammy python3-rgw=19.0.0-3116-g1f81fb39-1jammy python3-cephfs=19.0.0-3116-g1f81fb39-1jammy python3-rbd=19.0.0-3116-g1f81fb39-1jammy libcephfs2=19.0.0-3116-g1f81fb39-1jammy libcephfs-dev=19.0.0-3116-g1f81fb39-1jammy librados2=19.0.0-3116-g1f81fb39-1jammy librbd1=19.0.0-3116-g1f81fb39-1jammy rbd-fuse=19.0.0-3116-g1f81fb39-1jammy python3-cephfs=19.0.0-3116-g1f81fb39-1jammy cephfs-shell=19.0.0-3116-g1f81fb39-1jammy cephfs-top=19.0.0-3116-g1f81fb39-1jammy cephfs-mirror=19.0.0-3116-g1f81fb39-1jammy 2024-04-24T08:21:43.952 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2024-04-24T08:21:43.955 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-24T08:21:44.126 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2024-04-24T08:21:44.127 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2024-04-24T08:21:44.129 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-04-24T08:21:44.130 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-04-24T08:21:44.303 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T08:21:44.303 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T08:21:44.304 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T08:21:44.304 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T08:21:44.305 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T08:21:44.305 INFO:teuthology.orchestra.run.smithi142.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T08:21:44.306 INFO:teuthology.orchestra.run.smithi142.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T08:21:44.306 INFO:teuthology.orchestra.run.smithi142.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T08:21:44.306 INFO:teuthology.orchestra.run.smithi142.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T08:21:44.306 INFO:teuthology.orchestra.run.smithi142.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T08:21:44.306 INFO:teuthology.orchestra.run.smithi142.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T08:21:44.307 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T08:21:44.307 INFO:teuthology.orchestra.run.smithi088.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T08:21:44.307 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T08:21:44.307 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2024-04-24T08:21:44.307 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-24T08:21:44.308 INFO:teuthology.orchestra.run.smithi088.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-24T08:21:44.309 INFO:teuthology.orchestra.run.smithi088.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-24T08:21:44.310 INFO:teuthology.orchestra.run.smithi088.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-24T08:21:44.310 INFO:teuthology.orchestra.run.smithi088.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-24T08:21:44.310 INFO:teuthology.orchestra.run.smithi088.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-24T08:21:44.310 INFO:teuthology.orchestra.run.smithi088.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-24T08:21:44.310 INFO:teuthology.orchestra.run.smithi088.stdout:Recommended packages: 2024-04-24T08:21:44.310 INFO:teuthology.orchestra.run.smithi088.stdout: btrfs-tools 2024-04-24T08:21:44.312 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2024-04-24T08:21:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-24T08:21:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-24T08:21:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T08:21:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-24T08:21:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-24T08:21:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-24T08:21:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-24T08:21:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-24T08:21:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-24T08:21:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-24T08:21:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-24T08:21:44.314 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2024-04-24T08:21:44.314 INFO:teuthology.orchestra.run.smithi142.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-24T08:21:44.314 INFO:teuthology.orchestra.run.smithi142.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-24T08:21:44.314 INFO:teuthology.orchestra.run.smithi142.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-24T08:21:44.314 INFO:teuthology.orchestra.run.smithi142.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-24T08:21:44.314 INFO:teuthology.orchestra.run.smithi142.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-24T08:21:44.314 INFO:teuthology.orchestra.run.smithi142.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-24T08:21:44.314 INFO:teuthology.orchestra.run.smithi142.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-24T08:21:44.314 INFO:teuthology.orchestra.run.smithi142.stdout:Recommended packages: 2024-04-24T08:21:44.314 INFO:teuthology.orchestra.run.smithi142.stdout: btrfs-tools 2024-04-24T08:21:44.459 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2024-04-24T08:21:44.459 INFO:teuthology.orchestra.run.smithi142.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-24T08:21:44.459 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-24T08:21:44.460 INFO:teuthology.orchestra.run.smithi142.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-24T08:21:44.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-24T08:21:44.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-24T08:21:44.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-24T08:21:44.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-24T08:21:44.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-24T08:21:44.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-24T08:21:44.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-24T08:21:44.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-24T08:21:44.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-24T08:21:44.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-24T08:21:44.461 INFO:teuthology.orchestra.run.smithi142.stdout: socat unzip xmlstarlet zip 2024-04-24T08:21:44.463 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2024-04-24T08:21:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-24T08:21:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-24T08:21:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-24T08:21:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-24T08:21:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-24T08:21:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-24T08:21:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-24T08:21:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-24T08:21:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-24T08:21:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-24T08:21:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-24T08:21:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-24T08:21:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-24T08:21:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: socat unzip xmlstarlet zip 2024-04-24T08:21:44.534 INFO:teuthology.orchestra.run.smithi088.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-24T08:21:44.534 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 182 MB of archives. 2024-04-24T08:21:44.535 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-24T08:21:44.535 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-24T08:21:44.555 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-24T08:21:44.566 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-24T08:21:44.614 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-24T08:21:44.630 INFO:teuthology.orchestra.run.smithi142.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-24T08:21:44.630 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 182 MB of archives. 2024-04-24T08:21:44.630 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-24T08:21:44.630 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3116-g1f81fb39-1jammy [3,553 kB] 2024-04-24T08:21:44.638 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-24T08:21:44.640 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-24T08:21:44.654 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-24T08:21:44.654 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-24T08:21:44.663 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3116-g1f81fb39-1jammy [3,553 kB] 2024-04-24T08:21:44.701 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-24T08:21:44.704 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-24T08:21:44.711 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-24T08:21:44.713 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-24T08:21:44.714 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-24T08:21:44.720 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-24T08:21:44.722 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-24T08:21:44.724 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-24T08:21:44.725 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-24T08:21:44.725 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-24T08:21:44.737 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-24T08:21:44.742 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-24T08:21:44.744 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-24T08:21:44.746 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-24T08:21:44.746 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-24T08:21:44.747 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-24T08:21:44.762 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-24T08:21:44.762 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-24T08:21:44.762 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-24T08:21:44.763 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-24T08:21:44.763 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-24T08:21:44.781 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-24T08:21:44.782 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-24T08:21:44.782 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-24T08:21:44.784 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-24T08:21:44.784 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-24T08:21:44.785 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-24T08:21:44.801 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-24T08:21:44.802 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-24T08:21:44.802 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-24T08:21:44.802 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-24T08:21:44.803 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-24T08:21:44.820 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-24T08:21:44.821 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-24T08:21:44.826 INFO:teuthology.orchestra.run.smithi088.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-24T08:21:44.826 INFO:teuthology.orchestra.run.smithi088.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-24T08:21:44.826 INFO:teuthology.orchestra.run.smithi088.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-24T08:21:44.840 INFO:teuthology.orchestra.run.smithi088.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-24T08:21:44.841 INFO:teuthology.orchestra.run.smithi088.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-24T08:21:44.843 INFO:teuthology.orchestra.run.smithi088.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-24T08:21:44.843 INFO:teuthology.orchestra.run.smithi088.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-24T08:21:44.844 INFO:teuthology.orchestra.run.smithi088.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-24T08:21:44.859 INFO:teuthology.orchestra.run.smithi088.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-24T08:21:44.861 INFO:teuthology.orchestra.run.smithi088.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-24T08:21:44.862 INFO:teuthology.orchestra.run.smithi088.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-24T08:21:44.863 INFO:teuthology.orchestra.run.smithi088.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-24T08:21:44.864 INFO:teuthology.orchestra.run.smithi088.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-24T08:21:44.911 INFO:teuthology.orchestra.run.smithi088.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-24T08:21:44.912 INFO:teuthology.orchestra.run.smithi088.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-24T08:21:44.913 INFO:teuthology.orchestra.run.smithi088.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-24T08:21:44.913 INFO:teuthology.orchestra.run.smithi088.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-24T08:21:44.914 INFO:teuthology.orchestra.run.smithi088.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-24T08:21:44.934 INFO:teuthology.orchestra.run.smithi088.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-24T08:21:44.936 INFO:teuthology.orchestra.run.smithi088.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-24T08:21:44.936 INFO:teuthology.orchestra.run.smithi088.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-24T08:21:44.953 INFO:teuthology.orchestra.run.smithi088.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-24T08:21:44.953 INFO:teuthology.orchestra.run.smithi088.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-24T08:21:44.954 INFO:teuthology.orchestra.run.smithi088.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-24T08:21:44.955 INFO:teuthology.orchestra.run.smithi088.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-24T08:21:44.955 INFO:teuthology.orchestra.run.smithi088.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-24T08:21:44.956 INFO:teuthology.orchestra.run.smithi088.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-24T08:21:44.969 INFO:teuthology.orchestra.run.smithi088.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-24T08:21:44.970 INFO:teuthology.orchestra.run.smithi088.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-24T08:21:44.970 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3116-g1f81fb39-1jammy [3,224 kB] 2024-04-24T08:21:44.973 INFO:teuthology.orchestra.run.smithi088.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-24T08:21:44.984 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-24T08:21:44.989 INFO:teuthology.orchestra.run.smithi088.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-24T08:21:44.990 INFO:teuthology.orchestra.run.smithi088.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-24T08:21:44.991 INFO:teuthology.orchestra.run.smithi088.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-24T08:21:44.995 INFO:teuthology.orchestra.run.smithi088.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-24T08:21:44.997 INFO:teuthology.orchestra.run.smithi088.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-24T08:21:44.998 INFO:teuthology.orchestra.run.smithi088.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-24T08:21:44.999 INFO:teuthology.orchestra.run.smithi088.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-24T08:21:45.008 INFO:teuthology.orchestra.run.smithi088.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-24T08:21:45.013 INFO:teuthology.orchestra.run.smithi088.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-24T08:21:45.014 INFO:teuthology.orchestra.run.smithi088.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-24T08:21:45.028 INFO:teuthology.orchestra.run.smithi088.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-24T08:21:45.028 INFO:teuthology.orchestra.run.smithi088.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-24T08:21:45.029 INFO:teuthology.orchestra.run.smithi088.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-24T08:21:45.030 INFO:teuthology.orchestra.run.smithi088.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-24T08:21:45.031 INFO:teuthology.orchestra.run.smithi088.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-24T08:21:45.032 INFO:teuthology.orchestra.run.smithi088.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-24T08:21:45.039 INFO:teuthology.orchestra.run.smithi088.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-24T08:21:45.048 INFO:teuthology.orchestra.run.smithi088.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-24T08:21:45.048 INFO:teuthology.orchestra.run.smithi088.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-24T08:21:45.050 INFO:teuthology.orchestra.run.smithi088.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-24T08:21:45.067 INFO:teuthology.orchestra.run.smithi088.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-24T08:21:45.068 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3116-g1f81fb39-1jammy [712 kB] 2024-04-24T08:21:45.078 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-24T08:21:45.091 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3116-g1f81fb39-1jammy [356 kB] 2024-04-24T08:21:45.091 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-24T08:21:45.102 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3116-g1f81fb39-1jammy [32.8 kB] 2024-04-24T08:21:45.103 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3116-g1f81fb39-1jammy [180 kB] 2024-04-24T08:21:45.109 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3116-g1f81fb39-1jammy [66.9 kB] 2024-04-24T08:21:45.124 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3116-g1f81fb39-1jammy [330 kB] 2024-04-24T08:21:45.142 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-24T08:21:45.152 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3116-g1f81fb39-1jammy [6,889 kB] 2024-04-24T08:21:45.317 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-24T08:21:45.327 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-24T08:21:45.354 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-24T08:21:45.363 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-24T08:21:45.389 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3116-g1f81fb39-1jammy [112 kB] 2024-04-24T08:21:45.390 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3116-g1f81fb39-1jammy [466 kB] 2024-04-24T08:21:45.401 INFO:teuthology.orchestra.run.smithi088.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3116-g1f81fb39-1jammy [3,224 kB] 2024-04-24T08:21:45.424 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3116-g1f81fb39-1jammy [25.8 MB] 2024-04-24T08:21:45.526 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-24T08:21:45.627 INFO:teuthology.orchestra.run.smithi088.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3116-g1f81fb39-1jammy [712 kB] 2024-04-24T08:21:45.685 INFO:teuthology.orchestra.run.smithi088.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3116-g1f81fb39-1jammy [356 kB] 2024-04-24T08:21:45.734 INFO:teuthology.orchestra.run.smithi088.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3116-g1f81fb39-1jammy [32.8 kB] 2024-04-24T08:21:45.735 INFO:teuthology.orchestra.run.smithi088.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3116-g1f81fb39-1jammy [180 kB] 2024-04-24T08:21:45.746 INFO:teuthology.orchestra.run.smithi088.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3116-g1f81fb39-1jammy [66.9 kB] 2024-04-24T08:21:45.748 INFO:teuthology.orchestra.run.smithi088.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3116-g1f81fb39-1jammy [330 kB] 2024-04-24T08:21:45.794 INFO:teuthology.orchestra.run.smithi088.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3116-g1f81fb39-1jammy [6,889 kB] 2024-04-24T08:21:46.108 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-24T08:21:46.123 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-24T08:21:46.139 INFO:teuthology.orchestra.run.smithi142.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-24T08:21:46.148 INFO:teuthology.orchestra.run.smithi142.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-24T08:21:46.148 INFO:teuthology.orchestra.run.smithi142.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-24T08:21:46.165 INFO:teuthology.orchestra.run.smithi142.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-24T08:21:46.202 INFO:teuthology.orchestra.run.smithi142.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-24T08:21:46.215 INFO:teuthology.orchestra.run.smithi142.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-24T08:21:46.219 INFO:teuthology.orchestra.run.smithi142.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-24T08:21:46.220 INFO:teuthology.orchestra.run.smithi142.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-24T08:21:46.379 INFO:teuthology.orchestra.run.smithi088.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3116-g1f81fb39-1jammy [112 kB] 2024-04-24T08:21:46.381 INFO:teuthology.orchestra.run.smithi088.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3116-g1f81fb39-1jammy [466 kB] 2024-04-24T08:21:46.390 INFO:teuthology.orchestra.run.smithi142.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-24T08:21:46.439 INFO:teuthology.orchestra.run.smithi088.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3116-g1f81fb39-1jammy [25.8 MB] 2024-04-24T08:21:46.474 INFO:teuthology.orchestra.run.smithi142.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-24T08:21:46.491 INFO:teuthology.orchestra.run.smithi142.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-24T08:21:46.555 INFO:teuthology.orchestra.run.smithi142.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-24T08:21:46.589 INFO:teuthology.orchestra.run.smithi142.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-24T08:21:46.608 INFO:teuthology.orchestra.run.smithi142.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-24T08:21:46.640 INFO:teuthology.orchestra.run.smithi142.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-24T08:21:46.791 INFO:teuthology.orchestra.run.smithi142.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3116-g1f81fb39-1jammy [5,094 kB] 2024-04-24T08:21:46.812 INFO:teuthology.orchestra.run.smithi142.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-24T08:21:46.827 INFO:teuthology.orchestra.run.smithi142.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-24T08:21:46.834 INFO:teuthology.orchestra.run.smithi142.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-24T08:21:46.839 INFO:teuthology.orchestra.run.smithi142.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-24T08:21:47.023 INFO:teuthology.orchestra.run.smithi142.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-24T08:21:47.106 INFO:teuthology.orchestra.run.smithi142.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-24T08:21:47.120 INFO:teuthology.orchestra.run.smithi142.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-24T08:21:47.174 INFO:teuthology.orchestra.run.smithi142.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3116-g1f81fb39-1jammy [244 kB] 2024-04-24T08:21:47.181 INFO:teuthology.orchestra.run.smithi142.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3116-g1f81fb39-1jammy [124 kB] 2024-04-24T08:21:47.185 INFO:teuthology.orchestra.run.smithi142.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3116-g1f81fb39-1jammy [1,525 kB] 2024-04-24T08:21:47.235 INFO:teuthology.orchestra.run.smithi142.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3116-g1f81fb39-1jammy [6,258 kB] 2024-04-24T08:21:47.295 INFO:teuthology.orchestra.run.smithi142.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-24T08:21:47.344 INFO:teuthology.orchestra.run.smithi142.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-24T08:21:47.358 INFO:teuthology.orchestra.run.smithi142.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-24T08:21:47.442 INFO:teuthology.orchestra.run.smithi142.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3116-g1f81fb39-1jammy [22.8 MB] 2024-04-24T08:21:47.515 INFO:teuthology.orchestra.run.smithi142.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-24T08:21:47.516 INFO:teuthology.orchestra.run.smithi142.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-24T08:21:47.521 INFO:teuthology.orchestra.run.smithi142.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-24T08:21:47.526 INFO:teuthology.orchestra.run.smithi142.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-24T08:21:47.541 INFO:teuthology.orchestra.run.smithi142.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-24T08:21:47.724 INFO:teuthology.orchestra.run.smithi142.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-24T08:21:47.977 INFO:teuthology.orchestra.run.smithi142.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-24T08:21:48.115 INFO:teuthology.orchestra.run.smithi142.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-24T08:21:48.157 INFO:teuthology.orchestra.run.smithi142.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-24T08:21:48.249 INFO:teuthology.orchestra.run.smithi142.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-24T08:21:48.259 INFO:teuthology.orchestra.run.smithi142.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-24T08:21:48.271 INFO:teuthology.orchestra.run.smithi142.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-24T08:21:48.316 INFO:teuthology.orchestra.run.smithi142.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-24T08:21:48.577 INFO:teuthology.orchestra.run.smithi142.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-24T08:21:48.578 INFO:teuthology.orchestra.run.smithi142.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-24T08:21:48.579 INFO:teuthology.orchestra.run.smithi142.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-24T08:21:48.657 INFO:teuthology.orchestra.run.smithi142.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3116-g1f81fb39-1jammy [14.1 kB] 2024-04-24T08:21:48.657 INFO:teuthology.orchestra.run.smithi142.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3116-g1f81fb39-1jammy [870 kB] 2024-04-24T08:21:48.687 INFO:teuthology.orchestra.run.smithi142.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3116-g1f81fb39-1jammy [2,437 kB] 2024-04-24T08:21:48.743 INFO:teuthology.orchestra.run.smithi142.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-24T08:21:48.767 INFO:teuthology.orchestra.run.smithi142.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3116-g1f81fb39-1jammy [791 kB] 2024-04-24T08:21:48.793 INFO:teuthology.orchestra.run.smithi142.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3116-g1f81fb39-1jammy [148 kB] 2024-04-24T08:21:48.798 INFO:teuthology.orchestra.run.smithi142.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3116-g1f81fb39-1jammy [2,297 kB] 2024-04-24T08:21:49.045 INFO:teuthology.orchestra.run.smithi142.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3116-g1f81fb39-1jammy [8,625 kB] 2024-04-24T08:21:49.088 INFO:teuthology.orchestra.run.smithi142.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-24T08:21:49.490 INFO:teuthology.orchestra.run.smithi142.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-24T08:21:49.499 INFO:teuthology.orchestra.run.smithi142.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-24T08:21:49.501 INFO:teuthology.orchestra.run.smithi142.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-24T08:21:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-24T08:21:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-24T08:21:49.572 INFO:teuthology.orchestra.run.smithi142.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-24T08:21:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-24T08:21:49.573 INFO:teuthology.orchestra.run.smithi142.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-24T08:21:49.574 INFO:teuthology.orchestra.run.smithi142.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-24T08:21:49.739 INFO:teuthology.orchestra.run.smithi142.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-24T08:21:49.848 INFO:teuthology.orchestra.run.smithi142.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3116-g1f81fb39-1jammy [14.2 kB] 2024-04-24T08:21:49.848 INFO:teuthology.orchestra.run.smithi142.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3116-g1f81fb39-1jammy [51.6 MB] 2024-04-24T08:21:49.944 INFO:teuthology.orchestra.run.smithi142.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-24T08:21:50.267 INFO:teuthology.orchestra.run.smithi142.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-24T08:21:50.313 INFO:teuthology.orchestra.run.smithi142.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-24T08:21:50.340 INFO:teuthology.orchestra.run.smithi142.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-24T08:21:50.349 INFO:teuthology.orchestra.run.smithi142.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-24T08:21:50.395 INFO:teuthology.orchestra.run.smithi142.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-24T08:21:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-24T08:21:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-24T08:21:50.429 INFO:teuthology.orchestra.run.smithi142.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-24T08:21:50.432 INFO:teuthology.orchestra.run.smithi142.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-24T08:21:50.629 INFO:teuthology.orchestra.run.smithi142.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-24T08:21:50.888 INFO:teuthology.orchestra.run.smithi142.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-24T08:21:51.158 INFO:teuthology.orchestra.run.smithi142.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-24T08:21:51.159 INFO:teuthology.orchestra.run.smithi142.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-24T08:21:51.169 INFO:teuthology.orchestra.run.smithi088.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3116-g1f81fb39-1jammy [5,094 kB] 2024-04-24T08:21:51.176 INFO:teuthology.orchestra.run.smithi142.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-24T08:21:51.181 INFO:teuthology.orchestra.run.smithi142.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-24T08:21:51.220 INFO:teuthology.orchestra.run.smithi142.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-24T08:21:51.235 INFO:teuthology.orchestra.run.smithi142.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-24T08:21:51.325 INFO:teuthology.orchestra.run.smithi142.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-24T08:21:51.327 INFO:teuthology.orchestra.run.smithi142.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-24T08:21:51.328 INFO:teuthology.orchestra.run.smithi142.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-24T08:21:51.508 INFO:teuthology.orchestra.run.smithi142.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-24T08:21:51.533 INFO:teuthology.orchestra.run.smithi088.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3116-g1f81fb39-1jammy [244 kB] 2024-04-24T08:21:51.539 INFO:teuthology.orchestra.run.smithi088.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3116-g1f81fb39-1jammy [124 kB] 2024-04-24T08:21:51.543 INFO:teuthology.orchestra.run.smithi088.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3116-g1f81fb39-1jammy [1,525 kB] 2024-04-24T08:21:51.676 INFO:teuthology.orchestra.run.smithi088.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3116-g1f81fb39-1jammy [6,258 kB] 2024-04-24T08:21:51.781 INFO:teuthology.orchestra.run.smithi142.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-24T08:21:52.131 INFO:teuthology.orchestra.run.smithi088.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3116-g1f81fb39-1jammy [22.8 MB] 2024-04-24T08:21:52.493 INFO:teuthology.orchestra.run.smithi142.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3116-g1f81fb39-1jammy [124 kB] 2024-04-24T08:21:52.494 INFO:teuthology.orchestra.run.smithi142.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3116-g1f81fb39-1jammy [232 kB] 2024-04-24T08:21:52.522 INFO:teuthology.orchestra.run.smithi142.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3116-g1f81fb39-1jammy [33.9 kB] 2024-04-24T08:21:52.523 INFO:teuthology.orchestra.run.smithi142.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3116-g1f81fb39-1jammy [23.4 kB] 2024-04-24T08:21:52.524 INFO:teuthology.orchestra.run.smithi142.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3116-g1f81fb39-1jammy [38.9 kB] 2024-04-24T08:21:52.525 INFO:teuthology.orchestra.run.smithi142.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3116-g1f81fb39-1jammy [13.6 MB] 2024-04-24T08:21:53.336 INFO:teuthology.orchestra.run.smithi142.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3116-g1f81fb39-1jammy [91.2 kB] 2024-04-24T08:21:53.595 INFO:teuthology.orchestra.run.smithi088.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3116-g1f81fb39-1jammy [14.1 kB] 2024-04-24T08:21:53.596 INFO:teuthology.orchestra.run.smithi088.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3116-g1f81fb39-1jammy [870 kB] 2024-04-24T08:21:53.616 INFO:teuthology.orchestra.run.smithi088.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3116-g1f81fb39-1jammy [2,437 kB] 2024-04-24T08:21:53.697 INFO:teuthology.orchestra.run.smithi088.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3116-g1f81fb39-1jammy [791 kB] 2024-04-24T08:21:53.723 INFO:teuthology.orchestra.run.smithi088.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3116-g1f81fb39-1jammy [148 kB] 2024-04-24T08:21:53.727 INFO:teuthology.orchestra.run.smithi088.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3116-g1f81fb39-1jammy [2,297 kB] 2024-04-24T08:21:53.804 INFO:teuthology.orchestra.run.smithi088.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3116-g1f81fb39-1jammy [8,625 kB] 2024-04-24T08:21:53.994 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 182 MB in 9s (20.4 MB/s) 2024-04-24T08:21:54.088 INFO:teuthology.orchestra.run.smithi088.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3116-g1f81fb39-1jammy [14.2 kB] 2024-04-24T08:21:54.088 INFO:teuthology.orchestra.run.smithi088.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3116-g1f81fb39-1jammy [51.6 MB] 2024-04-24T08:21:54.172 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-24T08:21:54.241 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-24T08:21:54.245 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-24T08:21:54.313 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-24T08:21:54.691 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-24T08:21:54.711 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-24T08:21:54.758 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T08:21:55.135 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cmd2. 2024-04-24T08:21:55.150 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-24T08:21:55.227 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-24T08:21:55.663 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-24T08:21:55.678 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-24T08:21:55.772 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T08:21:55.796 INFO:teuthology.orchestra.run.smithi088.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3116-g1f81fb39-1jammy [124 kB] 2024-04-24T08:21:55.797 INFO:teuthology.orchestra.run.smithi088.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3116-g1f81fb39-1jammy [232 kB] 2024-04-24T08:21:55.799 INFO:teuthology.orchestra.run.smithi088.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3116-g1f81fb39-1jammy [33.9 kB] 2024-04-24T08:21:55.800 INFO:teuthology.orchestra.run.smithi088.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3116-g1f81fb39-1jammy [23.4 kB] 2024-04-24T08:21:55.800 INFO:teuthology.orchestra.run.smithi088.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3116-g1f81fb39-1jammy [38.9 kB] 2024-04-24T08:21:55.801 INFO:teuthology.orchestra.run.smithi088.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3116-g1f81fb39-1jammy [13.6 MB] 2024-04-24T08:21:56.150 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-24T08:21:56.165 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-24T08:21:56.217 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T08:21:56.247 INFO:teuthology.orchestra.run.smithi088.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/rishabh-main-apr17-a654945/1f81fb397ae98da7563d451a78c61574c8f4e6e0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3116-g1f81fb39-1jammy [91.2 kB] 2024-04-24T08:21:56.619 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-24T08:21:56.634 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-24T08:21:56.686 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T08:21:56.879 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 182 MB in 12s (15.4 MB/s) 2024-04-24T08:21:57.029 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-24T08:21:57.095 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-24T08:21:57.099 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-24T08:21:57.135 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-24T08:21:57.438 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-24T08:21:57.452 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-24T08:21:57.496 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T08:21:57.514 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-24T08:21:57.529 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T08:21:57.589 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T08:21:57.816 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cmd2. 2024-04-24T08:21:57.830 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-24T08:21:57.874 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-24T08:21:58.043 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-24T08:21:58.058 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T08:21:58.109 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T08:21:58.244 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-24T08:21:58.258 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-24T08:21:58.344 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T08:21:58.521 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-24T08:21:58.536 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T08:21:58.578 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T08:21:58.681 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-24T08:21:58.696 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-24T08:21:58.739 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T08:21:58.991 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-24T08:21:59.005 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-24T08:21:59.025 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-24T08:21:59.040 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-24T08:21:59.057 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T08:21:59.075 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T08:21:59.393 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librados2. 2024-04-24T08:21:59.408 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../010-librados2_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:21:59.451 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librados2 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:21:59.520 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-24T08:21:59.535 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T08:21:59.586 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T08:21:59.973 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-24T08:21:59.979 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librbd1. 2024-04-24T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T08:21:59.994 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../011-librbd1_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:00.031 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T08:22:00.045 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librbd1 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:00.334 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-24T08:22:00.349 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T08:22:00.409 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T08:22:00.473 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libcephfs2. 2024-04-24T08:22:00.487 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:00.532 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libcephfs2 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:00.754 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-24T08:22:00.769 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-24T08:22:00.792 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rados. 2024-04-24T08:22:00.807 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:00.812 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T08:22:00.842 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rados (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:01.132 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librados2. 2024-04-24T08:22:01.146 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../010-librados2_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:01.153 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-24T08:22:01.168 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:01.190 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librados2 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:01.212 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-ceph-argparse (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:01.464 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cephfs. 2024-04-24T08:22:01.479 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:01.522 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cephfs (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:01.659 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librbd1. 2024-04-24T08:22:01.673 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../011-librbd1_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:01.717 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librbd1 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:01.875 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-24T08:22:01.890 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:01.933 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-ceph-common (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:02.320 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-prettytable. 2024-04-24T08:22:02.335 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-24T08:22:02.386 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-24T08:22:02.487 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libcephfs2. 2024-04-24T08:22:02.501 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:02.545 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libcephfs2 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:02.731 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rbd. 2024-04-24T08:22:02.745 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:02.797 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rbd (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:02.823 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rados. 2024-04-24T08:22:02.837 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:02.898 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rados (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:03.209 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-24T08:22:03.223 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:03.226 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-24T08:22:03.240 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-24T08:22:03.258 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-ceph-argparse (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:03.292 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T08:22:03.486 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cephfs. 2024-04-24T08:22:03.501 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:03.544 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cephfs (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:03.619 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-24T08:22:03.634 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-24T08:22:03.677 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T08:22:03.855 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-24T08:22:03.870 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:03.913 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-ceph-common (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:03.989 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-24T08:22:04.003 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-24T08:22:04.055 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T08:22:04.250 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-prettytable. 2024-04-24T08:22:04.265 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-24T08:22:04.308 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-24T08:22:04.459 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package lua5.1. 2024-04-24T08:22:04.473 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-24T08:22:04.525 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-24T08:22:04.569 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rbd. 2024-04-24T08:22:04.584 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:04.627 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rbd (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:04.895 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package lua-any. 2024-04-24T08:22:04.910 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-24T08:22:04.914 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-24T08:22:04.928 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-24T08:22:04.961 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-24T08:22:04.964 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T08:22:05.239 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package zip. 2024-04-24T08:22:05.241 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-24T08:22:05.254 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-24T08:22:05.255 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-24T08:22:05.299 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T08:22:05.322 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking zip (3.0-12build2) ... 2024-04-24T08:22:05.636 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-24T08:22:05.650 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-24T08:22:05.692 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package unzip. 2024-04-24T08:22:05.694 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T08:22:05.707 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-24T08:22:05.750 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-24T08:22:06.022 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package lua5.1. 2024-04-24T08:22:06.037 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-24T08:22:06.072 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-24T08:22:06.221 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package luarocks. 2024-04-24T08:22:06.235 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-24T08:22:06.287 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-24T08:22:06.358 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package lua-any. 2024-04-24T08:22:06.373 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-24T08:22:06.416 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-24T08:22:06.703 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package zip. 2024-04-24T08:22:06.717 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-24T08:22:06.753 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librgw2. 2024-04-24T08:22:06.760 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking zip (3.0-12build2) ... 2024-04-24T08:22:06.767 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../027-librgw2_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:06.820 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librgw2 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:07.055 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package unzip. 2024-04-24T08:22:07.070 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-24T08:22:07.113 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-24T08:22:07.456 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rgw. 2024-04-24T08:22:07.470 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:07.492 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package luarocks. 2024-04-24T08:22:07.507 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-24T08:22:07.522 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rgw (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:07.550 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-24T08:22:07.884 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-24T08:22:07.898 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-24T08:22:07.924 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librgw2. 2024-04-24T08:22:07.938 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../027-librgw2_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:07.942 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T08:22:07.974 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librgw2 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:08.328 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libradosstriper1. 2024-04-24T08:22:08.343 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:08.394 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libradosstriper1 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:08.452 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rgw. 2024-04-24T08:22:08.465 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:08.510 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rgw (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:08.830 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-24T08:22:08.843 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-24T08:22:08.888 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T08:22:08.906 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-common. 2024-04-24T08:22:08.920 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:08.997 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-common (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:09.208 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libradosstriper1. 2024-04-24T08:22:09.222 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:09.257 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libradosstriper1 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:09.652 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-common. 2024-04-24T08:22:09.667 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:09.710 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-common (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:10.269 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-base. 2024-04-24T08:22:10.285 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:10.346 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-base (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:10.841 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-base. 2024-04-24T08:22:10.856 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:10.908 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-base (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:10.924 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-24T08:22:10.938 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-24T08:22:10.982 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-24T08:22:11.251 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cheroot. 2024-04-24T08:22:11.266 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-24T08:22:11.309 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T08:22:11.453 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-24T08:22:11.467 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-24T08:22:11.503 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-24T08:22:11.638 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-24T08:22:11.653 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-24T08:22:11.696 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-24T08:22:11.789 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cheroot. 2024-04-24T08:22:11.803 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-24T08:22:11.847 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T08:22:12.032 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-24T08:22:12.047 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-24T08:22:12.091 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-24T08:22:12.158 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-24T08:22:12.173 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-24T08:22:12.217 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-24T08:22:12.368 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-24T08:22:12.383 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-24T08:22:12.418 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-24T08:22:12.737 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tempora. 2024-04-24T08:22:12.745 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-24T08:22:12.752 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-24T08:22:12.760 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-24T08:22:12.803 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-24T08:22:13.027 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-24T08:22:13.098 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-24T08:22:13.113 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-24T08:22:13.156 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-24T08:22:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-portend. 2024-04-24T08:22:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-24T08:22:13.399 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-24T08:22:13.458 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-tempora. 2024-04-24T08:22:13.473 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-24T08:22:13.517 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-24T08:22:13.701 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-24T08:22:13.716 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-24T08:22:13.751 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-24T08:22:13.820 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-portend. 2024-04-24T08:22:13.835 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-24T08:22:13.878 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-24T08:22:14.012 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-24T08:22:14.027 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-24T08:22:14.071 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-24T08:22:14.114 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-24T08:22:14.129 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-24T08:22:14.189 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-24T08:22:14.399 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-natsort. 2024-04-24T08:22:14.414 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-24T08:22:14.449 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-24T08:22:14.484 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-24T08:22:14.498 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-24T08:22:14.541 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-24T08:22:14.794 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-logutils. 2024-04-24T08:22:14.809 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-24T08:22:14.852 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-24T08:22:14.854 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-natsort. 2024-04-24T08:22:14.869 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-24T08:22:14.903 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-24T08:22:15.155 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-24T08:22:15.165 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-logutils. 2024-04-24T08:22:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-24T08:22:15.180 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-24T08:22:15.213 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-24T08:22:15.223 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-24T08:22:15.541 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-mako. 2024-04-24T08:22:15.556 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-24T08:22:15.559 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-24T08:22:15.574 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-24T08:22:15.591 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T08:22:15.642 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-24T08:22:15.911 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-24T08:22:15.926 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-24T08:22:15.953 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-mako. 2024-04-24T08:22:15.960 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-24T08:22:15.968 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-24T08:22:16.012 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T08:22:16.255 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-24T08:22:16.270 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-24T08:22:16.313 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-24T08:22:16.315 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-24T08:22:16.330 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-24T08:22:16.364 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-24T08:22:16.657 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-24T08:22:16.658 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webob. 2024-04-24T08:22:16.672 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-24T08:22:16.672 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-24T08:22:16.716 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-24T08:22:16.717 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-24T08:22:17.020 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webob. 2024-04-24T08:22:17.035 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-24T08:22:17.077 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-waitress. 2024-04-24T08:22:17.078 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-24T08:22:17.092 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-24T08:22:17.138 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T08:22:18.098 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-waitress. 2024-04-24T08:22:18.114 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-24T08:22:18.147 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tempita. 2024-04-24T08:22:18.159 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T08:22:18.162 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-24T08:22:18.197 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T08:22:18.468 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-tempita. 2024-04-24T08:22:18.483 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-24T08:22:18.525 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T08:22:18.533 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-paste. 2024-04-24T08:22:18.548 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-24T08:22:18.591 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T08:22:18.770 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-paste. 2024-04-24T08:22:18.785 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-24T08:22:18.820 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T08:22:18.886 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-24T08:22:18.901 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-24T08:22:18.936 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T08:22:19.131 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-24T08:22:19.146 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-24T08:22:19.189 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T08:22:19.264 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-24T08:22:19.279 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-24T08:22:19.322 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-24T08:22:19.493 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-24T08:22:19.507 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-24T08:22:19.542 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-24T08:22:19.625 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webtest. 2024-04-24T08:22:19.640 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-24T08:22:19.683 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-24T08:22:19.829 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webtest. 2024-04-24T08:22:19.844 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-24T08:22:19.887 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-24T08:22:19.994 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pecan. 2024-04-24T08:22:20.010 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-24T08:22:20.053 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T08:22:20.198 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pecan. 2024-04-24T08:22:20.213 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-24T08:22:20.256 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T08:22:20.415 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-certifi. 2024-04-24T08:22:20.430 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-24T08:22:20.474 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-24T08:22:20.653 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-certifi. 2024-04-24T08:22:20.668 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-24T08:22:20.711 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-24T08:22:20.769 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-idna. 2024-04-24T08:22:20.782 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-24T08:22:20.826 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-24T08:22:21.006 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-idna. 2024-04-24T08:22:21.020 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-24T08:22:21.064 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-24T08:22:21.171 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-urllib3. 2024-04-24T08:22:21.184 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-24T08:22:21.229 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T08:22:21.375 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-urllib3. 2024-04-24T08:22:21.390 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-24T08:22:21.433 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T08:22:21.549 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-requests. 2024-04-24T08:22:21.563 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-24T08:22:21.607 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T08:22:21.678 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-requests. 2024-04-24T08:22:21.692 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-24T08:22:21.753 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T08:22:21.944 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-24T08:22:21.957 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-24T08:22:22.002 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T08:22:22.047 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-24T08:22:22.062 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-24T08:22:22.105 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T08:22:22.305 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-24T08:22:22.318 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:22.375 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-24T08:22:22.390 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:22.425 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:22.734 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-24T08:22:22.748 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:22.792 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:23.022 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-24T08:22:23.037 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:23.080 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:23.137 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-24T08:22:23.153 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-24T08:22:23.195 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-24T08:22:23.349 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-24T08:22:23.364 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-24T08:22:23.399 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-24T08:22:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-openssl. 2024-04-24T08:22:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-24T08:22:23.556 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-24T08:22:23.660 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-openssl. 2024-04-24T08:22:23.675 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-24T08:22:23.718 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-24T08:22:23.894 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr. 2024-04-24T08:22:23.908 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:23.944 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:24.055 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr. 2024-04-24T08:22:24.070 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:24.113 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:24.322 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mon. 2024-04-24T08:22:24.337 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:24.380 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mon (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:24.533 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mon. 2024-04-24T08:22:24.547 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:24.591 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mon (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:24.909 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-osd. 2024-04-24T08:22:24.926 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:24.958 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-osd (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:25.086 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-osd. 2024-04-24T08:22:25.100 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:25.136 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-osd (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:25.754 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph. 2024-04-24T08:22:25.768 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../068-ceph_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:25.812 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:25.905 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph. 2024-04-24T08:22:25.920 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../068-ceph_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:25.963 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:26.131 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-fuse. 2024-04-24T08:22:26.146 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:26.189 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-fuse (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:26.283 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-fuse. 2024-04-24T08:22:26.298 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:26.341 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-fuse (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:26.592 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mds. 2024-04-24T08:22:26.608 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:26.650 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mds (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:26.694 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mds. 2024-04-24T08:22:26.709 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:26.776 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mds (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:27.003 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephadm. 2024-04-24T08:22:27.019 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../071-cephadm_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:27.061 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephadm (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:27.122 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephadm. 2024-04-24T08:22:27.137 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../071-cephadm_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:27.180 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephadm (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:27.423 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-24T08:22:27.438 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-24T08:22:27.480 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-24T08:22:27.499 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-24T08:22:27.514 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-24T08:22:27.557 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-24T08:22:27.792 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-24T08:22:27.807 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T08:22:27.841 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T08:22:27.869 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-24T08:22:27.884 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T08:22:27.927 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T08:22:28.890 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-babel. 2024-04-24T08:22:28.903 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T08:22:28.948 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T08:22:29.004 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-babel. 2024-04-24T08:22:29.019 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T08:22:29.054 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T08:22:29.292 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jinja2. 2024-04-24T08:22:29.306 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-24T08:22:29.351 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T08:22:29.374 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jinja2. 2024-04-24T08:22:29.388 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-24T08:22:29.432 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T08:22:29.721 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-24T08:22:29.734 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:29.777 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-24T08:22:29.778 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:29.791 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:29.827 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:30.115 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-24T08:22:30.122 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-24T08:22:30.129 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-24T08:22:30.136 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-24T08:22:30.171 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-24T08:22:30.173 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-24T08:22:30.451 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-routes. 2024-04-24T08:22:30.464 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-24T08:22:30.466 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-routes. 2024-04-24T08:22:30.480 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-24T08:22:30.524 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T08:22:30.542 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T08:22:30.827 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-24T08:22:30.842 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:30.871 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-24T08:22:30.885 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:30.885 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:30.929 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:32.192 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-24T08:22:32.206 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-24T08:22:32.249 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-24T08:22:32.250 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T08:22:32.256 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-24T08:22:32.298 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T08:22:32.729 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-joblib. 2024-04-24T08:22:32.742 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-24T08:22:32.787 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T08:22:32.810 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-joblib. 2024-04-24T08:22:32.820 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-24T08:22:32.860 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T08:22:33.107 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-24T08:22:33.121 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-24T08:22:33.242 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-24T08:22:33.247 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-24T08:22:33.255 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-24T08:22:33.383 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-24T08:22:33.547 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-sklearn. 2024-04-24T08:22:33.558 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-24T08:22:33.597 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T08:22:33.711 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sklearn. 2024-04-24T08:22:33.722 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-24T08:22:33.752 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T08:22:34.264 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-24T08:22:34.279 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:34.323 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:34.428 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-24T08:22:34.440 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:34.478 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:35.309 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cachetools. 2024-04-24T08:22:35.325 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-24T08:22:35.358 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-24T08:22:35.431 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cachetools. 2024-04-24T08:22:35.442 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-24T08:22:35.480 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-24T08:22:35.586 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-24T08:22:35.630 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-24T08:22:35.661 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-24T08:22:35.767 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-24T08:22:35.778 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-24T08:22:35.816 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-24T08:22:35.981 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-24T08:22:35.999 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-24T08:22:36.039 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T08:22:36.162 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-24T08:22:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-24T08:22:36.211 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T08:22:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rsa. 2024-04-24T08:22:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-24T08:22:36.409 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-24T08:22:36.506 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rsa. 2024-04-24T08:22:36.517 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-24T08:22:36.556 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-24T08:22:36.713 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-google-auth. 2024-04-24T08:22:36.728 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-24T08:22:36.771 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-24T08:22:36.851 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-google-auth. 2024-04-24T08:22:36.862 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-24T08:22:36.901 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-24T08:22:37.066 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-24T08:22:37.081 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-24T08:22:37.116 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T08:22:37.221 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-24T08:22:37.232 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-24T08:22:37.270 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T08:22:37.427 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-websocket. 2024-04-24T08:22:37.442 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-24T08:22:37.485 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-24T08:22:37.582 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-websocket. 2024-04-24T08:22:37.593 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-24T08:22:37.632 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-24T08:22:37.805 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-24T08:22:37.821 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-24T08:22:37.863 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T08:22:37.977 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-24T08:22:37.988 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-24T08:22:38.035 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T08:22:38.793 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-24T08:22:38.808 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:38.851 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:39.107 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-24T08:22:39.117 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:39.146 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-24T08:22:39.157 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:39.160 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-24T08:22:39.196 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T08:22:39.409 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-24T08:22:39.419 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-24T08:22:39.451 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T08:22:39.540 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-24T08:22:39.554 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T08:22:39.598 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T08:22:39.838 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-24T08:22:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package jq. 2024-04-24T08:22:39.848 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T08:22:39.857 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T08:22:39.887 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T08:22:39.893 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-24T08:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package socat. 2024-04-24T08:22:40.135 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-24T08:22:40.140 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package jq. 2024-04-24T08:22:40.151 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T08:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-24T08:22:40.190 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-24T08:22:40.417 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package socat. 2024-04-24T08:22:40.428 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-24T08:22:40.477 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-24T08:22:40.482 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package xmlstarlet. 2024-04-24T08:22:40.497 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-24T08:22:40.540 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-24T08:22:40.837 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package xmlstarlet. 2024-04-24T08:22:40.848 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-24T08:22:40.895 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-24T08:22:40.902 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-test. 2024-04-24T08:22:40.917 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:40.960 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-test (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:41.266 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-test. 2024-04-24T08:22:41.275 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:41.324 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-test (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-volume. 2024-04-24T08:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-volume (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:43.260 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-24T08:22:43.275 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:43.318 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-mirror (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:43.437 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-volume. 2024-04-24T08:22:43.449 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:43.495 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-volume (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:43.613 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-colorama. 2024-04-24T08:22:43.628 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-24T08:22:43.671 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-24T08:22:43.874 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-24T08:22:43.885 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:43.924 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephfs-mirror (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:43.932 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-shell. 2024-04-24T08:22:43.945 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:43.982 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-shell (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:44.243 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-top. 2024-04-24T08:22:44.257 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:44.277 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-colorama. 2024-04-24T08:22:44.288 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-24T08:22:44.301 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-top (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:44.327 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-24T08:22:44.580 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephfs-shell. 2024-04-24T08:22:44.590 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:44.595 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-24T08:22:44.608 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:44.629 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephfs-shell (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:44.645 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libcephfs-dev (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:44.848 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephfs-top. 2024-04-24T08:22:44.858 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3116-g1f81fb39-1jammy_all.deb ... 2024-04-24T08:22:44.889 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephfs-top (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:44.914 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-24T08:22:44.926 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-24T08:22:44.956 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T08:22:45.165 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-24T08:22:45.175 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:45.217 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libcephfs-dev (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-24T08:22:45.282 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-24T08:22:45.326 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-24T08:22:45.520 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-24T08:22:45.530 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-24T08:22:45.570 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T08:22:45.722 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package nvme-cli. 2024-04-24T08:22:45.734 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-24T08:22:45.772 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T08:22:45.874 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-24T08:22:45.884 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-24T08:22:45.924 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-24T08:22:46.185 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package pkg-config. 2024-04-24T08:22:46.197 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-24T08:22:46.235 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T08:22:46.320 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package nvme-cli. 2024-04-24T08:22:46.330 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-24T08:22:46.369 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T08:22:46.480 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-24T08:22:46.493 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-24T08:22:46.530 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-24T08:22:46.793 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package pkg-config. 2024-04-24T08:22:46.801 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-24T08:22:46.841 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T08:22:46.925 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-24T08:22:46.938 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-24T08:22:46.991 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-24T08:22:47.127 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-24T08:22:47.137 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-24T08:22:47.177 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-24T08:22:47.210 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pastescript. 2024-04-24T08:22:47.223 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-24T08:22:47.251 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-24T08:22:47.564 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pluggy. 2024-04-24T08:22:47.577 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-24T08:22:47.613 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-24T08:22:47.621 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-24T08:22:47.624 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-24T08:22:47.663 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-24T08:22:47.916 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-psutil. 2024-04-24T08:22:47.929 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-24T08:22:47.957 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pastescript. 2024-04-24T08:22:47.966 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-24T08:22:47.968 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-24T08:22:47.999 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-24T08:22:48.286 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pluggy. 2024-04-24T08:22:48.296 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-24T08:22:48.319 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-py. 2024-04-24T08:22:48.332 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-24T08:22:48.335 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-24T08:22:48.368 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-24T08:22:48.639 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-psutil. 2024-04-24T08:22:48.649 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-24T08:22:48.688 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-24T08:22:48.897 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pygments. 2024-04-24T08:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-24T08:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T08:22:49.033 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-py. 2024-04-24T08:22:49.043 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-24T08:22:49.082 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-24T08:22:49.359 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-24T08:22:49.371 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-24T08:22:49.409 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-24T08:22:49.411 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pygments. 2024-04-24T08:22:49.422 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-24T08:22:49.461 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T08:22:49.745 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-toml. 2024-04-24T08:22:49.757 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-24T08:22:49.795 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-24T08:22:49.939 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-24T08:22:49.949 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-24T08:22:49.989 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-24T08:22:50.098 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pytest. 2024-04-24T08:22:50.109 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-24T08:22:50.147 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T08:22:50.284 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-toml. 2024-04-24T08:22:50.295 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-24T08:22:50.350 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-24T08:22:50.442 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-simplejson. 2024-04-24T08:22:50.454 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-24T08:22:50.484 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-24T08:22:50.603 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pytest. 2024-04-24T08:22:50.614 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-24T08:22:50.678 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T08:22:50.753 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-24T08:22:50.765 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-24T08:22:50.795 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-24T08:22:50.990 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-simplejson. 2024-04-24T08:22:51.000 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-24T08:22:51.039 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-24T08:22:51.301 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-24T08:22:51.311 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-24T08:22:51.350 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-24T08:22:51.490 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package radosgw. 2024-04-24T08:22:51.502 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../122-radosgw_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:51.532 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking radosgw (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:52.054 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package radosgw. 2024-04-24T08:22:52.063 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../122-radosgw_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:52.104 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking radosgw (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:52.168 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package rbd-fuse. 2024-04-24T08:22:52.181 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:52.226 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking rbd-fuse (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:52.527 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-24T08:22:52.749 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package rbd-fuse. 2024-04-24T08:22:52.758 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3116-g1f81fb39-1jammy_amd64.deb ... 2024-04-24T08:22:52.798 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking rbd-fuse (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:52.823 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T08:22:52.924 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T08:22:53.097 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-24T08:22:53.164 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-24T08:22:53.345 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T08:22:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T08:22:53.517 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-24T08:22:53.744 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-24T08:22:54.111 INFO:teuthology.orchestra.run.smithi088.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-24T08:22:54.133 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-24T08:22:54.171 INFO:teuthology.orchestra.run.smithi088.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-24T08:22:54.208 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephadm (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:54.682 INFO:teuthology.orchestra.run.smithi142.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-24T08:22:54.722 INFO:teuthology.orchestra.run.smithi142.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-24T08:22:54.764 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephadm (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:54.769 INFO:teuthology.orchestra.run.smithi088.stdout:Adding system user cephadm....done 2024-04-24T08:22:54.890 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T08:22:55.149 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-24T08:22:55.283 INFO:teuthology.orchestra.run.smithi142.stdout:Adding system user cephadm....done 2024-04-24T08:22:55.400 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-24T08:22:55.462 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T08:22:55.526 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-24T08:22:55.738 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-24T08:22:55.786 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-24T08:22:55.998 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-24T08:22:56.054 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T08:22:56.124 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-24T08:22:56.180 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-24T08:22:56.383 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-24T08:22:56.482 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T08:22:56.651 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T08:22:56.752 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-24T08:22:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-24T08:22:57.045 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T08:22:57.101 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-24T08:22:57.369 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-24T08:22:57.431 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-24T08:22:57.654 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-24T08:22:57.698 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-24T08:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-24T08:22:57.966 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-24T08:22:58.156 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-24T08:22:58.267 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-24T08:22:58.432 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-24T08:22:58.527 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-24T08:22:58.675 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-ceph-argparse (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:58.778 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-24T08:22:58.943 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T08:22:59.038 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-24T08:22:59.068 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T08:22:59.203 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-24T08:22:59.314 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-ceph-argparse (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:22:59.479 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T08:22:59.581 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T08:22:59.605 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-24T08:22:59.707 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T08:22:59.833 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-24T08:22:59.864 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-24T08:23:00.126 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T08:23:00.235 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-24T08:23:00.245 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-24T08:23:00.269 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-24T08:23:00.342 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T08:23:00.469 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-24T08:23:00.478 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-24T08:23:00.835 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-24T08:23:00.836 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T08:23:00.891 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-24T08:23:00.956 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T08:23:00.962 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-24T08:23:01.082 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-24T08:23:01.238 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T08:23:01.458 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T08:23:01.497 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-24T08:23:01.584 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-24T08:23:01.798 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up zip (3.0-12build2) ... 2024-04-24T08:23:01.860 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T08:23:01.908 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T08:23:02.111 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-24T08:23:02.438 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up zip (3.0-12build2) ... 2024-04-24T08:23:02.563 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T08:23:02.618 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T08:23:02.903 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T08:23:03.029 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-24T08:23:03.154 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T08:23:03.273 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T08:23:03.481 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-24T08:23:03.566 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T08:23:03.692 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-24T08:23:03.793 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T08:23:03.865 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-24T08:23:04.103 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-24T08:23:04.107 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T08:23:04.509 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T08:23:04.512 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-24T08:23:04.780 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T08:23:04.811 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-24T08:23:05.137 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T08:23:05.165 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T08:23:05.474 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-24T08:23:05.496 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-24T08:23:05.739 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-24T08:23:05.800 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T08:23:05.840 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-ceph-common (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:06.125 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-idna (3.3-1) ... 2024-04-24T08:23:06.143 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-24T08:23:06.389 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-24T08:23:06.467 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T08:23:06.495 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-ceph-common (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:06.798 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-idna (3.3-1) ... 2024-04-24T08:23:07.139 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T08:23:07.690 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T08:23:07.925 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T08:23:08.059 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-24T08:23:08.327 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T08:23:08.380 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T08:23:08.453 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-24T08:23:08.578 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T08:23:08.615 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T08:23:08.749 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-24T08:23:08.871 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-24T08:23:09.017 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T08:23:09.123 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-24T08:23:09.143 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-24T08:23:09.244 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T08:23:09.373 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T08:23:09.533 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-24T08:23:09.537 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-24T08:23:09.805 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-24T08:23:09.842 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-24T08:23:10.073 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T08:23:10.119 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-24T08:23:10.387 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-24T08:23:10.507 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-24T08:23:10.680 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-24T08:23:10.825 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-24T08:23:10.930 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-24T08:23:11.101 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-24T08:23:11.181 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T08:23:11.290 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-24T08:23:11.352 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-24T08:23:11.575 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T08:23:11.603 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-24T08:23:11.701 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T08:23:11.887 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-24T08:23:12.010 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-24T08:23:12.163 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T08:23:12.289 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-24T08:23:12.320 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-24T08:23:12.582 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T08:23:12.587 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T08:23:12.688 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-24T08:23:12.708 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T08:23:12.789 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T08:23:12.869 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-24T08:23:13.026 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-24T08:23:13.099 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T08:23:13.250 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T08:23:13.318 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-24T08:23:13.561 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T08:23:13.652 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-24T08:23:13.704 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-24T08:23:13.830 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T08:23:13.918 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-24T08:23:13.928 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-24T08:23:14.054 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-24T08:23:14.165 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T08:23:14.291 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T08:23:14.305 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T08:23:14.431 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T08:23:14.692 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-24T08:23:14.748 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T08:23:14.943 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-24T08:23:15.044 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-24T08:23:15.058 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T08:23:15.295 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T08:23:15.342 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-24T08:23:15.421 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T08:23:15.554 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-24T08:23:15.781 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T08:23:15.847 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-24T08:23:16.090 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T08:23:16.106 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T08:23:16.366 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-24T08:23:16.374 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-24T08:23:16.611 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-24T08:23:16.750 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-24T08:23:16.904 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-24T08:23:17.052 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T08:23:17.180 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T08:23:17.413 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T08:23:17.448 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-24T08:23:17.522 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librados2 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:17.623 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:17.749 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-24T08:23:17.833 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-24T08:23:18.087 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libcephfs2 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:18.109 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T08:23:18.222 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libradosstriper1 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:18.348 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-24T08:23:18.445 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T08:23:18.579 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librados2 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:18.624 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librbd1 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:18.705 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:18.750 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-modules-core (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:18.831 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-24T08:23:18.876 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-fuse (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:19.085 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T08:23:19.085 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T08:23:19.159 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libcephfs2 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:19.285 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libradosstriper1 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:19.395 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-24T08:23:19.686 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libcephfs-dev (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:19.696 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librbd1 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:19.795 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rados (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:19.822 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-modules-core (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:19.921 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librgw2 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:19.948 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-fuse (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:20.039 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-top (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:20.157 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T08:23:20.157 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T08:23:20.165 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T08:23:20.774 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libcephfs-dev (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:20.892 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rados (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:20.992 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librgw2 (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:21.127 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephfs-top (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:21.236 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T08:23:21.443 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rbd (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:21.569 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up rbd-fuse (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:21.670 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rgw (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:21.771 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cephfs (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:21.939 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-shell (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:22.065 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-common (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:22.523 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rbd (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:22.585 INFO:teuthology.orchestra.run.smithi088.stdout:Adding group ceph....done 2024-04-24T08:23:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up rbd-fuse (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:22.775 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rgw (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:22.901 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cephfs (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:22.919 INFO:teuthology.orchestra.run.smithi088.stdout:Adding system user ceph....done 2024-04-24T08:23:23.002 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephfs-shell (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:23.089 INFO:teuthology.orchestra.run.smithi088.stdout:Setting system user ceph properties....done 2024-04-24T08:23:23.105 INFO:teuthology.orchestra.run.smithi088.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-24T08:23:23.111 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-common (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:23.250 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-24T08:23:23.666 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-24T08:23:23.673 INFO:teuthology.orchestra.run.smithi142.stdout:Adding group ceph....done 2024-04-24T08:23:24.057 INFO:teuthology.orchestra.run.smithi142.stdout:Adding system user ceph....done 2024-04-24T08:23:24.209 INFO:teuthology.orchestra.run.smithi142.stdout:Setting system user ceph properties....done 2024-04-24T08:23:24.231 INFO:teuthology.orchestra.run.smithi142.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-24T08:23:24.371 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-24T08:23:24.409 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-mirror (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:24.764 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-24T08:23:24.972 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T08:23:24.972 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T08:23:25.396 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephfs-mirror (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:25.577 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-test (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:25.603 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T08:23:25.603 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T08:23:25.720 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up radosgw (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:26.224 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T08:23:26.224 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T08:23:26.322 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-test (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:26.805 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-base (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:26.841 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up radosgw (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:27.199 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-24T08:23:27.376 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T08:23:27.376 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T08:23:27.849 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mds (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-base (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:28.071 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T08:23:28.071 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T08:23:28.312 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-24T08:23:28.667 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:28.879 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T08:23:28.880 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T08:23:28.952 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mds (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:29.208 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T08:23:29.208 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T08:23:29.476 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-osd (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:29.773 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T08:23:29.774 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T08:23:29.812 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:30.025 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T08:23:30.025 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T08:23:30.412 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:30.538 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:30.639 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-osd (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:30.723 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mon (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:30.932 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T08:23:30.932 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T08:23:30.949 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T08:23:30.949 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T08:23:31.499 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-cephadm (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:31.608 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:31.642 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:31.709 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:31.767 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-dashboard (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:31.826 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mon (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:31.919 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-volume (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:32.019 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T08:23:32.019 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T08:23:32.255 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T08:23:32.355 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T08:23:32.499 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T08:23:32.670 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-cephadm (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:32.832 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:32.963 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-dashboard (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:33.106 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-volume (19.0.0-3116-g1f81fb39-1jammy) ... 2024-04-24T08:23:33.199 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T08:23:33.483 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T08:23:33.584 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T08:23:33.711 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T08:23:33.910 INFO:teuthology.orchestra.run.smithi088.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T08:23:33.914 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-24T08:23:33.988 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-24T08:23:34.163 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-04-24T08:23:34.164 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-04-24T08:23:34.332 INFO:teuthology.orchestra.run.smithi088.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-24T08:23:34.333 INFO:teuthology.orchestra.run.smithi088.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-24T08:23:34.333 INFO:teuthology.orchestra.run.smithi088.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-24T08:23:34.333 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T08:23:34.333 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T08:23:34.333 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T08:23:34.333 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T08:23:34.333 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T08:23:34.334 INFO:teuthology.orchestra.run.smithi088.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T08:23:34.334 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T08:23:34.334 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2024-04-24T08:23:34.334 INFO:teuthology.orchestra.run.smithi088.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-24T08:23:34.334 INFO:teuthology.orchestra.run.smithi088.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-24T08:23:34.335 INFO:teuthology.orchestra.run.smithi088.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-24T08:23:34.335 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-24T08:23:34.335 INFO:teuthology.orchestra.run.smithi088.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T08:23:34.335 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2024-04-24T08:23:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-24T08:23:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-24T08:23:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-24T08:23:34.390 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2024-04-24T08:23:34.391 INFO:teuthology.orchestra.run.smithi088.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-24T08:23:34.391 INFO:teuthology.orchestra.run.smithi088.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-24T08:23:34.391 INFO:teuthology.orchestra.run.smithi088.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-24T08:23:34.391 INFO:teuthology.orchestra.run.smithi088.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-24T08:23:34.391 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-24T08:23:34.391 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-24T08:23:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T08:23:34.392 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages will be upgraded: 2024-04-24T08:23:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-24T08:23:34.578 INFO:teuthology.orchestra.run.smithi088.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-24T08:23:34.579 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 55.7 MB of archives. 2024-04-24T08:23:34.579 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-24T08:23:34.579 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-24T08:23:34.862 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T08:23:35.222 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-24T08:23:35.238 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-24T08:23:35.363 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-24T08:23:35.364 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-24T08:23:35.365 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-24T08:23:35.394 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-24T08:23:35.394 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-24T08:23:35.398 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-24T08:23:35.401 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-24T08:23:35.401 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-24T08:23:35.566 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-24T08:23:35.582 INFO:teuthology.orchestra.run.smithi142.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T08:23:35.586 DEBUG:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-24T08:23:35.660 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2024-04-24T08:23:35.834 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2024-04-24T08:23:35.835 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2024-04-24T08:23:35.859 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-24T08:23:35.869 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-24T08:23:35.874 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-24T08:23:35.963 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-24T08:23:36.010 INFO:teuthology.orchestra.run.smithi142.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-24T08:23:36.011 INFO:teuthology.orchestra.run.smithi142.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-24T08:23:36.011 INFO:teuthology.orchestra.run.smithi142.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-24T08:23:36.011 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T08:23:36.011 INFO:teuthology.orchestra.run.smithi142.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T08:23:36.011 INFO:teuthology.orchestra.run.smithi142.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T08:23:36.011 INFO:teuthology.orchestra.run.smithi142.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T08:23:36.011 INFO:teuthology.orchestra.run.smithi142.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T08:23:36.012 INFO:teuthology.orchestra.run.smithi142.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T08:23:36.012 INFO:teuthology.orchestra.run.smithi142.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T08:23:36.012 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2024-04-24T08:23:36.012 INFO:teuthology.orchestra.run.smithi142.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-24T08:23:36.012 INFO:teuthology.orchestra.run.smithi142.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-24T08:23:36.013 INFO:teuthology.orchestra.run.smithi142.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-24T08:23:36.013 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-24T08:23:36.013 INFO:teuthology.orchestra.run.smithi142.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T08:23:36.014 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2024-04-24T08:23:36.014 INFO:teuthology.orchestra.run.smithi142.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-24T08:23:36.014 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-24T08:23:36.014 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-24T08:23:36.068 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2024-04-24T08:23:36.069 INFO:teuthology.orchestra.run.smithi142.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-24T08:23:36.069 INFO:teuthology.orchestra.run.smithi142.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-24T08:23:36.069 INFO:teuthology.orchestra.run.smithi142.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-24T08:23:36.069 INFO:teuthology.orchestra.run.smithi142.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-24T08:23:36.069 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-24T08:23:36.070 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-24T08:23:36.070 INFO:teuthology.orchestra.run.smithi142.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T08:23:36.071 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages will be upgraded: 2024-04-24T08:23:36.072 INFO:teuthology.orchestra.run.smithi142.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-24T08:23:36.135 INFO:teuthology.orchestra.run.smithi142.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-24T08:23:36.136 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 55.7 MB of archives. 2024-04-24T08:23:36.136 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-24T08:23:36.136 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-24T08:23:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-24T08:23:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-24T08:23:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-24T08:23:36.340 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-24T08:23:36.340 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-24T08:23:36.350 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-24T08:23:36.351 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-24T08:23:36.352 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-24T08:23:36.354 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-24T08:23:36.354 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-24T08:23:36.355 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-24T08:23:36.372 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-24T08:23:36.372 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-24T08:23:36.372 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-24T08:23:36.393 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-24T08:23:36.661 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-24T08:23:36.663 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-24T08:23:36.663 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-24T08:23:36.666 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-24T08:23:36.666 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-24T08:23:36.670 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-24T08:23:36.672 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-24T08:23:36.679 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-24T08:23:36.680 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-24T08:23:36.702 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-24T08:23:36.703 INFO:teuthology.orchestra.run.smithi142.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-24T08:23:36.714 INFO:teuthology.orchestra.run.smithi142.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-24T08:23:36.735 INFO:teuthology.orchestra.run.smithi142.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-24T08:23:36.739 INFO:teuthology.orchestra.run.smithi142.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-24T08:23:36.739 INFO:teuthology.orchestra.run.smithi142.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-24T08:23:36.740 INFO:teuthology.orchestra.run.smithi142.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-24T08:23:36.741 INFO:teuthology.orchestra.run.smithi142.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-24T08:23:36.752 INFO:teuthology.orchestra.run.smithi142.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-24T08:23:36.756 INFO:teuthology.orchestra.run.smithi142.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-24T08:23:36.919 INFO:teuthology.orchestra.run.smithi142.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-24T08:23:36.919 INFO:teuthology.orchestra.run.smithi142.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-24T08:23:36.919 INFO:teuthology.orchestra.run.smithi142.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-24T08:23:36.919 INFO:teuthology.orchestra.run.smithi142.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-24T08:23:36.919 INFO:teuthology.orchestra.run.smithi142.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-24T08:23:36.920 INFO:teuthology.orchestra.run.smithi142.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-24T08:23:36.931 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-24T08:23:36.933 INFO:teuthology.orchestra.run.smithi142.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-24T08:23:36.933 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-24T08:23:36.933 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-24T08:23:36.934 INFO:teuthology.orchestra.run.smithi142.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-24T08:23:36.957 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-24T08:23:36.957 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-24T08:23:36.962 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-24T08:23:37.127 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-24T08:23:37.312 INFO:teuthology.orchestra.run.smithi142.stdout:Preconfiguring packages ... 2024-04-24T08:23:37.477 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 55.7 MB in 1s (65.3 MB/s) 2024-04-24T08:23:37.737 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-24T08:23:37.738 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-24T08:23:37.765 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-24T08:23:37.769 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T08:23:37.910 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T08:23:37.917 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-24T08:23:37.918 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-24T08:23:37.957 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-24T08:23:38.019 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-24T08:23:38.024 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-24T08:23:38.025 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-24T08:23:38.026 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-24T08:23:38.026 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-24T08:23:38.233 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-24T08:23:38.551 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-24T08:23:38.656 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-24T08:23:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-24T08:23:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-24T08:23:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-24T08:23:39.404 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-24T08:23:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-24T08:23:39.405 INFO:teuthology.orchestra.run.smithi088.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-24T08:23:39.435 INFO:teuthology.orchestra.run.smithi088.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-24T08:23:39.436 INFO:teuthology.orchestra.run.smithi088.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-24T08:23:39.631 INFO:teuthology.orchestra.run.smithi142.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-24T08:23:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:Preconfiguring packages ... 2024-04-24T08:23:39.907 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package flex. 2024-04-24T08:23:39.964 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 55.7 MB in 5s (11.1 MB/s) 2024-04-24T08:23:39.980 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-24T08:23:39.983 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-24T08:23:40.030 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-24T08:23:40.454 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-24T08:23:40.458 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T08:23:40.641 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T08:23:40.863 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T08:23:41.275 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-24T08:23:41.293 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-24T08:23:41.955 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T08:23:42.305 INFO:teuthology.orchestra.run.smithi088.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-24T08:23:42.520 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-24T08:23:42.523 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T08:23:42.555 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package flex. 2024-04-24T08:23:42.625 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-24T08:23:42.628 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-24T08:23:42.670 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-24T08:23:42.671 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T08:23:43.067 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T08:23:43.180 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T08:23:43.194 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T08:23:43.334 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-24T08:23:43.517 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T08:23:43.698 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T08:23:43.912 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package bison. 2024-04-24T08:23:43.983 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-24T08:23:43.987 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-24T08:23:44.030 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T08:23:44.221 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-24T08:23:44.225 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T08:23:44.333 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T08:23:44.407 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-24T08:23:44.421 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-24T08:23:44.465 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T08:23:44.754 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T08:23:44.826 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package dump. 2024-04-24T08:23:44.840 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-24T08:23:44.881 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T08:23:44.884 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking dump (0.4b47-3) ... 2024-04-24T08:23:45.163 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package indent. 2024-04-24T08:23:45.178 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T08:23:45.180 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T08:23:45.213 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T08:23:45.416 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-24T08:23:45.431 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-24T08:23:45.474 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T08:23:45.549 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package bison. 2024-04-24T08:23:45.622 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-24T08:23:45.626 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-24T08:23:45.668 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T08:23:45.803 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-24T08:23:45.818 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-24T08:23:45.861 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T08:23:46.069 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-24T08:23:46.083 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-24T08:23:46.127 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T08:23:46.130 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-24T08:23:46.146 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-24T08:23:46.188 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T08:23:46.430 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package dump. 2024-04-24T08:23:46.445 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-24T08:23:46.480 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking dump (0.4b47-3) ... 2024-04-24T08:23:46.593 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-24T08:23:46.608 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-24T08:23:46.651 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T08:23:46.767 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package indent. 2024-04-24T08:23:46.781 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T08:23:46.818 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T08:23:46.878 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-24T08:23:46.894 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-24T08:23:46.928 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T08:23:47.104 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-24T08:23:47.118 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-24T08:23:47.162 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T08:23:47.173 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libjson-perl. 2024-04-24T08:23:47.189 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-24T08:23:47.232 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-24T08:23:47.458 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-24T08:23:47.472 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-24T08:23:47.516 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T08:23:47.576 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-24T08:23:47.591 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-24T08:23:47.634 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T08:23:47.785 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-24T08:23:47.800 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-24T08:23:47.844 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T08:23:48.189 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-24T08:23:48.204 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-24T08:23:48.239 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T08:23:48.466 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-24T08:23:48.482 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-24T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T08:23:48.761 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjson-perl. 2024-04-24T08:23:48.776 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-24T08:23:48.819 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-24T08:23:49.012 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-24T08:23:49.028 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T08:23:49.070 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T08:23:49.131 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-24T08:23:49.146 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-24T08:23:49.189 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T08:23:49.348 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-24T08:23:49.364 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T08:23:49.406 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T08:23:49.759 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-24T08:23:49.775 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T08:23:49.809 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T08:23:50.287 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-24T08:23:50.303 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-24T08:23:50.345 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T08:23:50.715 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-24T08:23:50.731 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T08:23:50.773 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T08:23:50.785 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-24T08:23:50.801 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T08:23:50.843 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T08:23:51.104 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-24T08:23:51.120 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T08:23:51.126 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-24T08:23:51.142 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T08:23:51.162 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T08:23:51.184 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T08:23:51.482 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-24T08:23:51.497 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T08:23:51.540 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T08:23:51.547 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-24T08:23:51.563 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T08:23:51.606 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T08:23:51.857 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-24T08:23:51.872 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-24T08:23:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-24T08:23:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T08:23:51.920 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T08:23:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T08:23:52.186 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-24T08:23:52.202 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T08:23:52.246 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-24T08:23:52.261 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T08:23:52.268 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T08:23:52.304 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T08:23:52.632 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-24T08:23:52.647 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T08:23:52.690 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T08:23:52.739 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-24T08:23:52.754 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-24T08:23:52.789 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T08:23:52.977 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-24T08:23:52.992 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T08:23:53.027 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T08:23:53.092 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package modemmanager. 2024-04-24T08:23:53.108 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T08:23:53.150 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T08:23:53.321 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-24T08:23:53.336 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T08:23:53.379 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T08:23:53.623 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-24T08:23:53.639 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T08:23:53.681 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T08:23:53.774 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package network-manager. 2024-04-24T08:23:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T08:23:53.831 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-24T08:23:54.169 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-24T08:23:54.183 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-24T08:23:54.227 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T08:23:54.500 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ppp. 2024-04-24T08:23:54.516 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-24T08:23:54.530 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package modemmanager. 2024-04-24T08:23:54.545 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T08:23:54.588 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T08:23:54.849 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T08:23:55.237 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package pptp-linux. 2024-04-24T08:23:55.252 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-24T08:23:55.287 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package network-manager. 2024-04-24T08:23:55.295 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-24T08:23:55.303 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T08:23:55.353 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-24T08:23:55.523 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-24T08:23:55.538 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-24T08:23:55.573 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-24T08:23:55.843 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-24T08:23:55.857 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-24T08:23:55.892 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-client-common (238) ... 2024-04-24T08:23:56.213 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-24T08:23:56.227 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T08:23:56.263 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T08:23:56.555 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ppp. 2024-04-24T08:23:56.571 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-24T08:23:56.918 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T08:23:57.226 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package pptp-linux. 2024-04-24T08:23:57.240 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-24T08:23:57.276 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-24T08:23:57.352 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-common. 2024-04-24T08:23:57.368 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-24T08:23:57.428 INFO:teuthology.orchestra.run.smithi142.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-24T08:23:57.450 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-common (238) ... 2024-04-24T08:23:57.495 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-24T08:23:57.509 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-24T08:23:57.553 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-24T08:23:57.856 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-24T08:23:57.871 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-24T08:23:57.914 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client-common (238) ... 2024-04-24T08:23:57.917 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-14. 2024-04-24T08:23:57.933 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T08:23:57.977 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T08:23:58.252 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-24T08:23:58.267 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T08:23:58.310 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T08:23:58.890 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-common. 2024-04-24T08:23:58.904 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-24T08:23:58.965 INFO:teuthology.orchestra.run.smithi088.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-24T08:23:58.996 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-common (238) ... 2024-04-24T08:23:59.093 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql. 2024-04-24T08:23:59.109 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-24T08:23:59.143 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql (14+238) ... 2024-04-24T08:23:59.379 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-client. 2024-04-24T08:23:59.393 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-24T08:23:59.437 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-client (14+238) ... 2024-04-24T08:23:59.439 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-14. 2024-04-24T08:23:59.453 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T08:23:59.491 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T08:23:59.714 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-24T08:23:59.729 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-24T08:23:59.772 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-24T08:24:00.100 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package tcl8.6. 2024-04-24T08:24:00.115 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-24T08:24:00.158 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T08:24:00.427 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package tcl. 2024-04-24T08:24:00.443 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-24T08:24:00.481 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-24T08:24:00.617 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql. 2024-04-24T08:24:00.631 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-24T08:24:00.675 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql (14+238) ... 2024-04-24T08:24:00.796 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package wpasupplicant. 2024-04-24T08:24:00.812 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-24T08:24:00.846 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T08:24:00.928 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client. 2024-04-24T08:24:00.942 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-24T08:24:00.986 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client (14+238) ... 2024-04-24T08:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-24T08:24:01.200 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-24T08:24:01.229 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-24T08:24:01.242 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-24T08:24:01.244 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-24T08:24:01.288 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-24T08:24:01.574 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package tcl8.6. 2024-04-24T08:24:01.588 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-24T08:24:01.624 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T08:24:01.736 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-24T08:24:01.753 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-24T08:24:01.802 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T08:24:01.935 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package tcl. 2024-04-24T08:24:01.950 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-24T08:24:01.997 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-24T08:24:02.104 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-client-common (238) ... 2024-04-24T08:24:02.317 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-24T08:24:02.329 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package wpasupplicant. 2024-04-24T08:24:02.345 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-24T08:24:02.388 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T08:24:02.493 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T08:24:02.619 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T08:24:02.719 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T08:24:02.734 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-24T08:24:02.750 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-24T08:24:02.792 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-24T08:24:02.820 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T08:24:02.938 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T08:24:03.197 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-24T08:24:03.213 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-24T08:24:03.255 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T08:24:03.540 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client-common (238) ... 2024-04-24T08:24:03.753 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-24T08:24:03.887 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T08:24:03.888 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-24T08:24:03.985 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T08:24:04.013 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T08:24:04.123 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T08:24:04.224 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T08:24:04.313 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T08:24:04.313 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T08:24:04.366 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T08:24:05.004 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T08:24:05.130 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T08:24:05.289 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T08:24:05.321 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-24T08:24:05.421 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T08:24:05.423 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-24T08:24:05.549 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T08:24:05.742 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T08:24:05.782 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T08:24:05.782 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T08:24:05.868 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T08:24:05.985 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T08:24:06.732 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T08:24:06.783 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T08:24:06.858 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up dump (0.4b47-3) ... 2024-04-24T08:24:06.951 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T08:24:06.953 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-24T08:24:07.076 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T08:24:07.202 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-24T08:24:07.337 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T08:24:07.409 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T08:24:07.463 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T08:24:07.535 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T08:24:07.588 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T08:24:07.661 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-24T08:24:07.689 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T08:24:07.770 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-24T08:24:07.880 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T08:24:07.953 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-24T08:24:08.023 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T08:24:08.174 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T08:24:08.350 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T08:24:08.378 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T08:24:08.476 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T08:24:08.504 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up dump (0.4b47-3) ... 2024-04-24T08:24:08.599 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-24T08:24:08.602 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-24T08:24:08.664 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T08:24:08.765 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T08:24:08.770 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-client (14+238) ... 2024-04-24T08:24:08.882 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-24T08:24:08.895 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-24T08:24:09.008 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-24T08:24:09.135 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T08:24:09.224 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-24T08:24:09.294 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T08:24:09.437 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T08:24:09.464 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:09.464 INFO:teuthology.orchestra.run.smithi142.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-24T08:24:09.464 INFO:teuthology.orchestra.run.smithi142.stdout:which means they are currently configured by ifupdown: 2024-04-24T08:24:09.464 INFO:teuthology.orchestra.run.smithi142.stdout:- enp3s0f1 2024-04-24T08:24:09.464 INFO:teuthology.orchestra.run.smithi142.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-24T08:24:09.464 INFO:teuthology.orchestra.run.smithi142.stdout:remove their configuration from /etc/network/interfaces. 2024-04-24T08:24:09.464 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:09.595 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-24T08:24:09.613 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T08:24:09.739 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T08:24:09.840 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-24T08:24:09.990 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-24T08:24:10.000 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client (14+238) ... 2024-04-24T08:24:10.126 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-24T08:24:10.398 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-24T08:24:10.717 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:10.717 INFO:teuthology.orchestra.run.smithi088.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-24T08:24:10.717 INFO:teuthology.orchestra.run.smithi088.stdout:which means they are currently configured by ifupdown: 2024-04-24T08:24:10.717 INFO:teuthology.orchestra.run.smithi088.stdout:- enp3s0f1 2024-04-24T08:24:10.717 INFO:teuthology.orchestra.run.smithi088.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-24T08:24:10.717 INFO:teuthology.orchestra.run.smithi088.stdout:remove their configuration from /etc/network/interfaces. 2024-04-24T08:24:10.718 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:10.849 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-24T08:24:11.140 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T08:24:11.235 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-24T08:24:11.282 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T08:24:11.409 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-24T08:24:11.534 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-common (238) ... 2024-04-24T08:24:11.630 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-24T08:24:12.295 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T08:24:12.425 INFO:teuthology.orchestra.run.smithi142.stdout:Adding user postgres to group ssl-cert 2024-04-24T08:24:12.429 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T08:24:12.556 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-24T08:24:12.643 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:12.643 INFO:teuthology.orchestra.run.smithi142.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-24T08:24:12.665 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-common (238) ... 2024-04-24T08:24:12.917 INFO:teuthology.orchestra.run.smithi142.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-24T08:24:12.917 INFO:teuthology.orchestra.run.smithi142.stdout:Removing obsolete dictionary files: 2024-04-24T08:24:13.587 INFO:teuthology.orchestra.run.smithi088.stdout:Adding user postgres to group ssl-cert 2024-04-24T08:24:13.643 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-24T08:24:13.846 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:13.846 INFO:teuthology.orchestra.run.smithi088.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-24T08:24:14.093 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T08:24:14.095 INFO:teuthology.orchestra.run.smithi088.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-24T08:24:14.095 INFO:teuthology.orchestra.run.smithi088.stdout:Removing obsolete dictionary files: 2024-04-24T08:24:14.552 INFO:teuthology.orchestra.run.smithi142.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-24T08:24:14.574 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-24T08:24:14.620 INFO:teuthology.orchestra.run.smithi142.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-24T08:24:14.620 INFO:teuthology.orchestra.run.smithi142.stdout:This user must also own the server process. 2024-04-24T08:24:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:14.620 INFO:teuthology.orchestra.run.smithi142.stdout:The database cluster will be initialized with locale "en_US". 2024-04-24T08:24:14.620 INFO:teuthology.orchestra.run.smithi142.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-24T08:24:14.620 INFO:teuthology.orchestra.run.smithi142.stdout:The default text search configuration will be set to "english". 2024-04-24T08:24:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:14.620 INFO:teuthology.orchestra.run.smithi142.stdout:Data page checksums are disabled. 2024-04-24T08:24:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:14.620 INFO:teuthology.orchestra.run.smithi142.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-24T08:24:14.621 INFO:teuthology.orchestra.run.smithi142.stdout:creating subdirectories ... ok 2024-04-24T08:24:14.621 INFO:teuthology.orchestra.run.smithi142.stdout:selecting dynamic shared memory implementation ... posix 2024-04-24T08:24:14.645 INFO:teuthology.orchestra.run.smithi142.stdout:selecting default max_connections ... 100 2024-04-24T08:24:14.678 INFO:teuthology.orchestra.run.smithi142.stdout:selecting default shared_buffers ... 128MB 2024-04-24T08:24:14.693 INFO:teuthology.orchestra.run.smithi142.stdout:selecting default time zone ... Etc/UTC 2024-04-24T08:24:14.694 INFO:teuthology.orchestra.run.smithi142.stdout:creating configuration files ... ok 2024-04-24T08:24:14.782 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-24T08:24:14.858 INFO:teuthology.orchestra.run.smithi142.stdout:running bootstrap script ... ok 2024-04-24T08:24:15.241 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T08:24:15.470 INFO:teuthology.orchestra.run.smithi142.stdout:performing post-bootstrap initialization ... ok 2024-04-24T08:24:15.581 INFO:teuthology.orchestra.run.smithi088.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-24T08:24:15.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-24T08:24:15.644 INFO:teuthology.orchestra.run.smithi088.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-24T08:24:15.645 INFO:teuthology.orchestra.run.smithi088.stdout:This user must also own the server process. 2024-04-24T08:24:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:15.645 INFO:teuthology.orchestra.run.smithi088.stdout:The database cluster will be initialized with locale "en_US". 2024-04-24T08:24:15.645 INFO:teuthology.orchestra.run.smithi088.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-24T08:24:15.645 INFO:teuthology.orchestra.run.smithi088.stdout:The default text search configuration will be set to "english". 2024-04-24T08:24:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:15.645 INFO:teuthology.orchestra.run.smithi088.stdout:Data page checksums are disabled. 2024-04-24T08:24:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:15.645 INFO:teuthology.orchestra.run.smithi088.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-24T08:24:15.646 INFO:teuthology.orchestra.run.smithi088.stdout:creating subdirectories ... ok 2024-04-24T08:24:15.646 INFO:teuthology.orchestra.run.smithi088.stdout:selecting dynamic shared memory implementation ... posix 2024-04-24T08:24:15.669 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default max_connections ... 100 2024-04-24T08:24:15.702 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default shared_buffers ... 128MB 2024-04-24T08:24:15.716 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default time zone ... Etc/UTC 2024-04-24T08:24:15.717 INFO:teuthology.orchestra.run.smithi088.stdout:creating configuration files ... ok 2024-04-24T08:24:15.880 INFO:teuthology.orchestra.run.smithi088.stdout:running bootstrap script ... ok 2024-04-24T08:24:16.080 INFO:teuthology.orchestra.run.smithi142.stdout:syncing data to disk ... ok 2024-04-24T08:24:16.516 INFO:teuthology.orchestra.run.smithi088.stdout:performing post-bootstrap initialization ... ok 2024-04-24T08:24:16.572 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-24T08:24:17.065 INFO:teuthology.orchestra.run.smithi088.stdout:syncing data to disk ... ok 2024-04-24T08:24:17.548 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-24T08:24:19.650 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T08:24:19.767 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-24T08:24:19.868 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql (14+238) ... 2024-04-24T08:24:19.969 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T08:24:20.112 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T08:24:20.372 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T08:24:20.372 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T08:24:20.689 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T08:24:20.815 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-24T08:24:20.941 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql (14+238) ... 2024-04-24T08:24:21.042 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T08:24:21.147 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T08:24:21.160 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T08:24:21.240 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-24T08:24:21.421 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T08:24:21.421 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T08:24:21.558 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T08:24:21.718 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T08:24:22.112 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T08:24:22.204 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-24T08:24:22.523 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T08:24:22.666 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T08:24:23.053 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-24T08:24:23.145 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T08:24:23.662 INFO:teuthology.orchestra.run.smithi142.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T08:24:23.669 DEBUG:teuthology.parallel:result is None 2024-04-24T08:24:24.061 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-24T08:24:24.161 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T08:24:24.719 INFO:teuthology.orchestra.run.smithi088.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T08:24:24.725 DEBUG:teuthology.parallel:result is None 2024-04-24T08:24:24.726 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1f81fb397ae98da7563d451a78c61574c8f4e6e0 2024-04-24T08:24:24.890 DEBUG:teuthology.orchestra.run.smithi088:> dpkg-query -W -f '${Version}' ceph 2024-04-24T08:24:24.913 INFO:teuthology.orchestra.run.smithi088.stdout:19.0.0-3116-g1f81fb39-1jammy 2024-04-24T08:24:24.913 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3116-g1f81fb39-1jammy 2024-04-24T08:24:24.913 INFO:teuthology.task.install:The correct ceph version 19.0.0-3116-g1f81fb39-1jammy is installed. 2024-04-24T08:24:24.915 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1f81fb397ae98da7563d451a78c61574c8f4e6e0 2024-04-24T08:24:25.145 DEBUG:teuthology.orchestra.run.smithi142:> dpkg-query -W -f '${Version}' ceph 2024-04-24T08:24:25.169 INFO:teuthology.orchestra.run.smithi142.stdout:19.0.0-3116-g1f81fb39-1jammy 2024-04-24T08:24:25.169 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3116-g1f81fb39-1jammy 2024-04-24T08:24:25.169 INFO:teuthology.task.install:The correct ceph version 19.0.0-3116-g1f81fb39-1jammy is installed. 2024-04-24T08:24:25.171 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-24T08:24:25.171 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:25.171 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T08:24:25.191 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:24:25.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T08:24:25.236 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-24T08:24:25.236 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:25.236 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T08:24:25.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T08:24:25.318 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:24:25.318 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T08:24:25.339 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T08:24:25.403 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-24T08:24:25.403 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:25.403 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T08:24:25.422 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T08:24:25.486 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:24:25.487 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T08:24:25.507 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T08:24:25.574 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-24T08:24:25.575 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:25.575 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T08:24:25.594 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T08:24:25.654 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:24:25.654 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T08:24:25.674 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T08:24:25.739 INFO:teuthology.run_tasks:Running task ceph... 2024-04-24T08:24:25.830 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-24T08:24:25.830 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2024-04-24T08:24:25.833 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-04-24T08:24:25.853 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-24T08:24:25.854 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T08:24:25.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T08:24:25.919 INFO:tasks.ceph:Creating extra log directories... 2024-04-24T08:24:25.919 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T08:24:25.954 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T08:24:25.993 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-24T08:24:25.993 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-24T08:24:25.993 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-24T08:24:25.993 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:25.993 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-24T08:24:26.023 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-24T08:24:26.109 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:24:26.109 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-24T08:24:26.118 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-24T08:24:26.214 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-24T08:24:26.215 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-24T08:24:26.215 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215', 'branch': 'rishabh-main-apr17-a654945', 'description': 'fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell}', 'email': None, 'first_in_suite': False, 'job_id': '7671215', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-main-apr17-a654945'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '1f81fb397ae98da7563d451a78c61574c8f4e6e0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1f81fb397ae98da7563d451a78c61574c8f4e6e0'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-main-apr17-a654945', 'sha1': '1f81fb397ae98da7563d451a78c61574c8f4e6e0'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 7954, 'sha1': '1f81fb397ae98da7563d451a78c61574c8f4e6e0', 'sleep_before_teardown': 0, 'subset': '364/512', 'suite': 'fs', 'suite_branch': 'rishabh-main-apr17-a654945', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1f81fb397ae98da7563d451a78c61574c8f4e6e0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1f81fb397ae98da7563d451a78c61574c8f4e6e0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7KnOPcHZcxJTfUZiHBPafRwYDiWQ6t/KQSznzuP2z3g3T+5hgDmN2FKhIsGWtisn5RqLj8XbNhanRM5TU/1KU=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDRtOf/tckZAVCMYlgMVPlD+8iO7z9o0CmZkJOZPeGRAR5DDfG+kBXyBP5hJL2JdCMFcgzlRpMfh26NaoDbIYc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1f81fb397ae98da7563d451a78c61574c8f4e6e0'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '1f81fb397ae98da7563d451a78c61574c8f4e6e0', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_cephfs_shell']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_07:32:23', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-24T08:24:26.215 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T08:24:26.218 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T08:24:26.227 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T08:24:26.270 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T08:24:26.294 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:26.294 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T08:24:26.340 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T08:24:26.340 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2024-04-24T08:24:26.396 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T08:24:26.396 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T08:24:26.396 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 879 Links: 1 2024-04-24T08:24:26.396 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T08:24:26.396 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-24 08:18:07.882916800 +0000 2024-04-24T08:24:26.396 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-24 08:18:07.878916836 +0000 2024-04-24T08:24:26.396 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-24 08:18:07.878916836 +0000 2024-04-24T08:24:26.396 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-04-24 08:18:07.878916836 +0000 2024-04-24T08:24:26.397 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T08:24:26.457 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-24T08:24:26.457 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-24T08:24:26.457 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000392932 s, 1.3 MB/s 2024-04-24T08:24:26.459 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T08:24:26.514 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2024-04-24T08:24:26.567 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T08:24:26.568 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T08:24:26.568 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 898 Links: 1 2024-04-24T08:24:26.568 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T08:24:26.568 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-24 08:18:08.710909404 +0000 2024-04-24T08:24:26.568 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-24 08:18:08.430911905 +0000 2024-04-24T08:24:26.568 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-24 08:18:08.430911905 +0000 2024-04-24T08:24:26.568 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-04-24 08:18:08.430911905 +0000 2024-04-24T08:24:26.568 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T08:24:26.633 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-24T08:24:26.633 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-24T08:24:26.633 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000358446 s, 1.4 MB/s 2024-04-24T08:24:26.635 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T08:24:26.685 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2024-04-24T08:24:26.740 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T08:24:26.740 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T08:24:26.740 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 915 Links: 1 2024-04-24T08:24:26.740 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T08:24:26.740 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-24 08:18:09.246904616 +0000 2024-04-24T08:24:26.740 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-24 08:18:09.006906760 +0000 2024-04-24T08:24:26.740 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-24 08:18:09.006906760 +0000 2024-04-24T08:24:26.740 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-04-24 08:18:09.006906760 +0000 2024-04-24T08:24:26.740 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T08:24:26.801 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-24T08:24:26.802 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-24T08:24:26.802 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000633249 s, 809 kB/s 2024-04-24T08:24:26.803 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T08:24:26.858 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2024-04-24T08:24:26.908 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T08:24:26.908 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T08:24:26.908 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 930 Links: 1 2024-04-24T08:24:26.908 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T08:24:26.909 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-24 08:18:09.822899472 +0000 2024-04-24T08:24:26.909 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-24 08:18:09.550901901 +0000 2024-04-24T08:24:26.909 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-24 08:18:09.550901901 +0000 2024-04-24T08:24:26.909 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-04-24 08:18:09.550901901 +0000 2024-04-24T08:24:26.909 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T08:24:26.969 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-24T08:24:26.969 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-24T08:24:26.970 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000379289 s, 1.3 MB/s 2024-04-24T08:24:26.971 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T08:24:27.023 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T08:24:27.023 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:24:27.023 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T08:24:27.032 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T08:24:27.032 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-04-24T08:24:27.087 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T08:24:27.087 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T08:24:27.087 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 896 Links: 1 2024-04-24T08:24:27.087 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T08:24:27.088 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-24 08:18:07.583717250 +0000 2024-04-24T08:24:27.088 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-24 08:18:07.327719534 +0000 2024-04-24T08:24:27.088 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-24 08:18:07.327719534 +0000 2024-04-24T08:24:27.088 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-24 08:18:07.327719534 +0000 2024-04-24T08:24:27.088 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T08:24:27.149 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-24T08:24:27.149 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-24T08:24:27.149 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000421226 s, 1.2 MB/s 2024-04-24T08:24:27.151 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T08:24:27.210 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-04-24T08:24:27.263 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T08:24:27.263 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T08:24:27.263 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 914 Links: 1 2024-04-24T08:24:27.264 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T08:24:27.264 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-24 08:18:08.111712540 +0000 2024-04-24T08:24:27.264 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-24 08:18:07.827715073 +0000 2024-04-24T08:24:27.264 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-24 08:18:07.827715073 +0000 2024-04-24T08:24:27.264 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-24 08:18:07.827715073 +0000 2024-04-24T08:24:27.264 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T08:24:27.329 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-24T08:24:27.329 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-24T08:24:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000403259 s, 1.3 MB/s 2024-04-24T08:24:27.331 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T08:24:27.386 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-04-24T08:24:27.439 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T08:24:27.439 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T08:24:27.439 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 932 Links: 1 2024-04-24T08:24:27.439 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T08:24:27.439 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-24 08:18:08.723707080 +0000 2024-04-24T08:24:27.439 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-24 08:18:08.435709649 +0000 2024-04-24T08:24:27.439 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-24 08:18:08.435709649 +0000 2024-04-24T08:24:27.439 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-24 08:18:08.435709649 +0000 2024-04-24T08:24:27.440 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T08:24:27.505 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-24T08:24:27.505 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-24T08:24:27.505 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000375497 s, 1.4 MB/s 2024-04-24T08:24:27.507 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T08:24:27.565 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-04-24T08:24:27.619 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T08:24:27.619 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T08:24:27.619 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 950 Links: 1 2024-04-24T08:24:27.619 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T08:24:27.619 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-24 08:18:09.307701871 +0000 2024-04-24T08:24:27.619 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-24 08:18:09.051704154 +0000 2024-04-24T08:24:27.619 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-24 08:18:09.051704154 +0000 2024-04-24T08:24:27.619 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-24 08:18:09.051704154 +0000 2024-04-24T08:24:27.620 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T08:24:27.681 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-24T08:24:27.681 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-24T08:24:27.681 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000663962 s, 771 kB/s 2024-04-24T08:24:27.683 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T08:24:27.741 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T08:24:27.741 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-24T08:24:27.741 INFO:tasks.ceph:Generating config... 2024-04-24T08:24:27.742 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-24T08:24:27.742 INFO:tasks.ceph:[client] debug client = 20 2024-04-24T08:24:27.742 INFO:tasks.ceph:[client] debug ms = 1 2024-04-24T08:24:27.743 INFO:tasks.ceph:[client] pid file = 2024-04-24T08:24:27.743 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-24T08:24:27.743 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-24T08:24:27.743 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-24T08:24:27.743 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-24T08:24:27.743 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-24T08:24:27.743 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-24T08:24:27.743 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-24T08:24:27.743 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-24T08:24:27.743 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-24T08:24:27.743 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-24T08:24:27.743 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-24T08:24:27.743 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-24T08:24:27.743 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-24T08:24:27.743 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-24T08:24:27.744 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-24T08:24:27.744 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-24T08:24:27.744 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-24T08:24:27.744 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-24T08:24:27.744 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-24T08:24:27.744 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-24T08:24:27.744 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-24T08:24:27.744 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-24T08:24:27.744 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-24T08:24:27.744 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-24T08:24:27.744 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-24T08:24:27.744 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-24T08:24:27.744 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-24T08:24:27.744 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-24T08:24:27.744 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-24T08:24:27.744 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-24T08:24:27.745 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-24T08:24:27.745 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-24T08:24:27.745 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-24T08:24:27.745 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-24T08:24:27.745 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-24T08:24:27.745 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-24T08:24:27.745 INFO:tasks.ceph:Setting up mon.a... 2024-04-24T08:24:27.745 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-24T08:24:27.791 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2024-04-24T08:24:27.809 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-24T08:24:27.899 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T08:24:27.919 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.b', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]')] 2024-04-24T08:24:27.920 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.88,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-24T08:24:27.920 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:27.921 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T08:24:27.971 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.88 --add b 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:24:28.061 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:24:28.061 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid 0c7f29ca-8828-476d-9ca3-111d6acc4dca 2024-04-24T08:24:28.061 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = quincy 2024-04-24T08:24:28.062 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2024-04-24T08:24:28.062 INFO:teuthology.orchestra.run.smithi088.stdout:fsid 0c7f29ca-8828-476d-9ca3-111d6acc4dca 2024-04-24T08:24:28.062 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2024-04-24T08:24:28.063638+0000 2024-04-24T08:24:28.062 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-04-24T08:24:28.063638+0000 2024-04-24T08:24:28.062 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 17 (quincy) 2024-04-24T08:24:28.062 INFO:teuthology.orchestra.run.smithi088.stdout:election_strategy: 1 2024-04-24T08:24:28.062 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-04-24T08:24:28.062 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2024-04-24T08:24:28.062 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-04-24T08:24:28.062 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-24T08:24:28.064 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T08:24:28.072 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0c7f29ca-8828-476d-9ca3-111d6acc4dca... 2024-04-24T08:24:28.073 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T08:24:28.118 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T08:24:28.158 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2024-04-24T08:24:28.158 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2024-04-24T08:24:28.158 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T08:24:28.158 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2024-04-24T08:24:28.158 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.158 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2024-04-24T08:24:28.158 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T08:24:28.159 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.160 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 0c7f29ca-8828-476d-9ca3-111d6acc4dca 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2024-04-24T08:24:28.161 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug trim objects = true 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2024-04-24T08:24:28.162 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: bdev async discard = True 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: bdev enable discard = True 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore allocator = bitmap 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2024-04-24T08:24:28.163 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 1/20 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 1/20 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 4/10 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2024-04-24T08:24:28.164 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-04-24T08:24:28.165 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2024-04-24T08:24:28.166 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: mon down mkfs grace = 300 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = "" 2024-04-24T08:24:28.167 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds balancer = 20 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2024-04-24T08:24:28.168 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2024-04-24T08:24:28.169 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2024-04-24T08:24:28.169 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2024-04-24T08:24:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-04-24T08:24:28.169 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-04-24T08:24:28.169 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T08:24:28.169 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-04-24T08:24:28.169 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.169 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-04-24T08:24:28.169 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T08:24:28.170 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T08:24:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.88,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 0c7f29ca-8828-476d-9ca3-111d6acc4dca 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-04-24T08:24:28.172 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.173 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore allocator = bitmap 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-04-24T08:24:28.174 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 1/20 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 1/20 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 4/10 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-04-24T08:24:28.175 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-04-24T08:24:28.176 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-04-24T08:24:28.177 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: mon down mkfs grace = 300 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-04-24T08:24:28.178 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds balancer = 20 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2024-04-24T08:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2024-04-24T08:24:28.180 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2024-04-24T08:24:28.180 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-04-24T08:24:28.180 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-04-24T08:24:28.180 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-04-24T08:24:28.181 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-24T08:24:28.181 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-24T08:24:28.284 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-24T08:24:28.284 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:28.284 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-24T08:24:28.292 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:28.293 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-24T08:24:28.343 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:24:28.343 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:28.343 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T08:24:28.343 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T08:24:28.414 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:28.414 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:24:28.463 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T08:24:28.463 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:24:28.463 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T08:24:28.463 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T08:24:28.499 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:24:28.499 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:24:28.551 INFO:tasks.ceph:Setting up mon nodes... 2024-04-24T08:24:28.551 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-24T08:24:28.551 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-24T08:24:28.604 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-24T08:24:28.610 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T08:24:28.669 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T08:24:28.688 INFO:tasks.ceph:Setting up mds nodes... 2024-04-24T08:24:28.689 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-24T08:24:28.742 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-24T08:24:28.747 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-24T08:24:28.766 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-24T08:24:28.824 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-24T08:24:28.828 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-24T08:24:28.848 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-24T08:24:28.848 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-24T08:24:28.890 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-24T08:24:28.907 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-24T08:24:28.907 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-24T08:24:28.907 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-24T08:24:28.966 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T08:24:28.966 INFO:tasks.ceph:role: osd.0 2024-04-24T08:24:28.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:24:28.966 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T08:24:29.034 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T08:24:29.034 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T08:24:29.034 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T08:24:29.034 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T08:24:29.034 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T08:24:29.034 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-24T08:24:29.034 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T08:24:29.034 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T08:24:29.034 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T08:24:29.034 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T08:24:29.430 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-24T08:24:29.433 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-24T08:24:29.433 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-24T08:24:29.531 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-24T08:24:29.546 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T08:24:29.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:24:29.547 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-24T08:24:29.610 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T08:24:29.610 INFO:tasks.ceph:role: osd.1 2024-04-24T08:24:29.610 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:24:29.610 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T08:24:29.678 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T08:24:29.678 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T08:24:29.678 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T08:24:29.678 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T08:24:29.678 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T08:24:29.678 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-24T08:24:29.678 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T08:24:29.678 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T08:24:29.679 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T08:24:29.679 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T08:24:30.072 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-24T08:24:30.075 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-24T08:24:30.075 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-24T08:24:30.171 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-24T08:24:30.186 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T08:24:30.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:24:30.187 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-24T08:24:30.246 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T08:24:30.246 INFO:tasks.ceph:role: osd.2 2024-04-24T08:24:30.246 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:24:30.246 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T08:24:30.317 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T08:24:30.317 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T08:24:30.318 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T08:24:30.318 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T08:24:30.318 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T08:24:30.318 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-24T08:24:30.318 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T08:24:30.318 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T08:24:30.318 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T08:24:30.318 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T08:24:30.725 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-24T08:24:30.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-24T08:24:30.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-24T08:24:30.840 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-24T08:24:30.856 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T08:24:30.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:24:30.857 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-24T08:24:30.922 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T08:24:30.922 INFO:tasks.ceph:role: osd.3 2024-04-24T08:24:30.922 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:24:30.922 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-24T08:24:30.990 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T08:24:30.990 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T08:24:30.990 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T08:24:30.990 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T08:24:30.990 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T08:24:30.990 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-24T08:24:30.990 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T08:24:30.990 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T08:24:30.990 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T08:24:30.991 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T08:24:31.354 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-24T08:24:31.357 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-24T08:24:31.357 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-24T08:24:31.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-24T08:24:31.487 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T08:24:31.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:24:31.488 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:24:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:31.604+0000 7f02b7f347c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-24T08:24:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:31.604+0000 7f02b7f347c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-24T08:24:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:31.604+0000 7f02b7f347c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T08:24:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:31.604+0000 7f02b7f347c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T08:24:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:31.604+0000 7f02b7f347c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T08:24:31.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:31.608+0000 7f02b7f347c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-24T08:24:34.670 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-24T08:24:34.690 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:24:34.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:34.780+0000 7efc15efb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-24T08:24:34.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:34.780+0000 7efc15efb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-24T08:24:34.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:34.780+0000 7efc15efb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T08:24:34.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:34.780+0000 7efc15efb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T08:24:34.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:34.780+0000 7efc15efb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T08:24:34.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:34.784+0000 7efc15efb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-24T08:24:37.814 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-24T08:24:37.834 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:24:37.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:37.924+0000 7fc3910af7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-24T08:24:37.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:37.924+0000 7fc3910af7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-24T08:24:37.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:37.924+0000 7fc3910af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T08:24:37.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:37.924+0000 7fc3910af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T08:24:37.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:37.924+0000 7fc3910af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T08:24:37.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:37.924+0000 7fc3910af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-24T08:24:40.973 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-24T08:24:40.994 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:24:41.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:41.084+0000 7fdb0e9867c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-24T08:24:41.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:41.084+0000 7fdb0e9867c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-24T08:24:41.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:41.084+0000 7fdb0e9867c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T08:24:41.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:41.084+0000 7fdb0e9867c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T08:24:41.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:41.084+0000 7fdb0e9867c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T08:24:41.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:24:41.084+0000 7fdb0e9867c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-24T08:24:44.153 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-24T08:24:44.174 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-24T08:24:44.196 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T08:24:44.196 INFO:tasks.ceph:role: osd.4 2024-04-24T08:24:44.196 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T08:24:44.196 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T08:24:44.267 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T08:24:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T08:24:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T08:24:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T08:24:44.267 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T08:24:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-24T08:24:44.268 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T08:24:44.268 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T08:24:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T08:24:44.268 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T08:24:44.668 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-24T08:24:44.671 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-24T08:24:44.671 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-24T08:24:44.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-24T08:24:44.778 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T08:24:44.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:24:44.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-24T08:24:44.842 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T08:24:44.843 INFO:tasks.ceph:role: osd.5 2024-04-24T08:24:44.843 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T08:24:44.843 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T08:24:44.914 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T08:24:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T08:24:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T08:24:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T08:24:44.914 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T08:24:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-24T08:24:44.914 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T08:24:44.914 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T08:24:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T08:24:44.914 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T08:24:45.318 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-24T08:24:45.321 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-24T08:24:45.321 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-24T08:24:45.445 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-24T08:24:45.462 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T08:24:45.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:24:45.463 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-24T08:24:45.531 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T08:24:45.531 INFO:tasks.ceph:role: osd.6 2024-04-24T08:24:45.531 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T08:24:45.531 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T08:24:45.602 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T08:24:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T08:24:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T08:24:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T08:24:45.603 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T08:24:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-24T08:24:45.603 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T08:24:45.603 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T08:24:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T08:24:45.603 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T08:24:46.023 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-24T08:24:46.026 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-24T08:24:46.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-24T08:24:46.160 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-24T08:24:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T08:24:46.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:24:46.179 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-24T08:24:46.243 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T08:24:46.243 INFO:tasks.ceph:role: osd.7 2024-04-24T08:24:46.243 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T08:24:46.243 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-24T08:24:46.318 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T08:24:46.318 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T08:24:46.318 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T08:24:46.319 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T08:24:46.319 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T08:24:46.319 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-24T08:24:46.319 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T08:24:46.319 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T08:24:46.319 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T08:24:46.319 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T08:24:46.685 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-24T08:24:46.688 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-24T08:24:46.688 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-24T08:24:46.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-24T08:24:46.839 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T08:24:46.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:24:46.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:24:46.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:46.989+0000 7fd5bb42b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-24T08:24:46.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:46.993+0000 7fd5bb42b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-24T08:24:46.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:46.993+0000 7fd5bb42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T08:24:46.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:46.993+0000 7fd5bb42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T08:24:46.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:46.993+0000 7fd5bb42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T08:24:47.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:46.997+0000 7fd5bb42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-24T08:24:50.061 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-24T08:24:50.082 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:24:50.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:50.169+0000 7fd6fe2547c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-24T08:24:50.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:50.169+0000 7fd6fe2547c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-24T08:24:50.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:50.169+0000 7fd6fe2547c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T08:24:50.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:50.169+0000 7fd6fe2547c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T08:24:50.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:50.169+0000 7fd6fe2547c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T08:24:50.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:50.173+0000 7fd6fe2547c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-24T08:24:53.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-24T08:24:53.226 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:24:53.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:53.317+0000 7fd6a88e27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-24T08:24:53.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:53.321+0000 7fd6a88e27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-24T08:24:53.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:53.321+0000 7fd6a88e27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T08:24:53.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:53.321+0000 7fd6a88e27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T08:24:53.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:53.321+0000 7fd6a88e27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T08:24:53.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:53.321+0000 7fd6a88e27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-24T08:24:56.217 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T08:24:56.221 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T08:24:56.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-24T08:24:56.421 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:24:56.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:56.513+0000 7fc565a6b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-24T08:24:56.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:56.513+0000 7fc565a6b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-24T08:24:56.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:56.513+0000 7fc565a6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T08:24:56.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:56.513+0000 7fc565a6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T08:24:56.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:56.513+0000 7fc565a6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T08:24:56.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:24:56.513+0000 7fc565a6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-24T08:24:59.577 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-24T08:24:59.599 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-24T08:24:59.599 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:59.600 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-24T08:24:59.635 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:59.635 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-24T08:24:59.706 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:59.706 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-24T08:24:59.728 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:59.729 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-24T08:24:59.796 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:59.796 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-24T08:24:59.864 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:24:59.864 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-24T08:24:59.932 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:24:59.932 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-24T08:24:59.953 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:24:59.953 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-24T08:25:00.015 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:25:00.015 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-24T08:25:00.077 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:25:00.078 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-24T08:25:00.137 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:25:00.137 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-24T08:25:00.201 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:25:00.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-24T08:25:00.261 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:25:00.261 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-24T08:25:00.270 INFO:tasks.ceph:Adding keys to all mons... 2024-04-24T08:25:00.270 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T08:25:00.318 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T08:25:00.334 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2024-04-24T08:25:00.334 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC8wShmEOIlJBAAtSMWYz47ddIsN6TSsgqv0g== 2024-04-24T08:25:00.334 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-04-24T08:25:00.334 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC8wShmR3tjLBAAzC/tom6MtpsXzIu4Q8bF4g== 2024-04-24T08:25:00.334 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2024-04-24T08:25:00.334 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC/wShmtiJOJBAAftc6wI18dGzb8g67eHItEw== 2024-04-24T08:25:00.334 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2024-04-24T08:25:00.334 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDCwShmoiy8LhAAVGF40f/k1DKBdtodsRQYeA== 2024-04-24T08:25:00.334 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2024-04-24T08:25:00.334 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDFwShmZq45NxAAiG66924obdbvtga9o774nQ== 2024-04-24T08:25:00.334 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2024-04-24T08:25:00.335 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDJwShmzC40BRAAiRgfksbTIO3nldg4ZvpDYg== 2024-04-24T08:25:00.335 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2024-04-24T08:25:00.335 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC8wShmXIb6JxAA0UBmH5g6fqzx9jHxtbiWEQ== 2024-04-24T08:25:00.335 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2024-04-24T08:25:00.335 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC8wShmaLY0MRAA4C7VwUvS2kfRJG3Zs0uZCg== 2024-04-24T08:25:00.335 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2024-04-24T08:25:00.335 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDOwShmmZBXOxAAS8BTD9awA0JC+PgVSdMjuw== 2024-04-24T08:25:00.335 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2024-04-24T08:25:00.335 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDSwShmCfhmChAAdJ0ts5lzvhtpSItkb2AN7A== 2024-04-24T08:25:00.335 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2024-04-24T08:25:00.335 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDVwShmHYxWExAAfQiCyQc/EUiKastD/W0cfw== 2024-04-24T08:25:00.335 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2024-04-24T08:25:00.336 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDYwShmjujbHhAAD0AUXpz9e2X6BFqmdqreVw== 2024-04-24T08:25:00.336 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2024-04-24T08:25:00.336 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC8wShmTIw5NRAA2gyIbsJGs4xD5Edvy8KmQg== 2024-04-24T08:25:00.336 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2024-04-24T08:25:00.336 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC8wShmEOIlJBAAtSMWYz47ddIsN6TSsgqv0g== 2024-04-24T08:25:00.336 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-04-24T08:25:00.336 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC8wShmR3tjLBAAzC/tom6MtpsXzIu4Q8bF4g== 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC/wShmtiJOJBAAftc6wI18dGzb8g67eHItEw== 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDCwShmoiy8LhAAVGF40f/k1DKBdtodsRQYeA== 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDFwShmZq45NxAAiG66924obdbvtga9o774nQ== 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDJwShmzC40BRAAiRgfksbTIO3nldg4ZvpDYg== 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC8wShmXIb6JxAA0UBmH5g6fqzx9jHxtbiWEQ== 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC8wShmaLY0MRAA4C7VwUvS2kfRJG3Zs0uZCg== 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDOwShmmZBXOxAAS8BTD9awA0JC+PgVSdMjuw== 2024-04-24T08:25:00.337 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2024-04-24T08:25:00.338 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDSwShmCfhmChAAdJ0ts5lzvhtpSItkb2AN7A== 2024-04-24T08:25:00.338 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2024-04-24T08:25:00.338 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDVwShmHYxWExAAfQiCyQc/EUiKastD/W0cfw== 2024-04-24T08:25:00.338 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2024-04-24T08:25:00.338 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDYwShmjujbHhAAD0AUXpz9e2X6BFqmdqreVw== 2024-04-24T08:25:00.338 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-04-24T08:25:00.338 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC8wShmTIw5NRAA2gyIbsJGs4xD5Edvy8KmQg== 2024-04-24T08:25:00.340 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T08:25:00.386 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T08:25:00.440 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T08:25:00.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T08:25:00.499 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.558 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.611 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.614 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.666 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.722 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T08:25:00.725 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T08:25:00.777 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T08:25:00.780 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T08:25:00.835 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.837 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.891 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.946 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:00.949 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:01.001 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:01.004 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T08:25:01.056 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T08:25:01.059 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T08:25:01.115 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-24T08:25:01.115 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-24T08:25:01.134 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T08:25:01.239 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-24T08:25:01.258 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-24T08:25:01.278 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T08:25:01.384 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-24T08:25:01.404 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-24T08:25:01.465 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T08:25:01.574 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-24T08:25:01.593 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:25:01.596 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T08:25:01.647 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-24T08:25:01.647 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-24T08:25:01.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-24T08:25:01.650 INFO:tasks.ceph.mon.a:Started 2024-04-24T08:25:01.650 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-24T08:25:01.650 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-24T08:25:01.693 INFO:tasks.ceph.mon.b:Started 2024-04-24T08:25:01.693 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-24T08:25:01.694 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-24T08:25:01.696 INFO:tasks.ceph.mon.c:Started 2024-04-24T08:25:01.696 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-24T08:25:01.697 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-24T08:25:01.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-24T08:25:01.700 INFO:tasks.ceph.mgr.y:Started 2024-04-24T08:25:01.700 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-24T08:25:01.700 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-24T08:25:01.703 INFO:tasks.ceph.mgr.x:Started 2024-04-24T08:25:01.704 INFO:tasks.ceph:Setting crush tunables to default 2024-04-24T08:25:01.704 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2024-04-24T08:25:01.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.840+0000 7f69d4800640 1 Processor -- start 2024-04-24T08:25:01.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.840+0000 7f69d4800640 1 -- start start 2024-04-24T08:25:01.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.844+0000 7f69d4800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f69cc06cbe0 0x7f69cc0b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:01.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.844+0000 7f69d4800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69cc0bc390 con 0x7f69cc0bbfb0 2024-04-24T08:25:01.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.844+0000 7f69d4800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69cc06e640 con 0x7f69cc142060 2024-04-24T08:25:01.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.844+0000 7f69d4800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f69cc06e920 con 0x7f69cc06cbe0 2024-04-24T08:25:01.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.844+0000 7f69d1e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f69cc0bbfb0 0x7f69cc141950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55646/0 (socket says 172.21.15.88:55646) 2024-04-24T08:25:01.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.844+0000 7f69d1e00640 1 -- 172.21.15.88:0/3777088020 learned_addr learned my addr 172.21.15.88:0/3777088020 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:01.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.844+0000 7f69d1400640 1 --2- 172.21.15.88:0/3777088020 >> v2:172.21.15.142:3300/0 conn(0x7f69cc06cbe0 0x7f69cc0b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:01.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.844+0000 7f69d1400640 1 -- 172.21.15.88:0/3777088020 >> v2:172.21.15.142:3300/0 conn(0x7f69cc06cbe0 msgr2=0x7f69cc0b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-24T08:25:01.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.844+0000 7f69d1400640 1 -- 172.21.15.88:0/3777088020 >> v2:172.21.15.142:3300/0 conn(0x7f69cc06cbe0 msgr2=0x7f69cc0b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T08:25:01.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.844+0000 7f69d1400640 1 --2- 172.21.15.88:0/3777088020 >> v2:172.21.15.142:3300/0 conn(0x7f69cc06cbe0 0x7f69cc0b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T08:25:01.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.844+0000 7f69d1400640 1 --2- 172.21.15.88:0/3777088020 >> v2:172.21.15.142:3300/0 conn(0x7f69cc06cbe0 0x7f69cc0b7210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T08:25:01.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738956885 0 0) 0x7f69cc06e640 con 0x7f69cc142060 2024-04-24T08:25:01.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69b4003530 con 0x7f69cc142060 2024-04-24T08:25:01.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351777163 0 0) 0x7f69cc0bc390 con 0x7f69cc0bbfb0 2024-04-24T08:25:01.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69cc06e640 con 0x7f69cc0bbfb0 2024-04-24T08:25:01.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3977251047 0 0) 0x7f69cc06e640 con 0x7f69cc0bbfb0 2024-04-24T08:25:01.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 >> v2:172.21.15.142:3300/0 conn(0x7f69cc06cbe0 msgr2=0x7f69cc0b7210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 --2- 172.21.15.88:0/3777088020 >> v2:172.21.15.142:3300/0 conn(0x7f69cc06cbe0 0x7f69cc0b7210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 >> v1:172.21.15.142:6789/0 conn(0x7f69cc142060 legacy=0x7f69cc1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc06e2d0 con 0x7f69cc0bbfb0 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f69c0001980 con 0x7f69cc0bbfb0 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 >> v1:172.21.15.88:6789/0 conn(0x7f69cc0bbfb0 legacy=0x7f69cc141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 --2- 172.21.15.88:0/3777088020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b4004bb0 0x7f69b4004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 --2- 172.21.15.88:0/3777088020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b40037b0 0x7f69b4003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 --2- 172.21.15.88:0/3777088020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4004290 0x7f69b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc06e920 con 0x7f69b40037b0 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f69b400c1a0 con 0x7f69b4004290 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f69b400c3a0 con 0x7f69b4004bb0 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d1400640 1 --2- 172.21.15.88:0/3777088020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b40037b0 0x7f69b4003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d2800640 1 --2- 172.21.15.88:0/3777088020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4004290 0x7f69b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d1e00640 1 --2- 172.21.15.88:0/3777088020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b4004bb0 0x7f69b4004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d2800640 1 -- 172.21.15.88:0/3777088020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b4004bb0 msgr2=0x7f69b4004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d2800640 1 --2- 172.21.15.88:0/3777088020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b4004bb0 0x7f69b4004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d2800640 1 -- 172.21.15.88:0/3777088020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b40037b0 msgr2=0x7f69b4003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d2800640 1 --2- 172.21.15.88:0/3777088020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b40037b0 0x7f69b4003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d2800640 1 -- 172.21.15.88:0/3777088020 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc06e640 con 0x7f69b4004290 2024-04-24T08:25:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:01.996+0000 7f69d1400640 1 --2- 172.21.15.88:0/3777088020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b40037b0 0x7f69b4003c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.000+0000 7f69d2800640 1 -- 172.21.15.88:0/3777088020 reap_dead start 2024-04-24T08:25:02.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.000+0000 7f69d2800640 1 --2- 172.21.15.88:0/3777088020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4004290 0x7f69b400b9d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f69c8001900 tx=0x7f69c801c580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b818b1f75a37e212 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.000+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc00f040 con 0x7f69b4004290 2024-04-24T08:25:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.000+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c80052d0 con 0x7f69b4004290 2024-04-24T08:25:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.000+0000 7f69d0a00640 1 -- 172.21.15.88:0/3777088020 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c8001550 con 0x7f69b4004290 2024-04-24T08:25:02.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.000+0000 7f69d4800640 1 -- 172.21.15.88:0/3777088020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4004290 msgr2=0x7f69b400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:02.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.000+0000 7f69d4800640 1 --2- 172.21.15.88:0/3777088020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4004290 0x7f69b400b9d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f69c8001900 tx=0x7f69c801c580 comp rx=0 tx=0).stop 2024-04-24T08:25:02.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.000+0000 7f69d4800640 1 -- 172.21.15.88:0/3777088020 shutdown_connections 2024-04-24T08:25:02.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.000+0000 7f69d4800640 1 --2- 172.21.15.88:0/3777088020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4004290 0x7f69b400b9d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.000+0000 7f69d4800640 1 -- 172.21.15.88:0/3777088020 >> 172.21.15.88:0/3777088020 conn(0x7f69cc067e40 msgr2=0x7f69cc0bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:02.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.000+0000 7f69d4800640 1 -- 172.21.15.88:0/3777088020 shutdown_connections 2024-04-24T08:25:02.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.000+0000 7f69d4800640 1 -- 172.21.15.88:0/3777088020 wait complete. 2024-04-24T08:25:02.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d4800640 1 Processor -- start 2024-04-24T08:25:02.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d4800640 1 -- start start 2024-04-24T08:25:02.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d4800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4004290 0x7f69cc1441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d4800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69cc145060 0x7f69cc1302f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d4800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc130830 0x7f69cc142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d4800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc0b75a0 con 0x7f69cc145060 2024-04-24T08:25:02.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d4800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc0b7420 con 0x7f69b4004290 2024-04-24T08:25:02.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d4800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f69cc141950 con 0x7f69cc130830 2024-04-24T08:25:02.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d1400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69cc145060 0x7f69cc1302f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d1400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69cc145060 0x7f69cc1302f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43680/0 (socket says 172.21.15.88:43680) 2024-04-24T08:25:02.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d1400640 1 -- 172.21.15.88:0/4051209882 learned_addr learned my addr 172.21.15.88:0/4051209882 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:02.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d1e00640 1 --2- 172.21.15.88:0/4051209882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4004290 0x7f69cc1441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d2800640 1 --2- 172.21.15.88:0/4051209882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc130830 0x7f69cc142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d1400640 1 -- 172.21.15.88:0/4051209882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc130830 msgr2=0x7f69cc142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:02.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d1400640 1 --2- 172.21.15.88:0/4051209882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc130830 0x7f69cc142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d1400640 1 -- 172.21.15.88:0/4051209882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4004290 msgr2=0x7f69cc1441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:02.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d1400640 1 --2- 172.21.15.88:0/4051209882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4004290 0x7f69cc1441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d1400640 1 -- 172.21.15.88:0/4051209882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc143460 con 0x7f69cc145060 2024-04-24T08:25:02.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d1400640 1 --2- 172.21.15.88:0/4051209882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69cc145060 0x7f69cc1302f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00e5c0 tx=0x7f69bc00e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:02.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69c6000640 1 -- 172.21.15.88:0/4051209882 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc01b020 con 0x7f69cc145060 2024-04-24T08:25:02.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69c6000640 1 -- 172.21.15.88:0/4051209882 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69bc017810 con 0x7f69cc145060 2024-04-24T08:25:02.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d4800640 1 -- 172.21.15.88:0/4051209882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69cc1437a0 con 0x7f69cc145060 2024-04-24T08:25:02.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69c6000640 1 -- 172.21.15.88:0/4051209882 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc017c00 con 0x7f69cc145060 2024-04-24T08:25:02.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69d4800640 1 -- 172.21.15.88:0/4051209882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69cc140220 con 0x7f69cc145060 2024-04-24T08:25:02.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69c6000640 1 -- 172.21.15.88:0/4051209882 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f69bc01e020 con 0x7f69cc145060 2024-04-24T08:25:02.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.004+0000 7f69c6000640 1 -- 172.21.15.88:0/4051209882 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f69bc01f400 con 0x7f69cc145060 2024-04-24T08:25:02.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.008+0000 7f69d4800640 1 -- 172.21.15.88:0/4051209882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69cc068c00 con 0x7f69cc145060 2024-04-24T08:25:02.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.012+0000 7f69c6000640 1 -- 172.21.15.88:0/4051209882 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f69bc025020 con 0x7f69cc145060 2024-04-24T08:25:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.076+0000 7f69d4800640 1 -- 172.21.15.88:0/4051209882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f69cc069600 con 0x7f69cc145060 2024-04-24T08:25:02.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.076+0000 7f69c6000640 1 -- 172.21.15.88:0/4051209882 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f69bc017e00 con 0x7f69cc145060 2024-04-24T08:25:02.078 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2024-04-24T08:25:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.076+0000 7f69d4800640 1 -- 172.21.15.88:0/4051209882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69cc145060 msgr2=0x7f69cc1302f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.076+0000 7f69d4800640 1 --2- 172.21.15.88:0/4051209882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69cc145060 0x7f69cc1302f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00e5c0 tx=0x7f69bc00e9c0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.076+0000 7f69d4800640 1 -- 172.21.15.88:0/4051209882 shutdown_connections 2024-04-24T08:25:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.076+0000 7f69d4800640 1 --2- 172.21.15.88:0/4051209882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc130830 0x7f69cc142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.076+0000 7f69d4800640 1 --2- 172.21.15.88:0/4051209882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69cc145060 0x7f69cc1302f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.076+0000 7f69d4800640 1 --2- 172.21.15.88:0/4051209882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4004290 0x7f69cc1441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.076+0000 7f69d4800640 1 -- 172.21.15.88:0/4051209882 >> 172.21.15.88:0/4051209882 conn(0x7f69cc067e40 msgr2=0x7f69cc0b87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:02.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.076+0000 7f69d4800640 1 -- 172.21.15.88:0/4051209882 shutdown_connections 2024-04-24T08:25:02.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:02.076+0000 7f69d4800640 1 -- 172.21.15.88:0/4051209882 wait complete. 2024-04-24T08:25:02.097 INFO:tasks.ceph:check_enable_crimson: False 2024-04-24T08:25:02.098 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-24T08:25:02.098 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:25:02.098 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-24T08:25:02.118 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:25:02.118 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-24T08:25:02.183 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:25:02.183 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-24T08:25:02.220 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:02.216+0000 7fbf69328180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T08:25:02.222 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:02.216+0000 7fe426a4c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T08:25:02.239 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:25:02.239 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-24T08:25:02.298 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:25:02.298 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-24T08:25:02.319 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:25:02.319 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-24T08:25:02.383 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:25:02.385 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-24T08:25:02.446 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T08:25:02.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-24T08:25:02.514 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new db6d4591-0b1a-4c26-b77a-42643369737d 0 2024-04-24T08:25:02.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.688+0000 7fb826000640 1 Processor -- start 2024-04-24T08:25:02.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.688+0000 7fb826000640 1 -- start start 2024-04-24T08:25:02.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.688+0000 7fb826000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8200b2b40 0x7fb820142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.688+0000 7fb826000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8200b7be0 0x7fb8201431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.688+0000 7fb826000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8200b4c40 con 0x7fb8200bbfb0 2024-04-24T08:25:02.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.688+0000 7fb826000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb8200bc390 con 0x7fb8200b7be0 2024-04-24T08:25:02.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.688+0000 7fb826000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb8200b6400 con 0x7fb8200b2b40 2024-04-24T08:25:02.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.688+0000 7fb817e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8200b2b40 0x7fb820142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.688+0000 7fb817e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8200b2b40 0x7fb820142cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56720/0 (socket says 172.21.15.142:56720) 2024-04-24T08:25:02.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.688+0000 7fb817e00640 1 -- 172.21.15.142:0/3655147509 learned_addr learned my addr 172.21.15.142:0/3655147509 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T08:25:02.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.688+0000 7fb81fe00640 1 --2- 172.21.15.142:0/3655147509 >> v2:172.21.15.88:3300/0 conn(0x7fb8200b7be0 0x7fb8201431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.692+0000 7fb817e00640 1 -- 172.21.15.142:0/3655147509 >> v2:172.21.15.88:3300/0 conn(0x7fb8200b7be0 msgr2=0x7fb8201431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:02.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.692+0000 7fb817e00640 1 --2- 172.21.15.142:0/3655147509 >> v2:172.21.15.88:3300/0 conn(0x7fb8200b7be0 0x7fb8201431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.692+0000 7fb817e00640 1 -- 172.21.15.142:0/3655147509 >> v1:172.21.15.88:6789/0 conn(0x7fb8200bbfb0 legacy=0x7fb8200b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:02.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.692+0000 7fb817e00640 1 -- 172.21.15.142:0/3655147509 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8200b66e0 con 0x7fb8200b2b40 2024-04-24T08:25:02.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.692+0000 7fb817e00640 1 --2- 172.21.15.142:0/3655147509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8200b2b40 0x7fb820142cb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb820145b90 tx=0x7fb80801c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cca6a5a66ef6cd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:02.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.692+0000 7fb81ea00640 1 -- 172.21.15.142:0/3655147509 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8080b0070 con 0x7fb8200b2b40 2024-04-24T08:25:02.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.692+0000 7fb81ea00640 1 -- 172.21.15.142:0/3655147509 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8080ab600 con 0x7fb8200b2b40 2024-04-24T08:25:02.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.692+0000 7fb81ea00640 1 -- 172.21.15.142:0/3655147509 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8080ab9d0 con 0x7fb8200b2b40 2024-04-24T08:25:02.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.692+0000 7fb826000640 1 -- 172.21.15.142:0/3655147509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8200b2b40 msgr2=0x7fb820142cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.692+0000 7fb826000640 1 --2- 172.21.15.142:0/3655147509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8200b2b40 0x7fb820142cb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb820145b90 tx=0x7fb80801c400 comp rx=0 tx=0).stop 2024-04-24T08:25:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 -- 172.21.15.142:0/3655147509 shutdown_connections 2024-04-24T08:25:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 --2- 172.21.15.142:0/3655147509 >> v2:172.21.15.88:3300/0 conn(0x7fb8200b7be0 0x7fb8201431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 --2- 172.21.15.142:0/3655147509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8200b2b40 0x7fb820142cb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 -- 172.21.15.142:0/3655147509 >> 172.21.15.142:0/3655147509 conn(0x7fb820067e40 msgr2=0x7fb8200bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 -- 172.21.15.142:0/3655147509 shutdown_connections 2024-04-24T08:25:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 -- 172.21.15.142:0/3655147509 wait complete. 2024-04-24T08:25:02.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 Processor -- start 2024-04-24T08:25:02.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 -- start start 2024-04-24T08:25:02.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8200b2b40 0x7fb82006de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8200b7be0 0x7fb8201e0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8200bbfb0 0x7fb8201e05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb820152e60 con 0x7fb8200b2b40 2024-04-24T08:25:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb8200b7550 con 0x7fb8200bbfb0 2024-04-24T08:25:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb820152fe0 con 0x7fb8200b7be0 2024-04-24T08:25:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb81fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8200bbfb0 0x7fb8201e05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb817e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8200b7be0 0x7fb8201e0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb81fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8200bbfb0 0x7fb8201e05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56730/0 (socket says 172.21.15.142:56730) 2024-04-24T08:25:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb81fe00640 1 -- 172.21.15.142:0/2021860477 learned_addr learned my addr 172.21.15.142:0/2021860477 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T08:25:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb81fe00640 1 -- 172.21.15.142:0/2021860477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8200b7be0 msgr2=0x7fb8201e0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb81fe00640 1 --2- 172.21.15.142:0/2021860477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8200b7be0 0x7fb8201e0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb81fe00640 1 -- 172.21.15.142:0/2021860477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8200b2b40 msgr2=0x7fb82006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb81fe00640 1 --2- 172.21.15.142:0/2021860477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8200b2b40 0x7fb82006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb81fe00640 1 -- 172.21.15.142:0/2021860477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82013d0d0 con 0x7fb8200bbfb0 2024-04-24T08:25:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb81fe00640 1 --2- 172.21.15.142:0/2021860477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8200bbfb0 0x7fb8201e05a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb81800efc0 tx=0x7fb81800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:02.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb817400640 1 -- 172.21.15.142:0/2021860477 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818018020 con 0x7fb8200bbfb0 2024-04-24T08:25:02.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb817400640 1 -- 172.21.15.142:0/2021860477 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb818014480 con 0x7fb8200bbfb0 2024-04-24T08:25:02.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 -- 172.21.15.142:0/2021860477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82006e8d0 con 0x7fb8200bbfb0 2024-04-24T08:25:02.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb817400640 1 -- 172.21.15.142:0/2021860477 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818014870 con 0x7fb8200bbfb0 2024-04-24T08:25:02.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.696+0000 7fb826000640 1 -- 172.21.15.142:0/2021860477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82013be90 con 0x7fb8200bbfb0 2024-04-24T08:25:02.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.700+0000 7fb817400640 1 -- 172.21.15.142:0/2021860477 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb81801b020 con 0x7fb8200bbfb0 2024-04-24T08:25:02.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.700+0000 7fb817400640 1 -- 172.21.15.142:0/2021860477 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb8180133e0 con 0x7fb8200bbfb0 2024-04-24T08:25:02.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.700+0000 7fb826000640 1 -- 172.21.15.142:0/2021860477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb820068c00 con 0x7fb8200bbfb0 2024-04-24T08:25:02.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.700+0000 7fb817400640 1 -- 172.21.15.142:0/2021860477 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb818022030 con 0x7fb8200bbfb0 2024-04-24T08:25:02.724 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:02.720+0000 7fe426a4c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T08:25:02.725 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:02.724+0000 7fbf69328180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T08:25:02.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.768+0000 7fb826000640 1 -- 172.21.15.142:0/2021860477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "db6d4591-0b1a-4c26-b77a-42643369737d", "id": 0} v 0) -- 0x7fb82013cdf0 con 0x7fb8200bbfb0 2024-04-24T08:25:02.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.772+0000 7fb817400640 1 -- 172.21.15.142:0/2021860477 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "db6d4591-0b1a-4c26-b77a-42643369737d", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb818010040 con 0x7fb8200bbfb0 2024-04-24T08:25:02.778 INFO:teuthology.orchestra.run.smithi142.stdout:0 2024-04-24T08:25:02.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.772+0000 7fb826000640 1 -- 172.21.15.142:0/2021860477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8200bbfb0 msgr2=0x7fb8201e05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:02.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.772+0000 7fb826000640 1 --2- 172.21.15.142:0/2021860477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8200bbfb0 0x7fb8201e05a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb81800efc0 tx=0x7fb81800c490 comp rx=0 tx=0).stop 2024-04-24T08:25:02.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.772+0000 7fb826000640 1 -- 172.21.15.142:0/2021860477 shutdown_connections 2024-04-24T08:25:02.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.772+0000 7fb826000640 1 --2- 172.21.15.142:0/2021860477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8200bbfb0 0x7fb8201e05a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.772+0000 7fb826000640 1 --2- 172.21.15.142:0/2021860477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8200b7be0 0x7fb8201e0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.776+0000 7fb826000640 1 --2- 172.21.15.142:0/2021860477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8200b2b40 0x7fb82006de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.776+0000 7fb826000640 1 -- 172.21.15.142:0/2021860477 >> 172.21.15.142:0/2021860477 conn(0x7fb820067e40 msgr2=0x7fb82013a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:02.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.776+0000 7fb826000640 1 -- 172.21.15.142:0/2021860477 shutdown_connections 2024-04-24T08:25:02.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.776+0000 7fb826000640 1 -- 172.21.15.142:0/2021860477 wait complete. 2024-04-24T08:25:02.797 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 54e7e964-31f5-4735-8a1a-43b825b4e5ce 1 2024-04-24T08:25:02.930 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:02.928+0000 7fbf69328180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T08:25:02.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f5346600640 1 Processor -- start 2024-04-24T08:25:02.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f5346600640 1 -- start start 2024-04-24T08:25:02.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f5346600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400bbfb0 0x7f53400b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f5346600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53400b2b40 0x7f5340142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f5346600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f53400b7be0 0x7f53401431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f5346600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f53400bc390 con 0x7f53400b7be0 2024-04-24T08:25:02.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f5346600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f53400b6400 con 0x7f53400b2b40 2024-04-24T08:25:02.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f5346600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f53400b66e0 con 0x7f53400bbfb0 2024-04-24T08:25:02.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f5337e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53400b2b40 0x7f5340142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f5337e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53400b2b40 0x7f5340142cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56742/0 (socket says 172.21.15.142:56742) 2024-04-24T08:25:02.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f533f400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400bbfb0 0x7f53400b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f5337e00640 1 -- 172.21.15.142:0/603925637 learned_addr learned my addr 172.21.15.142:0/603925637 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T08:25:02.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f533fe00640 1 --2- 172.21.15.142:0/603925637 >> v2:172.21.15.88:3300/0 conn(0x7f53400b7be0 0x7f53401431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f533f400640 1 -- 172.21.15.142:0/603925637 >> v2:172.21.15.142:3300/0 conn(0x7f53400b2b40 msgr2=0x7f5340142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:02.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f533f400640 1 --2- 172.21.15.142:0/603925637 >> v2:172.21.15.142:3300/0 conn(0x7f53400b2b40 0x7f5340142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f533f400640 1 -- 172.21.15.142:0/603925637 >> v2:172.21.15.88:3300/0 conn(0x7f53400b7be0 msgr2=0x7f53401431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:02.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f533f400640 1 --2- 172.21.15.142:0/603925637 >> v2:172.21.15.88:3300/0 conn(0x7f53400b7be0 0x7f53401431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f533f400640 1 -- 172.21.15.142:0/603925637 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53400b5070 con 0x7f53400bbfb0 2024-04-24T08:25:02.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.928+0000 7f5337e00640 1 --2- 172.21.15.142:0/603925637 >> v2:172.21.15.142:3300/0 conn(0x7f53400b2b40 0x7f5340142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:02.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f533f400640 1 --2- 172.21.15.142:0/603925637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400bbfb0 0x7f53400b4530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f53400bc6c0 tx=0x7f533001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59a2813491189937 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:02.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f533ea00640 1 -- 172.21.15.142:0/603925637 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53300b0070 con 0x7f53400bbfb0 2024-04-24T08:25:02.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f533ea00640 1 -- 172.21.15.142:0/603925637 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53300ab600 con 0x7f53400bbfb0 2024-04-24T08:25:02.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f533ea00640 1 -- 172.21.15.142:0/603925637 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53300ab9d0 con 0x7f53400bbfb0 2024-04-24T08:25:02.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f5346600640 1 -- 172.21.15.142:0/603925637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400bbfb0 msgr2=0x7f53400b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:02.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f5346600640 1 --2- 172.21.15.142:0/603925637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400bbfb0 0x7f53400b4530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f53400bc6c0 tx=0x7f533001c360 comp rx=0 tx=0).stop 2024-04-24T08:25:02.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f5346600640 1 -- 172.21.15.142:0/603925637 shutdown_connections 2024-04-24T08:25:02.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f5346600640 1 --2- 172.21.15.142:0/603925637 >> v2:172.21.15.88:3300/0 conn(0x7f53400b7be0 0x7f53401431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f5346600640 1 --2- 172.21.15.142:0/603925637 >> v2:172.21.15.142:3300/0 conn(0x7f53400b2b40 0x7f5340142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f5346600640 1 --2- 172.21.15.142:0/603925637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400bbfb0 0x7f53400b4530 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f5346600640 1 -- 172.21.15.142:0/603925637 >> 172.21.15.142:0/603925637 conn(0x7f5340067e40 msgr2=0x7f53400bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:02.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f5346600640 1 -- 172.21.15.142:0/603925637 shutdown_connections 2024-04-24T08:25:02.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.932+0000 7f5346600640 1 -- 172.21.15.142:0/603925637 wait complete. 2024-04-24T08:25:02.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f5346600640 1 Processor -- start 2024-04-24T08:25:02.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f5346600640 1 -- start start 2024-04-24T08:25:02.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f5346600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400b2b40 0x7f53401e0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f5346600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53400b7be0 0x7f5340140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f5346600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53400bbfb0 0x7f53401e4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f5346600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5340073230 con 0x7f53400b7be0 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f5346600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f53400730b0 con 0x7f53400bbfb0 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f5346600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f53400733b0 con 0x7f53400b2b40 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f533f400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400b2b40 0x7f53401e0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f533f400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400b2b40 0x7f53401e0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:34792/0 (socket says 172.21.15.142:34792) 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f533f400640 1 -- 172.21.15.142:0/3797037146 learned_addr learned my addr 172.21.15.142:0/3797037146 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f533fe00640 1 --2- 172.21.15.142:0/3797037146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53400bbfb0 0x7f53401e4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.936+0000 7f5337e00640 1 --2- 172.21.15.142:0/3797037146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53400b7be0 0x7f5340140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f533f400640 1 -- 172.21.15.142:0/3797037146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53400bbfb0 msgr2=0x7f53401e4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f533f400640 1 --2- 172.21.15.142:0/3797037146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53400bbfb0 0x7f53401e4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f533f400640 1 -- 172.21.15.142:0/3797037146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53400b7be0 msgr2=0x7f5340140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f533f400640 1 --2- 172.21.15.142:0/3797037146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53400b7be0 0x7f5340140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f533f400640 1 -- 172.21.15.142:0/3797037146 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53401e39d0 con 0x7f53400b2b40 2024-04-24T08:25:02.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f533f400640 1 --2- 172.21.15.142:0/3797037146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400b2b40 0x7f53401e0460 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f533001cc00 tx=0x7f5330019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:02.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f5337400640 1 -- 172.21.15.142:0/3797037146 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53300ba020 con 0x7f53400b2b40 2024-04-24T08:25:02.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f5337400640 1 -- 172.21.15.142:0/3797037146 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53300b5460 con 0x7f53400b2b40 2024-04-24T08:25:02.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f5337400640 1 -- 172.21.15.142:0/3797037146 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53300b0040 con 0x7f53400b2b40 2024-04-24T08:25:02.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f5346600640 1 -- 172.21.15.142:0/3797037146 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534013cbd0 con 0x7f53400b2b40 2024-04-24T08:25:02.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f5346600640 1 -- 172.21.15.142:0/3797037146 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f53401e3f50 con 0x7f53400b2b40 2024-04-24T08:25:02.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f5337400640 1 -- 172.21.15.142:0/3797037146 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f53300bd020 con 0x7f53400b2b40 2024-04-24T08:25:02.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f5337400640 1 -- 172.21.15.142:0/3797037146 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f53300b6940 con 0x7f53400b2b40 2024-04-24T08:25:02.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.940+0000 7f5346600640 1 -- 172.21.15.142:0/3797037146 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5340068c00 con 0x7f53400b2b40 2024-04-24T08:25:02.946 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:02.940+0000 7fe426a4c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T08:25:02.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:02.952+0000 7f5337400640 1 -- 172.21.15.142:0/3797037146 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f53300c4030 con 0x7f53400b2b40 2024-04-24T08:25:03.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.020+0000 7f5346600640 1 -- 172.21.15.142:0/3797037146 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "54e7e964-31f5-4735-8a1a-43b825b4e5ce", "id": 1} v 0) -- 0x7f53401e4120 con 0x7f53400b2b40 2024-04-24T08:25:03.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.028+0000 7f5337400640 1 -- 172.21.15.142:0/3797037146 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "54e7e964-31f5-4735-8a1a-43b825b4e5ce", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f5330016070 con 0x7f53400b2b40 2024-04-24T08:25:03.032 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-04-24T08:25:03.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.028+0000 7f5346600640 1 -- 172.21.15.142:0/3797037146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400b2b40 msgr2=0x7f53401e0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.028+0000 7f5346600640 1 --2- 172.21.15.142:0/3797037146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400b2b40 0x7f53401e0460 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f533001cc00 tx=0x7f5330019100 comp rx=0 tx=0).stop 2024-04-24T08:25:03.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.028+0000 7f5346600640 1 -- 172.21.15.142:0/3797037146 shutdown_connections 2024-04-24T08:25:03.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.028+0000 7f5346600640 1 --2- 172.21.15.142:0/3797037146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53400bbfb0 0x7f53401e4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.028+0000 7f5346600640 1 --2- 172.21.15.142:0/3797037146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53400b7be0 0x7f5340140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.028+0000 7f5346600640 1 --2- 172.21.15.142:0/3797037146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53400b2b40 0x7f53401e0460 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.028+0000 7f5346600640 1 -- 172.21.15.142:0/3797037146 >> 172.21.15.142:0/3797037146 conn(0x7f5340067e40 msgr2=0x7f534013b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:03.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.028+0000 7f5346600640 1 -- 172.21.15.142:0/3797037146 shutdown_connections 2024-04-24T08:25:03.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.028+0000 7f5346600640 1 -- 172.21.15.142:0/3797037146 wait complete. 2024-04-24T08:25:03.052 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 37ba8bc8-a48e-46ea-b04d-463febc6c70b 2 2024-04-24T08:25:03.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.180+0000 7f8f31600640 1 Processor -- start 2024-04-24T08:25:03.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.180+0000 7f8f31600640 1 -- start start 2024-04-24T08:25:03.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.180+0000 7f8f31600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8f2c0bbfb0 0x7f8f2c0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.180+0000 7f8f31600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f2c0b2b40 0x7f8f2c142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.180+0000 7f8f31600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f2c0bc390 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.180+0000 7f8f31600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8f2c0b6400 con 0x7f8f2c0bbfb0 2024-04-24T08:25:03.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.180+0000 7f8f31600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2c0b66e0 con 0x7f8f2c0b2b40 2024-04-24T08:25:03.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.180+0000 7f8f22000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f2c0b2b40 0x7f8f2c142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.180+0000 7f8f2aa00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8f2c0bbfb0 0x7f8f2c0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.180+0000 7f8f2b400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8f2c0b7be0 0x7f8f2c072690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56440/0 (socket says 172.21.15.142:56440) 2024-04-24T08:25:03.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.180+0000 7f8f2b400640 1 -- 172.21.15.142:0/2285126487 learned_addr learned my addr 172.21.15.142:0/2285126487 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T08:25:03.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.184+0000 7f8f22000640 1 -- 172.21.15.142:0/2285126487 >> v2:172.21.15.142:3300/0 conn(0x7f8f2c0bbfb0 msgr2=0x7f8f2c0b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:03.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.184+0000 7f8f22000640 1 --2- 172.21.15.142:0/2285126487 >> v2:172.21.15.142:3300/0 conn(0x7f8f2c0bbfb0 0x7f8f2c0b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.184+0000 7f8f22000640 1 -- 172.21.15.142:0/2285126487 >> v1:172.21.15.142:6789/0 conn(0x7f8f2c0b7be0 legacy=0x7f8f2c072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.184+0000 7f8f22000640 1 -- 172.21.15.142:0/2285126487 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c0b5070 con 0x7f8f2c0b2b40 2024-04-24T08:25:03.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.184+0000 7f8f22000640 1 --2- 172.21.15.142:0/2285126487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f2c0b2b40 0x7f8f2c142cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f140097c0 tx=0x7f8f1401c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9220a432f177f12d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:03.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.184+0000 7f8f2a000640 1 -- 172.21.15.142:0/2285126487 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140b0070 con 0x7f8f2c0b2b40 2024-04-24T08:25:03.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.184+0000 7f8f2a000640 1 -- 172.21.15.142:0/2285126487 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f140ab600 con 0x7f8f2c0b2b40 2024-04-24T08:25:03.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.184+0000 7f8f2a000640 1 -- 172.21.15.142:0/2285126487 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140ab9d0 con 0x7f8f2c0b2b40 2024-04-24T08:25:03.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 -- 172.21.15.142:0/2285126487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f2c0b2b40 msgr2=0x7f8f2c142cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 --2- 172.21.15.142:0/2285126487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f2c0b2b40 0x7f8f2c142cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f140097c0 tx=0x7f8f1401c380 comp rx=0 tx=0).stop 2024-04-24T08:25:03.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 -- 172.21.15.142:0/2285126487 shutdown_connections 2024-04-24T08:25:03.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 --2- 172.21.15.142:0/2285126487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f2c0b2b40 0x7f8f2c142cb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 --2- 172.21.15.142:0/2285126487 >> v2:172.21.15.142:3300/0 conn(0x7f8f2c0bbfb0 0x7f8f2c0b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 -- 172.21.15.142:0/2285126487 >> 172.21.15.142:0/2285126487 conn(0x7f8f2c067e40 msgr2=0x7f8f2c0bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:03.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 -- 172.21.15.142:0/2285126487 shutdown_connections 2024-04-24T08:25:03.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 -- 172.21.15.142:0/2285126487 wait complete. 2024-04-24T08:25:03.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 Processor -- start 2024-04-24T08:25:03.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 -- start start 2024-04-24T08:25:03.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c0b2b40 0x7f8f2c144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c0b7be0 0x7f8f2c1de6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f2c0bbfb0 0x7f8f2c135690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c0b7550 con 0x7f8f2c0b2b40 2024-04-24T08:25:03.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c143600 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f31600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2c153660 con 0x7f8f2c0bbfb0 2024-04-24T08:25:03.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f22000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c0b7be0 0x7f8f2c1de6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f2b400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f2c0bbfb0 0x7f8f2c135690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f22000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c0b7be0 0x7f8f2c1de6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56780/0 (socket says 172.21.15.142:56780) 2024-04-24T08:25:03.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f22000640 1 -- 172.21.15.142:0/4101664115 learned_addr learned my addr 172.21.15.142:0/4101664115 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T08:25:03.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f2aa00640 1 --2- 172.21.15.142:0/4101664115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c0b2b40 0x7f8f2c144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f22000640 1 -- 172.21.15.142:0/4101664115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f2c0bbfb0 msgr2=0x7f8f2c135690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f22000640 1 --2- 172.21.15.142:0/4101664115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f2c0bbfb0 0x7f8f2c135690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f22000640 1 -- 172.21.15.142:0/4101664115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c0b2b40 msgr2=0x7f8f2c144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f22000640 1 --2- 172.21.15.142:0/4101664115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c0b2b40 0x7f8f2c144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f22000640 1 -- 172.21.15.142:0/4101664115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c13f010 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f2b400640 1 --2- 172.21.15.142:0/4101664115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f2c0bbfb0 0x7f8f2c135690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:03.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f2aa00640 1 --2- 172.21.15.142:0/4101664115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c0b2b40 0x7f8f2c144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:03.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f22000640 1 --2- 172.21.15.142:0/4101664115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c0b7be0 0x7f8f2c1de6e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8f14019fb0 tx=0x7f8f14019120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:03.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.188+0000 7f8f23400640 1 -- 172.21.15.142:0/4101664115 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140b0040 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.192+0000 7f8f23400640 1 -- 172.21.15.142:0/4101664115 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f140b43f0 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.192+0000 7f8f23400640 1 -- 172.21.15.142:0/4101664115 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140b47c0 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.192+0000 7f8f31600640 1 -- 172.21.15.142:0/4101664115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2c13f280 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.192+0000 7f8f31600640 1 -- 172.21.15.142:0/4101664115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2c145800 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.192+0000 7f8f23400640 1 -- 172.21.15.142:0/4101664115 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f140b4960 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.192+0000 7f8f23400640 1 -- 172.21.15.142:0/4101664115 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f8f140bd400 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.192+0000 7f8f31600640 1 -- 172.21.15.142:0/4101664115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f2c068c00 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.192+0000 7f8f23400640 1 -- 172.21.15.142:0/4101664115 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8f14016090 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.260+0000 7f8f31600640 1 -- 172.21.15.142:0/4101664115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "37ba8bc8-a48e-46ea-b04d-463febc6c70b", "id": 2} v 0) -- 0x7f8f2c1423d0 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.264+0000 7f8f23400640 1 -- 172.21.15.142:0/4101664115 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37ba8bc8-a48e-46ea-b04d-463febc6c70b", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f8f140b4c50 con 0x7f8f2c0b7be0 2024-04-24T08:25:03.271 INFO:teuthology.orchestra.run.smithi142.stdout:2 2024-04-24T08:25:03.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.268+0000 7f8f31600640 1 -- 172.21.15.142:0/4101664115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c0b7be0 msgr2=0x7f8f2c1de6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.268+0000 7f8f31600640 1 --2- 172.21.15.142:0/4101664115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c0b7be0 0x7f8f2c1de6e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8f14019fb0 tx=0x7f8f14019120 comp rx=0 tx=0).stop 2024-04-24T08:25:03.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.268+0000 7f8f31600640 1 -- 172.21.15.142:0/4101664115 shutdown_connections 2024-04-24T08:25:03.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.268+0000 7f8f31600640 1 --2- 172.21.15.142:0/4101664115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f2c0bbfb0 0x7f8f2c135690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.268+0000 7f8f31600640 1 --2- 172.21.15.142:0/4101664115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c0b7be0 0x7f8f2c1de6e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.268+0000 7f8f31600640 1 --2- 172.21.15.142:0/4101664115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c0b2b40 0x7f8f2c144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.268+0000 7f8f31600640 1 -- 172.21.15.142:0/4101664115 >> 172.21.15.142:0/4101664115 conn(0x7f8f2c067e40 msgr2=0x7f8f2c0b87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:03.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.268+0000 7f8f31600640 1 -- 172.21.15.142:0/4101664115 shutdown_connections 2024-04-24T08:25:03.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.268+0000 7f8f31600640 1 -- 172.21.15.142:0/4101664115 wait complete. 2024-04-24T08:25:03.290 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new c624bd7f-f552-4943-a1a1-1fbe045affc2 3 2024-04-24T08:25:03.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764e000640 1 Processor -- start 2024-04-24T08:25:03.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764e000640 1 -- start start 2024-04-24T08:25:03.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764e000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7648067810 0x7f7648145780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764e000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7648067bf0 0x7f76480731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764e000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7648072d40 con 0x7f76480b3940 2024-04-24T08:25:03.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764e000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f764806eed0 con 0x7f7648067bf0 2024-04-24T08:25:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764e000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f764813fee0 con 0x7f7648067810 2024-04-24T08:25:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764cc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7648067810 0x7f7648145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764cc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7648067810 0x7f7648145780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56784/0 (socket says 172.21.15.142:56784) 2024-04-24T08:25:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764cc00640 1 -- 172.21.15.142:0/446014854 learned_addr learned my addr 172.21.15.142:0/446014854 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T08:25:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f7647e00640 1 --2- 172.21.15.142:0/446014854 >> v2:172.21.15.88:3300/0 conn(0x7f7648067bf0 0x7f76480731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764cc00640 1 -- 172.21.15.142:0/446014854 >> v2:172.21.15.88:3300/0 conn(0x7f7648067bf0 msgr2=0x7f76480731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764cc00640 1 --2- 172.21.15.142:0/446014854 >> v2:172.21.15.88:3300/0 conn(0x7f7648067bf0 0x7f76480731f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764cc00640 1 -- 172.21.15.142:0/446014854 >> v1:172.21.15.142:6789/0 conn(0x7f76480b3940 legacy=0x7f7648148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f764cc00640 1 -- 172.21.15.142:0/446014854 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76480b20e0 con 0x7f7648067810 2024-04-24T08:25:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f7647400640 1 -- 172.21.15.142:0/446014854 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255549063 0 0) 0x7f7648072d40 con 0x7f76480b3940 2024-04-24T08:25:03.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.420+0000 7f7647e00640 1 --2- 172.21.15.142:0/446014854 >> v2:172.21.15.88:3300/0 conn(0x7f7648067bf0 0x7f76480731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:03.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.424+0000 7f764cc00640 1 --2- 172.21.15.142:0/446014854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7648067810 0x7f7648145780 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f76480baac0 tx=0x7f763c01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=726c001d5748dea4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:03.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.424+0000 7f7647400640 1 -- 172.21.15.142:0/446014854 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c0b1070 con 0x7f7648067810 2024-04-24T08:25:03.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.424+0000 7f7647400640 1 -- 172.21.15.142:0/446014854 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c0ac600 con 0x7f7648067810 2024-04-24T08:25:03.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.424+0000 7f7647400640 1 -- 172.21.15.142:0/446014854 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c0ac9d0 con 0x7f7648067810 2024-04-24T08:25:03.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.424+0000 7f764e000640 1 -- 172.21.15.142:0/446014854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7648067810 msgr2=0x7f7648145780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.424+0000 7f764e000640 1 --2- 172.21.15.142:0/446014854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7648067810 0x7f7648145780 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f76480baac0 tx=0x7f763c01c490 comp rx=0 tx=0).stop 2024-04-24T08:25:03.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.424+0000 7f764e000640 1 -- 172.21.15.142:0/446014854 shutdown_connections 2024-04-24T08:25:03.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.424+0000 7f764e000640 1 --2- 172.21.15.142:0/446014854 >> v2:172.21.15.88:3300/0 conn(0x7f7648067bf0 0x7f76480731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.424+0000 7f764e000640 1 --2- 172.21.15.142:0/446014854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7648067810 0x7f7648145780 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.424+0000 7f764e000640 1 -- 172.21.15.142:0/446014854 >> 172.21.15.142:0/446014854 conn(0x7f76480ba0e0 msgr2=0x7f76480b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.424+0000 7f764e000640 1 -- 172.21.15.142:0/446014854 shutdown_connections 2024-04-24T08:25:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764e000640 1 -- 172.21.15.142:0/446014854 wait complete. 2024-04-24T08:25:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764e000640 1 Processor -- start 2024-04-24T08:25:03.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764e000640 1 -- start start 2024-04-24T08:25:03.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764e000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7648067810 0x7f76481e0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764e000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7648067bf0 0x7f7648072540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76480b3940 0x7f76481487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764e000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f76480b5d40 con 0x7f7648067810 2024-04-24T08:25:03.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764e000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f76480b5bc0 con 0x7f7648067bf0 2024-04-24T08:25:03.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764e000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7648153120 con 0x7f76480b3940 2024-04-24T08:25:03.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764d600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76480b3940 0x7f76481487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f7647e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7648067bf0 0x7f7648072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764d600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76480b3940 0x7f76481487c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:34828/0 (socket says 172.21.15.142:34828) 2024-04-24T08:25:03.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764d600640 1 -- 172.21.15.142:0/1990306694 learned_addr learned my addr 172.21.15.142:0/1990306694 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T08:25:03.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764cc00640 1 --2- 172.21.15.142:0/1990306694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7648067810 0x7f76481e0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764d600640 1 -- 172.21.15.142:0/1990306694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7648067bf0 msgr2=0x7f7648072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764d600640 1 --2- 172.21.15.142:0/1990306694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7648067bf0 0x7f7648072540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764d600640 1 -- 172.21.15.142:0/1990306694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7648067810 msgr2=0x7f76481e0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764d600640 1 --2- 172.21.15.142:0/1990306694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7648067810 0x7f76481e0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764d600640 1 -- 172.21.15.142:0/1990306694 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7648147b10 con 0x7f76480b3940 2024-04-24T08:25:03.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764d600640 1 --2- 172.21.15.142:0/1990306694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76480b3940 0x7f76481487c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f764000c780 tx=0x7f764000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:03.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f7644c00640 1 -- 172.21.15.142:0/1990306694 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7640003db0 con 0x7f76480b3940 2024-04-24T08:25:03.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f7644c00640 1 -- 172.21.15.142:0/1990306694 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764000ce30 con 0x7f76480b3940 2024-04-24T08:25:03.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f7644c00640 1 -- 172.21.15.142:0/1990306694 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7640005290 con 0x7f76480b3940 2024-04-24T08:25:03.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764e000640 1 -- 172.21.15.142:0/1990306694 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7648147d80 con 0x7f76480b3940 2024-04-24T08:25:03.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.428+0000 7f764e000640 1 -- 172.21.15.142:0/1990306694 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f764813a7d0 con 0x7f76480b3940 2024-04-24T08:25:03.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.432+0000 7f7644c00640 1 -- 172.21.15.142:0/1990306694 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7640005430 con 0x7f76480b3940 2024-04-24T08:25:03.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.432+0000 7f7644c00640 1 -- 172.21.15.142:0/1990306694 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f764001ba40 con 0x7f76480b3940 2024-04-24T08:25:03.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.432+0000 7f764e000640 1 -- 172.21.15.142:0/1990306694 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7648069230 con 0x7f76480b3940 2024-04-24T08:25:03.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.432+0000 7f7644c00640 1 -- 172.21.15.142:0/1990306694 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f764001b570 con 0x7f76480b3940 2024-04-24T08:25:03.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.500+0000 7f764e000640 1 -- 172.21.15.142:0/1990306694 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c624bd7f-f552-4943-a1a1-1fbe045affc2", "id": 3} v 0) -- 0x7f7648144350 con 0x7f76480b3940 2024-04-24T08:25:03.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.504+0000 7f7644c00640 1 -- 172.21.15.142:0/1990306694 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c624bd7f-f552-4943-a1a1-1fbe045affc2", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f764000a640 con 0x7f76480b3940 2024-04-24T08:25:03.510 INFO:teuthology.orchestra.run.smithi142.stdout:3 2024-04-24T08:25:03.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.508+0000 7f764e000640 1 -- 172.21.15.142:0/1990306694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76480b3940 msgr2=0x7f76481487c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.508+0000 7f764e000640 1 --2- 172.21.15.142:0/1990306694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76480b3940 0x7f76481487c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f764000c780 tx=0x7f764000cc40 comp rx=0 tx=0).stop 2024-04-24T08:25:03.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.508+0000 7f764e000640 1 -- 172.21.15.142:0/1990306694 shutdown_connections 2024-04-24T08:25:03.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.508+0000 7f764e000640 1 --2- 172.21.15.142:0/1990306694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76480b3940 0x7f76481487c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.508+0000 7f764e000640 1 --2- 172.21.15.142:0/1990306694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7648067bf0 0x7f7648072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.508+0000 7f764e000640 1 --2- 172.21.15.142:0/1990306694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7648067810 0x7f76481e0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.508+0000 7f764e000640 1 -- 172.21.15.142:0/1990306694 >> 172.21.15.142:0/1990306694 conn(0x7f76480ba0e0 msgr2=0x7f764806dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:03.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.508+0000 7f764e000640 1 -- 172.21.15.142:0/1990306694 shutdown_connections 2024-04-24T08:25:03.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.508+0000 7f764e000640 1 -- 172.21.15.142:0/1990306694 wait complete. 2024-04-24T08:25:03.530 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 4327e008-bbcf-4477-a5ba-a1694a21b0a8 4 2024-04-24T08:25:03.545 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:03.543+0000 7fbf69328180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T08:25:03.583 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:03.576+0000 7fe426a4c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T08:25:03.606 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:03.603+0000 7fbf69328180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T08:25:03.647 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:03.640+0000 7fe426a4c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T08:25:03.667 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:03.663+0000 7fbf69328180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T08:25:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.664+0000 7f888a800640 1 Processor -- start 2024-04-24T08:25:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.664+0000 7f888a800640 1 -- start start 2024-04-24T08:25:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f888a800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88840bbfb0 0x7f88840b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f888a800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8884142060 0x7f88841525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f888a800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88840bc390 con 0x7f888406cbe0 2024-04-24T08:25:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f888a800640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f888406e640 con 0x7f88840bbfb0 2024-04-24T08:25:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f888a800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f888406e920 con 0x7f8884142060 2024-04-24T08:25:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f8883e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8884142060 0x7f88841525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f8882a00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f888406cbe0 0x7f8884141950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56460/0 (socket says 172.21.15.142:56460) 2024-04-24T08:25:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f8882a00640 1 -- 172.21.15.142:0/2973072353 learned_addr learned my addr 172.21.15.142:0/2973072353 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T08:25:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f8883400640 1 --2- 172.21.15.142:0/2973072353 >> v2:172.21.15.88:3300/0 conn(0x7f88840bbfb0 0x7f88840b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f8883e00640 1 -- 172.21.15.142:0/2973072353 >> v2:172.21.15.88:3300/0 conn(0x7f88840bbfb0 msgr2=0x7f88840b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f8883e00640 1 --2- 172.21.15.142:0/2973072353 >> v2:172.21.15.88:3300/0 conn(0x7f88840bbfb0 0x7f88840b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f8883e00640 1 -- 172.21.15.142:0/2973072353 >> v1:172.21.15.142:6789/0 conn(0x7f888406cbe0 legacy=0x7f8884141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f8883e00640 1 -- 172.21.15.142:0/2973072353 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888406e2d0 con 0x7f8884142060 2024-04-24T08:25:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f8882000640 1 -- 172.21.15.142:0/2973072353 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156136883 0 0) 0x7f88840bc390 con 0x7f888406cbe0 2024-04-24T08:25:03.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.668+0000 7f8883e00640 1 --2- 172.21.15.142:0/2973072353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8884142060 0x7f88841525e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f888406d530 tx=0x7f887c01c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f0d45d28491ebf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:03.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f8882000640 1 -- 172.21.15.142:0/2973072353 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c0b2070 con 0x7f8884142060 2024-04-24T08:25:03.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f8882000640 1 -- 172.21.15.142:0/2973072353 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887c0a5760 con 0x7f8884142060 2024-04-24T08:25:03.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f8882000640 1 -- 172.21.15.142:0/2973072353 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c0a5b30 con 0x7f8884142060 2024-04-24T08:25:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 -- 172.21.15.142:0/2973072353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8884142060 msgr2=0x7f88841525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 --2- 172.21.15.142:0/2973072353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8884142060 0x7f88841525e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f888406d530 tx=0x7f887c01c8a0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 -- 172.21.15.142:0/2973072353 shutdown_connections 2024-04-24T08:25:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 --2- 172.21.15.142:0/2973072353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8884142060 0x7f88841525e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 --2- 172.21.15.142:0/2973072353 >> v2:172.21.15.88:3300/0 conn(0x7f88840bbfb0 0x7f88840b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 -- 172.21.15.142:0/2973072353 >> 172.21.15.142:0/2973072353 conn(0x7f8884067e40 msgr2=0x7f88840bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:03.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 -- 172.21.15.142:0/2973072353 shutdown_connections 2024-04-24T08:25:03.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 -- 172.21.15.142:0/2973072353 wait complete. 2024-04-24T08:25:03.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 Processor -- start 2024-04-24T08:25:03.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 -- start start 2024-04-24T08:25:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f888406cbe0 0x7f8884149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840bbfb0 0x7f88841e42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8884142060 0x7f88841e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f88841556d0 con 0x7f8884142060 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8884155550 con 0x7f88840bbfb0 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f888a800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8884155850 con 0x7f888406cbe0 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f8883400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f888406cbe0 0x7f8884149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f8882a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840bbfb0 0x7f88841e42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f8883400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f888406cbe0 0x7f8884149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:34834/0 (socket says 172.21.15.142:34834) 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f8883400640 1 -- 172.21.15.142:0/3525432298 learned_addr learned my addr 172.21.15.142:0/3525432298 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.672+0000 7f8883e00640 1 --2- 172.21.15.142:0/3525432298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8884142060 0x7f88841e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f8882a00640 1 -- 172.21.15.142:0/3525432298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f888406cbe0 msgr2=0x7f8884149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f8882a00640 1 --2- 172.21.15.142:0/3525432298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f888406cbe0 0x7f8884149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f8882a00640 1 -- 172.21.15.142:0/3525432298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8884142060 msgr2=0x7f88841e47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f8882a00640 1 --2- 172.21.15.142:0/3525432298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8884142060 0x7f88841e47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f8882a00640 1 -- 172.21.15.142:0/3525432298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888414d7f0 con 0x7f88840bbfb0 2024-04-24T08:25:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f8883400640 1 --2- 172.21.15.142:0/3525432298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f888406cbe0 0x7f8884149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f8882a00640 1 --2- 172.21.15.142:0/3525432298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840bbfb0 0x7f88841e42b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f887000c430 tx=0x7f887000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f887b400640 1 -- 172.21.15.142:0/3525432298 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700074e0 con 0x7f88840bbfb0 2024-04-24T08:25:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f887b400640 1 -- 172.21.15.142:0/3525432298 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88700047f0 con 0x7f88840bbfb0 2024-04-24T08:25:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f887b400640 1 -- 172.21.15.142:0/3525432298 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870004be0 con 0x7f88840bbfb0 2024-04-24T08:25:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f888a800640 1 -- 172.21.15.142:0/3525432298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f888414c2c0 con 0x7f88840bbfb0 2024-04-24T08:25:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f888a800640 1 -- 172.21.15.142:0/3525432298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f888414d510 con 0x7f88840bbfb0 2024-04-24T08:25:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f887b400640 1 -- 172.21.15.142:0/3525432298 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8870011070 con 0x7f88840bbfb0 2024-04-24T08:25:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f887b400640 1 -- 172.21.15.142:0/3525432298 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8870004d80 con 0x7f88840bbfb0 2024-04-24T08:25:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.676+0000 7f888a800640 1 -- 172.21.15.142:0/3525432298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8884068c00 con 0x7f88840bbfb0 2024-04-24T08:25:03.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.680+0000 7f887b400640 1 -- 172.21.15.142:0/3525432298 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f887001d3f0 con 0x7f88840bbfb0 2024-04-24T08:25:03.711 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:03.708+0000 7fe426a4c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T08:25:03.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.744+0000 7f888a800640 1 -- 172.21.15.142:0/3525432298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4327e008-bbcf-4477-a5ba-a1694a21b0a8", "id": 4} v 0) -- 0x7f888414c7e0 con 0x7f88840bbfb0 2024-04-24T08:25:03.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.752+0000 7f887b400640 1 -- 172.21.15.142:0/3525432298 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4327e008-bbcf-4477-a5ba-a1694a21b0a8", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f887001d6a0 con 0x7f88840bbfb0 2024-04-24T08:25:03.755 INFO:teuthology.orchestra.run.smithi142.stdout:4 2024-04-24T08:25:03.756 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:03.751+0000 7fbf69328180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T08:25:03.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.752+0000 7f888a800640 1 -- 172.21.15.142:0/3525432298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840bbfb0 msgr2=0x7f88841e42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.752+0000 7f888a800640 1 --2- 172.21.15.142:0/3525432298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840bbfb0 0x7f88841e42b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f887000c430 tx=0x7f887000c8f0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.752+0000 7f888a800640 1 -- 172.21.15.142:0/3525432298 shutdown_connections 2024-04-24T08:25:03.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.752+0000 7f888a800640 1 --2- 172.21.15.142:0/3525432298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8884142060 0x7f88841e47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.752+0000 7f888a800640 1 --2- 172.21.15.142:0/3525432298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840bbfb0 0x7f88841e42b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.752+0000 7f888a800640 1 --2- 172.21.15.142:0/3525432298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f888406cbe0 0x7f8884149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.752+0000 7f888a800640 1 -- 172.21.15.142:0/3525432298 >> 172.21.15.142:0/3525432298 conn(0x7f8884067e40 msgr2=0x7f8884140da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:03.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.752+0000 7f888a800640 1 -- 172.21.15.142:0/3525432298 shutdown_connections 2024-04-24T08:25:03.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.752+0000 7f888a800640 1 -- 172.21.15.142:0/3525432298 wait complete. 2024-04-24T08:25:03.775 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc 5 2024-04-24T08:25:03.803 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:03.800+0000 7fe426a4c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T08:25:03.816 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:03.815+0000 7fbf69328180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T08:25:03.865 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:03.860+0000 7fe426a4c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T08:25:03.903 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:03.899+0000 7fbf69328180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T08:25:03.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.904+0000 7f2282600640 1 Processor -- start 2024-04-24T08:25:03.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.904+0000 7f2282600640 1 -- start start 2024-04-24T08:25:03.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.904+0000 7f2282600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0bbfb0 0x7f227c0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.904+0000 7f2282600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f227c1433c0 0x7f227c150430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.904+0000 7f2282600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227c0bc390 con 0x7f227c0b2b40 2024-04-24T08:25:03.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.904+0000 7f2282600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f227c0b6400 con 0x7f227c1433c0 2024-04-24T08:25:03.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.904+0000 7f2282600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f227c0b66e0 con 0x7f227c0bbfb0 2024-04-24T08:25:03.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.904+0000 7f227b400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0bbfb0 0x7f227c0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.904+0000 7f227be00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f227c1433c0 0x7f227c150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.908+0000 7f227be00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f227c1433c0 0x7f227c150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56834/0 (socket says 172.21.15.142:56834) 2024-04-24T08:25:03.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.908+0000 7f227be00640 1 -- 172.21.15.142:0/4016043849 learned_addr learned my addr 172.21.15.142:0/4016043849 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T08:25:03.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.908+0000 7f227b400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0bbfb0 0x7f227c0b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:34850/0 (socket says 172.21.15.142:34850) 2024-04-24T08:25:03.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.908+0000 7f227be00640 1 -- 172.21.15.142:0/4016043849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0bbfb0 msgr2=0x7f227c0b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:03.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.908+0000 7f227be00640 1 --2- 172.21.15.142:0/4016043849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0bbfb0 0x7f227c0b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.908+0000 7f227be00640 1 -- 172.21.15.142:0/4016043849 >> v1:172.21.15.88:6789/0 conn(0x7f227c0b2b40 legacy=0x7f227c142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.908+0000 7f227be00640 1 -- 172.21.15.142:0/4016043849 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227c0b5070 con 0x7f227c1433c0 2024-04-24T08:25:03.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.908+0000 7f227be00640 1 --2- 172.21.15.142:0/4016043849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c1433c0 0x7f227c150430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2274009e50 tx=0x7f227401c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e46f65a8093c1704 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:03.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.908+0000 7f227aa00640 1 -- 172.21.15.142:0/4016043849 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22740a55d0 con 0x7f227c1433c0 2024-04-24T08:25:03.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.908+0000 7f227aa00640 1 -- 172.21.15.142:0/4016043849 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22740a5770 con 0x7f227c1433c0 2024-04-24T08:25:03.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.908+0000 7f227aa00640 1 -- 172.21.15.142:0/4016043849 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22740a5b40 con 0x7f227c1433c0 2024-04-24T08:25:03.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 -- 172.21.15.142:0/4016043849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c1433c0 msgr2=0x7f227c150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 --2- 172.21.15.142:0/4016043849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c1433c0 0x7f227c150430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2274009e50 tx=0x7f227401c910 comp rx=0 tx=0).stop 2024-04-24T08:25:03.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 -- 172.21.15.142:0/4016043849 shutdown_connections 2024-04-24T08:25:03.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 --2- 172.21.15.142:0/4016043849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c1433c0 0x7f227c150430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 --2- 172.21.15.142:0/4016043849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0bbfb0 0x7f227c0b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 -- 172.21.15.142:0/4016043849 >> 172.21.15.142:0/4016043849 conn(0x7f227c067e40 msgr2=0x7f227c0bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:03.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 -- 172.21.15.142:0/4016043849 shutdown_connections 2024-04-24T08:25:03.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 -- 172.21.15.142:0/4016043849 wait complete. 2024-04-24T08:25:03.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 Processor -- start 2024-04-24T08:25:03.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 -- start start 2024-04-24T08:25:03.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0b2b40 0x7f227c134c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f227c0bbfb0 0x7f227c135180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c1433c0 0x7f227c1e3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f227c0b7550 con 0x7f227c0bbfb0 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1533a0 con 0x7f227c1433c0 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2282600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f227c153520 con 0x7f227c0b2b40 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f227b400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0b2b40 0x7f227c134c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f227be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c1433c0 0x7f227c1e3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f227b400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0b2b40 0x7f227c134c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:34864/0 (socket says 172.21.15.142:34864) 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f227b400640 1 -- 172.21.15.142:0/2590317131 learned_addr learned my addr 172.21.15.142:0/2590317131 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f2273e00640 1 --2- 172.21.15.142:0/2590317131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f227c0bbfb0 0x7f227c135180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f227b400640 1 -- 172.21.15.142:0/2590317131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c1433c0 msgr2=0x7f227c1e3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f227b400640 1 --2- 172.21.15.142:0/2590317131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c1433c0 0x7f227c1e3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f227b400640 1 -- 172.21.15.142:0/2590317131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f227c0bbfb0 msgr2=0x7f227c135180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f227b400640 1 --2- 172.21.15.142:0/2590317131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f227c0bbfb0 0x7f227c135180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f227b400640 1 -- 172.21.15.142:0/2590317131 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227c06eb80 con 0x7f227c0b2b40 2024-04-24T08:25:03.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f227be00640 1 --2- 172.21.15.142:0/2590317131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c1433c0 0x7f227c1e3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:03.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.912+0000 7f227b400640 1 --2- 172.21.15.142:0/2590317131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0b2b40 0x7f227c134c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f226c00e960 tx=0x7f226c00ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:03.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.916+0000 7f2273400640 1 -- 172.21.15.142:0/2590317131 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c017070 con 0x7f227c0b2b40 2024-04-24T08:25:03.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.916+0000 7f2273400640 1 -- 172.21.15.142:0/2590317131 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c00ca00 con 0x7f227c0b2b40 2024-04-24T08:25:03.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.916+0000 7f2273400640 1 -- 172.21.15.142:0/2590317131 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c00cdb0 con 0x7f227c0b2b40 2024-04-24T08:25:03.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.916+0000 7f2282600640 1 -- 172.21.15.142:0/2590317131 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227c06e6a0 con 0x7f227c0b2b40 2024-04-24T08:25:03.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.916+0000 7f2282600640 1 -- 172.21.15.142:0/2590317131 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f227c06e0e0 con 0x7f227c0b2b40 2024-04-24T08:25:03.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.916+0000 7f2273400640 1 -- 172.21.15.142:0/2590317131 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f226c01a070 con 0x7f227c0b2b40 2024-04-24T08:25:03.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.916+0000 7f2273400640 1 -- 172.21.15.142:0/2590317131 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f226c006020 con 0x7f227c0b2b40 2024-04-24T08:25:03.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.916+0000 7f2282600640 1 -- 172.21.15.142:0/2590317131 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f227c068c00 con 0x7f227c0b2b40 2024-04-24T08:25:03.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.916+0000 7f2273400640 1 -- 172.21.15.142:0/2590317131 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f226c006610 con 0x7f227c0b2b40 2024-04-24T08:25:03.959 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:03.952+0000 7fe426a4c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T08:25:03.966 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:03.963+0000 7fbf69328180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T08:25:03.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.984+0000 7f2282600640 1 -- 172.21.15.142:0/2590317131 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc", "id": 5} v 0) -- 0x7f227c144980 con 0x7f227c0b2b40 2024-04-24T08:25:03.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.996+0000 7f2273400640 1 -- 172.21.15.142:0/2590317131 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f226c0067f0 con 0x7f227c0b2b40 2024-04-24T08:25:03.998 INFO:teuthology.orchestra.run.smithi142.stdout:5 2024-04-24T08:25:03.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.996+0000 7f2282600640 1 -- 172.21.15.142:0/2590317131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0b2b40 msgr2=0x7f227c134c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:03.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.996+0000 7f2282600640 1 --2- 172.21.15.142:0/2590317131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0b2b40 0x7f227c134c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f226c00e960 tx=0x7f226c00ee20 comp rx=0 tx=0).stop 2024-04-24T08:25:03.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.996+0000 7f2282600640 1 -- 172.21.15.142:0/2590317131 shutdown_connections 2024-04-24T08:25:03.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.996+0000 7f2282600640 1 --2- 172.21.15.142:0/2590317131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c1433c0 0x7f227c1e3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.996+0000 7f2282600640 1 --2- 172.21.15.142:0/2590317131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f227c0bbfb0 0x7f227c135180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.996+0000 7f2282600640 1 --2- 172.21.15.142:0/2590317131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c0b2b40 0x7f227c134c40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:03.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.996+0000 7f2282600640 1 -- 172.21.15.142:0/2590317131 >> 172.21.15.142:0/2590317131 conn(0x7f227c067e40 msgr2=0x7f227c13f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:03.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.996+0000 7f2282600640 1 -- 172.21.15.142:0/2590317131 shutdown_connections 2024-04-24T08:25:04.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:03.996+0000 7f2282600640 1 -- 172.21.15.142:0/2590317131 wait complete. 2024-04-24T08:25:04.017 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 4b650749-a5d1-4411-8db9-c5d23627085a 6 2024-04-24T08:25:04.026 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:04.024+0000 7fe426a4c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T08:25:04.132 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:04.131+0000 7fbf69328180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T08:25:04.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f919d200640 1 Processor -- start 2024-04-24T08:25:04.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f919d200640 1 -- start start 2024-04-24T08:25:04.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f919d200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f919806cbe0 0x7f91980b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f919d200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9198142060 0x7f91981525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f919d200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91980bc390 con 0x7f91980bbfb0 2024-04-24T08:25:04.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f919d200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f919806e640 con 0x7f919806cbe0 2024-04-24T08:25:04.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f919d200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f919806e920 con 0x7f9198142060 2024-04-24T08:25:04.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f9196800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9198142060 0x7f91981525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f9195e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f91980bbfb0 0x7f9198141950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56472/0 (socket says 172.21.15.142:56472) 2024-04-24T08:25:04.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f9196800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9198142060 0x7f91981525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56842/0 (socket says 172.21.15.142:56842) 2024-04-24T08:25:04.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f9195e00640 1 -- 172.21.15.142:0/541370980 learned_addr learned my addr 172.21.15.142:0/541370980 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T08:25:04.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f918fe00640 1 --2- 172.21.15.142:0/541370980 >> v2:172.21.15.88:3300/0 conn(0x7f919806cbe0 0x7f91980b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f9196800640 1 -- 172.21.15.142:0/541370980 >> v2:172.21.15.88:3300/0 conn(0x7f919806cbe0 msgr2=0x7f91980b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:04.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f9196800640 1 --2- 172.21.15.142:0/541370980 >> v2:172.21.15.88:3300/0 conn(0x7f919806cbe0 0x7f91980b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f9196800640 1 -- 172.21.15.142:0/541370980 >> v1:172.21.15.142:6789/0 conn(0x7f91980bbfb0 legacy=0x7f9198141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f9196800640 1 -- 172.21.15.142:0/541370980 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919806e2d0 con 0x7f9198142060 2024-04-24T08:25:04.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.160+0000 7f918fe00640 1 --2- 172.21.15.142:0/541370980 >> v2:172.21.15.88:3300/0 conn(0x7f919806cbe0 0x7f91980b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:04.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.164+0000 7f9196800640 1 --2- 172.21.15.142:0/541370980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9198142060 0x7f91981525e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f919806d530 tx=0x7f919001c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fe658afb7f92c41 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:04.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.164+0000 7f9195400640 1 -- 172.21.15.142:0/541370980 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91900b2070 con 0x7f9198142060 2024-04-24T08:25:04.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.164+0000 7f9195400640 1 -- 172.21.15.142:0/541370980 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91900a5760 con 0x7f9198142060 2024-04-24T08:25:04.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.164+0000 7f9195400640 1 -- 172.21.15.142:0/541370980 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91900a5b30 con 0x7f9198142060 2024-04-24T08:25:04.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.164+0000 7f919d200640 1 -- 172.21.15.142:0/541370980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9198142060 msgr2=0x7f91981525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.164+0000 7f919d200640 1 --2- 172.21.15.142:0/541370980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9198142060 0x7f91981525e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f919806d530 tx=0x7f919001c8a0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.164+0000 7f919d200640 1 -- 172.21.15.142:0/541370980 shutdown_connections 2024-04-24T08:25:04.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.164+0000 7f919d200640 1 --2- 172.21.15.142:0/541370980 >> v2:172.21.15.88:3300/0 conn(0x7f919806cbe0 0x7f91980b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.164+0000 7f919d200640 1 --2- 172.21.15.142:0/541370980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9198142060 0x7f91981525e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.164+0000 7f919d200640 1 -- 172.21.15.142:0/541370980 >> 172.21.15.142:0/541370980 conn(0x7f9198067e40 msgr2=0x7f91980bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:04.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.164+0000 7f919d200640 1 -- 172.21.15.142:0/541370980 shutdown_connections 2024-04-24T08:25:04.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.164+0000 7f919d200640 1 -- 172.21.15.142:0/541370980 wait complete. 2024-04-24T08:25:04.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f919d200640 1 Processor -- start 2024-04-24T08:25:04.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f919d200640 1 -- start start 2024-04-24T08:25:04.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f919d200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919806cbe0 0x7f919813fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f919d200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91980bbfb0 0x7f91981e0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f919d200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9198142060 0x7f91981e1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f919d200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f91981556d0 con 0x7f9198142060 2024-04-24T08:25:04.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f919d200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9198155550 con 0x7f91980bbfb0 2024-04-24T08:25:04.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f919d200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9198155850 con 0x7f919806cbe0 2024-04-24T08:25:04.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f9195e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919806cbe0 0x7f919813fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f918fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91980bbfb0 0x7f91981e0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f9195e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919806cbe0 0x7f919813fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:34866/0 (socket says 172.21.15.142:34866) 2024-04-24T08:25:04.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f9195e00640 1 -- 172.21.15.142:0/30785402 learned_addr learned my addr 172.21.15.142:0/30785402 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T08:25:04.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f9196800640 1 --2- 172.21.15.142:0/30785402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9198142060 0x7f91981e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f918fe00640 1 -- 172.21.15.142:0/30785402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919806cbe0 msgr2=0x7f919813fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f918fe00640 1 --2- 172.21.15.142:0/30785402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919806cbe0 0x7f919813fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f918fe00640 1 -- 172.21.15.142:0/30785402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9198142060 msgr2=0x7f91981e1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f918fe00640 1 --2- 172.21.15.142:0/30785402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9198142060 0x7f91981e1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f918fe00640 1 -- 172.21.15.142:0/30785402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919814d1f0 con 0x7f91980bbfb0 2024-04-24T08:25:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f918fe00640 1 --2- 172.21.15.142:0/30785402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91980bbfb0 0x7f91981e0ec0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f918000e600 tx=0x7f918000eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f918e000640 1 -- 172.21.15.142:0/30785402 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180017070 con 0x7f91980bbfb0 2024-04-24T08:25:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f918e000640 1 -- 172.21.15.142:0/30785402 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918000c620 con 0x7f91980bbfb0 2024-04-24T08:25:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f919d200640 1 -- 172.21.15.142:0/30785402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91981e09c0 con 0x7f91980bbfb0 2024-04-24T08:25:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f918e000640 1 -- 172.21.15.142:0/30785402 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918000f040 con 0x7f91980bbfb0 2024-04-24T08:25:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f919d200640 1 -- 172.21.15.142:0/30785402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f919814c230 con 0x7f91980bbfb0 2024-04-24T08:25:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f918e000640 1 -- 172.21.15.142:0/30785402 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f918001a070 con 0x7f91980bbfb0 2024-04-24T08:25:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f918e000640 1 -- 172.21.15.142:0/30785402 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f918001cb80 con 0x7f91980bbfb0 2024-04-24T08:25:04.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.168+0000 7f919d200640 1 -- 172.21.15.142:0/30785402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9198068c00 con 0x7f91980bbfb0 2024-04-24T08:25:04.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.172+0000 7f918e000640 1 -- 172.21.15.142:0/30785402 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f918001ce20 con 0x7f91980bbfb0 2024-04-24T08:25:04.198 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:04.196+0000 7fe426a4c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T08:25:04.203 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:04.199+0000 7fbf69328180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T08:25:04.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.240+0000 7f919d200640 1 -- 172.21.15.142:0/30785402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4b650749-a5d1-4411-8db9-c5d23627085a", "id": 6} v 0) -- 0x7f9198145680 con 0x7f91980bbfb0 2024-04-24T08:25:04.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.244+0000 7f918e000640 1 -- 172.21.15.142:0/30785402 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4b650749-a5d1-4411-8db9-c5d23627085a", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f918001c520 con 0x7f91980bbfb0 2024-04-24T08:25:04.245 INFO:teuthology.orchestra.run.smithi142.stdout:6 2024-04-24T08:25:04.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.244+0000 7f919d200640 1 -- 172.21.15.142:0/30785402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91980bbfb0 msgr2=0x7f91981e0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.244+0000 7f919d200640 1 --2- 172.21.15.142:0/30785402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91980bbfb0 0x7f91981e0ec0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f918000e600 tx=0x7f918000eac0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.244+0000 7f919d200640 1 -- 172.21.15.142:0/30785402 shutdown_connections 2024-04-24T08:25:04.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.244+0000 7f919d200640 1 --2- 172.21.15.142:0/30785402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9198142060 0x7f91981e1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.244+0000 7f919d200640 1 --2- 172.21.15.142:0/30785402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91980bbfb0 0x7f91981e0ec0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.244+0000 7f919d200640 1 --2- 172.21.15.142:0/30785402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919806cbe0 0x7f919813fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.244+0000 7f919d200640 1 -- 172.21.15.142:0/30785402 >> 172.21.15.142:0/30785402 conn(0x7f9198067e40 msgr2=0x7f9198147cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:04.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.244+0000 7f919d200640 1 -- 172.21.15.142:0/30785402 shutdown_connections 2024-04-24T08:25:04.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.244+0000 7f919d200640 1 -- 172.21.15.142:0/30785402 wait complete. 2024-04-24T08:25:04.265 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new a4af5c37-6417-42b3-9b96-a3be33d77d9c 7 2024-04-24T08:25:04.273 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:04.272+0000 7fe426a4c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T08:25:04.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa99e00640 1 Processor -- start 2024-04-24T08:25:04.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa99e00640 1 -- start start 2024-04-24T08:25:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa99e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa940b2b40 0x7ffa94142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa99e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffa940b7be0 0x7ffa941431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa99e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa940b4c40 con 0x7ffa940bbfb0 2024-04-24T08:25:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa99e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ffa940bc390 con 0x7ffa940b7be0 2024-04-24T08:25:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa99e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ffa940b6400 con 0x7ffa940b2b40 2024-04-24T08:25:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa92a00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ffa940bbfb0 0x7ffa940b4530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56484/0 (socket says 172.21.15.142:56484) 2024-04-24T08:25:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa92a00640 1 -- 172.21.15.142:0/524066055 learned_addr learned my addr 172.21.15.142:0/524066055 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T08:25:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa8be00640 1 --2- 172.21.15.142:0/524066055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa940b2b40 0x7ffa94142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa93400640 1 --2- 172.21.15.142:0/524066055 >> v2:172.21.15.142:3300/0 conn(0x7ffa940b7be0 0x7ffa941431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa93400640 1 -- 172.21.15.142:0/524066055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa940b2b40 msgr2=0x7ffa94142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa93400640 1 --2- 172.21.15.142:0/524066055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa940b2b40 0x7ffa94142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa93400640 1 -- 172.21.15.142:0/524066055 >> v1:172.21.15.142:6789/0 conn(0x7ffa940bbfb0 legacy=0x7ffa940b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa93400640 1 -- 172.21.15.142:0/524066055 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa940b66e0 con 0x7ffa940b7be0 2024-04-24T08:25:04.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.400+0000 7ffa92000640 1 -- 172.21.15.142:0/524066055 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1572268971 0 0) 0x7ffa940b4c40 con 0x7ffa940bbfb0 2024-04-24T08:25:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.404+0000 7ffa93400640 1 --2- 172.21.15.142:0/524066055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa940b7be0 0x7ffa941431f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c009d90 tx=0x7ffa8c01c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=903d165e741d3250 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.404+0000 7ffa92000640 1 -- 172.21.15.142:0/524066055 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0b2070 con 0x7ffa940b7be0 2024-04-24T08:25:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.404+0000 7ffa92000640 1 -- 172.21.15.142:0/524066055 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa8c0a5710 con 0x7ffa940b7be0 2024-04-24T08:25:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.404+0000 7ffa92000640 1 -- 172.21.15.142:0/524066055 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0a5ae0 con 0x7ffa940b7be0 2024-04-24T08:25:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.404+0000 7ffa99e00640 1 -- 172.21.15.142:0/524066055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa940b7be0 msgr2=0x7ffa941431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.404+0000 7ffa99e00640 1 --2- 172.21.15.142:0/524066055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa940b7be0 0x7ffa941431f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c009d90 tx=0x7ffa8c01c850 comp rx=0 tx=0).stop 2024-04-24T08:25:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.404+0000 7ffa99e00640 1 -- 172.21.15.142:0/524066055 shutdown_connections 2024-04-24T08:25:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.404+0000 7ffa99e00640 1 --2- 172.21.15.142:0/524066055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa940b2b40 0x7ffa94142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.404+0000 7ffa99e00640 1 --2- 172.21.15.142:0/524066055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa940b7be0 0x7ffa941431f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.404+0000 7ffa99e00640 1 -- 172.21.15.142:0/524066055 >> 172.21.15.142:0/524066055 conn(0x7ffa94067e40 msgr2=0x7ffa940bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:04.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.404+0000 7ffa99e00640 1 -- 172.21.15.142:0/524066055 shutdown_connections 2024-04-24T08:25:04.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.404+0000 7ffa99e00640 1 -- 172.21.15.142:0/524066055 wait complete. 2024-04-24T08:25:04.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa99e00640 1 Processor -- start 2024-04-24T08:25:04.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa99e00640 1 -- start start 2024-04-24T08:25:04.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa99e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa940b2b40 0x7ffa9413a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa99e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940b7be0 0x7ffa9413e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa99e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa940bbfb0 0x7ffa941e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa99e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffa94152e60 con 0x7ffa940b7be0 2024-04-24T08:25:04.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa99e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ffa940b7550 con 0x7ffa940b2b40 2024-04-24T08:25:04.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa99e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ffa94152fe0 con 0x7ffa940bbfb0 2024-04-24T08:25:04.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa93400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa940bbfb0 0x7ffa941e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa92a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa940b2b40 0x7ffa9413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa93400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa940bbfb0 0x7ffa941e16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:34888/0 (socket says 172.21.15.142:34888) 2024-04-24T08:25:04.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa93400640 1 -- 172.21.15.142:0/2463680241 learned_addr learned my addr 172.21.15.142:0/2463680241 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T08:25:04.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa93400640 1 -- 172.21.15.142:0/2463680241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa940b2b40 msgr2=0x7ffa9413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa93400640 1 --2- 172.21.15.142:0/2463680241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa940b2b40 0x7ffa9413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa93400640 1 -- 172.21.15.142:0/2463680241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940b7be0 msgr2=0x7ffa9413e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa8be00640 1 --2- 172.21.15.142:0/2463680241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940b7be0 0x7ffa9413e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa93400640 1 --2- 172.21.15.142:0/2463680241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940b7be0 0x7ffa9413e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa93400640 1 -- 172.21.15.142:0/2463680241 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa94138750 con 0x7ffa940bbfb0 2024-04-24T08:25:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa8be00640 1 --2- 172.21.15.142:0/2463680241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940b7be0 0x7ffa9413e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa93400640 1 --2- 172.21.15.142:0/2463680241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa940bbfb0 0x7ffa941e16b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c0b0040 tx=0x7ffa8c0195f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa8b400640 1 -- 172.21.15.142:0/2463680241 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0b2050 con 0x7ffa940bbfb0 2024-04-24T08:25:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa8b400640 1 -- 172.21.15.142:0/2463680241 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa8c0be070 con 0x7ffa940bbfb0 2024-04-24T08:25:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa8b400640 1 -- 172.21.15.142:0/2463680241 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0ad850 con 0x7ffa940bbfb0 2024-04-24T08:25:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa99e00640 1 -- 172.21.15.142:0/2463680241 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa940aa070 con 0x7ffa940bbfb0 2024-04-24T08:25:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa99e00640 1 -- 172.21.15.142:0/2463680241 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa9413dd90 con 0x7ffa940bbfb0 2024-04-24T08:25:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa8b400640 1 -- 172.21.15.142:0/2463680241 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffa8c0ad9f0 con 0x7ffa940bbfb0 2024-04-24T08:25:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa8b400640 1 -- 172.21.15.142:0/2463680241 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ffa8c0b9ab0 con 0x7ffa940bbfb0 2024-04-24T08:25:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.408+0000 7ffa99e00640 1 -- 172.21.15.142:0/2463680241 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa94068c00 con 0x7ffa940bbfb0 2024-04-24T08:25:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.412+0000 7ffa8b400640 1 -- 172.21.15.142:0/2463680241 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ffa94138750 con 0x7ffa940bbfb0 2024-04-24T08:25:04.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.476+0000 7ffa99e00640 1 -- 172.21.15.142:0/2463680241 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a4af5c37-6417-42b3-9b96-a3be33d77d9c", "id": 7} v 0) -- 0x7ffa9413df60 con 0x7ffa940bbfb0 2024-04-24T08:25:04.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.484+0000 7ffa8b400640 1 -- 172.21.15.142:0/2463680241 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a4af5c37-6417-42b3-9b96-a3be33d77d9c", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ffa8c016560 con 0x7ffa940bbfb0 2024-04-24T08:25:04.486 INFO:teuthology.orchestra.run.smithi142.stdout:7 2024-04-24T08:25:04.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.484+0000 7ffa99e00640 1 -- 172.21.15.142:0/2463680241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa940bbfb0 msgr2=0x7ffa941e16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.484+0000 7ffa99e00640 1 --2- 172.21.15.142:0/2463680241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa940bbfb0 0x7ffa941e16b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c0b0040 tx=0x7ffa8c0195f0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.484+0000 7ffa99e00640 1 -- 172.21.15.142:0/2463680241 shutdown_connections 2024-04-24T08:25:04.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.484+0000 7ffa99e00640 1 --2- 172.21.15.142:0/2463680241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa940bbfb0 0x7ffa941e16b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.484+0000 7ffa99e00640 1 --2- 172.21.15.142:0/2463680241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa940b7be0 0x7ffa9413e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.484+0000 7ffa99e00640 1 --2- 172.21.15.142:0/2463680241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa940b2b40 0x7ffa9413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.484+0000 7ffa99e00640 1 -- 172.21.15.142:0/2463680241 >> 172.21.15.142:0/2463680241 conn(0x7ffa94067e40 msgr2=0x7ffa9413c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:04.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.484+0000 7ffa99e00640 1 -- 172.21.15.142:0/2463680241 shutdown_connections 2024-04-24T08:25:04.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T08:25:04.488+0000 7ffa99e00640 1 -- 172.21.15.142:0/2463680241 wait complete. 2024-04-24T08:25:04.506 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-24T08:25:04.506 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-24T08:25:04.510 INFO:tasks.ceph.osd.0:Started 2024-04-24T08:25:04.510 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-24T08:25:04.510 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-24T08:25:04.524 INFO:tasks.ceph.osd.1:Started 2024-04-24T08:25:04.524 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-24T08:25:04.524 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-24T08:25:04.528 INFO:tasks.ceph.osd.2:Started 2024-04-24T08:25:04.528 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-24T08:25:04.529 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-24T08:25:04.538 INFO:tasks.ceph.osd.3:Started 2024-04-24T08:25:04.539 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-24T08:25:04.539 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-24T08:25:04.549 INFO:tasks.ceph.osd.4:Started 2024-04-24T08:25:04.549 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-24T08:25:04.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-24T08:25:04.552 INFO:tasks.ceph.osd.5:Started 2024-04-24T08:25:04.553 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-24T08:25:04.553 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-24T08:25:04.556 INFO:tasks.ceph.osd.6:Started 2024-04-24T08:25:04.556 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-24T08:25:04.556 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-24T08:25:04.562 INFO:tasks.ceph.osd.7:Started 2024-04-24T08:25:04.562 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:04.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faed9e00640 1 Processor -- start 2024-04-24T08:25:04.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faed9e00640 1 -- start start 2024-04-24T08:25:04.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faed9e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faed40b6260 0x7faed4148260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faed9e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faed41487a0 0x7faed41419a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faed9e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed40b6640 0x7faed40b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faed9e00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7faed4148cb0 con 0x7faed41487a0 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faed9e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7faed40b4f90 con 0x7faed40b6260 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faed9e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faed40b7850 con 0x7faed40b6640 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faecbe00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faed41487a0 0x7faed41419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faecbe00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faed41487a0 0x7faed41419a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43732/0 (socket says 172.21.15.88:43732) 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faecbe00640 1 -- 172.21.15.88:0/2552436810 learned_addr learned my addr 172.21.15.88:0/2552436810 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faed2a00640 1 --2- 172.21.15.88:0/2552436810 >> v2:172.21.15.142:3300/0 conn(0x7faed40b6260 0x7faed4148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faed3400640 1 --2- 172.21.15.88:0/2552436810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed40b6640 0x7faed40b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faecbe00640 1 -- 172.21.15.88:0/2552436810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed40b6640 msgr2=0x7faed40b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faecbe00640 1 --2- 172.21.15.88:0/2552436810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed40b6640 0x7faed40b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faecbe00640 1 -- 172.21.15.88:0/2552436810 >> v2:172.21.15.142:3300/0 conn(0x7faed40b6260 msgr2=0x7faed4148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faecbe00640 1 --2- 172.21.15.88:0/2552436810 >> v2:172.21.15.142:3300/0 conn(0x7faed40b6260 0x7faed4148260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.731+0000 7faecbe00640 1 -- 172.21.15.88:0/2552436810 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed40b4c20 con 0x7faed41487a0 2024-04-24T08:25:04.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faecbe00640 1 --2- 172.21.15.88:0/2552436810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed41487a0 0x7faed41419a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faed40bb070 tx=0x7faebc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a822157a0adb639 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:04.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faed2000640 1 -- 172.21.15.88:0/2552436810 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc0b1070 con 0x7faed41487a0 2024-04-24T08:25:04.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faed2000640 1 -- 172.21.15.88:0/2552436810 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faebc0ac600 con 0x7faed41487a0 2024-04-24T08:25:04.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faed2000640 1 -- 172.21.15.88:0/2552436810 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc0ac9d0 con 0x7faed41487a0 2024-04-24T08:25:04.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faed9e00640 1 -- 172.21.15.88:0/2552436810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed41487a0 msgr2=0x7faed41419a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faed9e00640 1 --2- 172.21.15.88:0/2552436810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed41487a0 0x7faed41419a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faed40bb070 tx=0x7faebc01c400 comp rx=0 tx=0).stop 2024-04-24T08:25:04.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faed9e00640 1 -- 172.21.15.88:0/2552436810 shutdown_connections 2024-04-24T08:25:04.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faed9e00640 1 --2- 172.21.15.88:0/2552436810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed40b6640 0x7faed40b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faed9e00640 1 --2- 172.21.15.88:0/2552436810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed41487a0 0x7faed41419a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faed9e00640 1 --2- 172.21.15.88:0/2552436810 >> v2:172.21.15.142:3300/0 conn(0x7faed40b6260 0x7faed4148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faed9e00640 1 -- 172.21.15.88:0/2552436810 >> 172.21.15.88:0/2552436810 conn(0x7faed40bd5c0 msgr2=0x7faed40bd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faed9e00640 1 -- 172.21.15.88:0/2552436810 shutdown_connections 2024-04-24T08:25:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.735+0000 7faed9e00640 1 -- 172.21.15.88:0/2552436810 wait complete. 2024-04-24T08:25:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed9e00640 1 Processor -- start 2024-04-24T08:25:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed9e00640 1 -- start start 2024-04-24T08:25:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed9e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed40b6260 0x7faed414ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed9e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed40b6640 0x7faed41e4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed9e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faed41487a0 0x7faed41e4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed9e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faed414bea0 con 0x7faed40b6260 2024-04-24T08:25:04.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed9e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faed414bd20 con 0x7faed41487a0 2024-04-24T08:25:04.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed9e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faed414c020 con 0x7faed40b6640 2024-04-24T08:25:04.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed2a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed40b6260 0x7faed414ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:04.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed2a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed40b6260 0x7faed414ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43740/0 (socket says 172.21.15.88:43740) 2024-04-24T08:25:04.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed2a00640 1 -- 172.21.15.88:0/1581034233 learned_addr learned my addr 172.21.15.88:0/1581034233 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:04.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed2a00640 1 -- 172.21.15.88:0/1581034233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed40b6640 msgr2=0x7faed41e4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed2a00640 1 --2- 172.21.15.88:0/1581034233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed40b6640 0x7faed41e4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed2a00640 1 -- 172.21.15.88:0/1581034233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faed41487a0 msgr2=0x7faed41e4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed2a00640 1 --2- 172.21.15.88:0/1581034233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faed41487a0 0x7faed41e4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed2a00640 1 -- 172.21.15.88:0/1581034233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed414e6b0 con 0x7faed40b6260 2024-04-24T08:25:04.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed2a00640 1 --2- 172.21.15.88:0/1581034233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed40b6260 0x7faed414ccd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faec400d830 tx=0x7faec400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:04.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faecb400640 1 -- 172.21.15.88:0/1581034233 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4018030 con 0x7faed40b6260 2024-04-24T08:25:04.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faecb400640 1 -- 172.21.15.88:0/1581034233 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec400be10 con 0x7faed40b6260 2024-04-24T08:25:04.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faecb400640 1 -- 172.21.15.88:0/1581034233 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec40098b0 con 0x7faed40b6260 2024-04-24T08:25:04.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed9e00640 1 -- 172.21.15.88:0/1581034233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed4145f90 con 0x7faed40b6260 2024-04-24T08:25:04.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed9e00640 1 -- 172.21.15.88:0/1581034233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed41452e0 con 0x7faed40b6260 2024-04-24T08:25:04.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faecb400640 1 -- 172.21.15.88:0/1581034233 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faec401b070 con 0x7faed40b6260 2024-04-24T08:25:04.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faecb400640 1 -- 172.21.15.88:0/1581034233 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7faec401db90 con 0x7faed40b6260 2024-04-24T08:25:04.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.739+0000 7faed9e00640 1 -- 172.21.15.88:0/1581034233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed4073bf0 con 0x7faed40b6260 2024-04-24T08:25:04.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.743+0000 7faecb400640 1 -- 172.21.15.88:0/1581034233 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7faec401d410 con 0x7faed40b6260 2024-04-24T08:25:04.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.799+0000 7faed9e00640 1 -- 172.21.15.88:0/1581034233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faed4068b90 con 0x7faed40b6260 2024-04-24T08:25:04.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.799+0000 7faecb400640 1 -- 172.21.15.88:0/1581034233 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7faec401d5f0 con 0x7faed40b6260 2024-04-24T08:25:04.803 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:04.804 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:04.482429+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:04.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.803+0000 7faed9e00640 1 -- 172.21.15.88:0/1581034233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed40b6260 msgr2=0x7faed414ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:04.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.803+0000 7faed9e00640 1 --2- 172.21.15.88:0/1581034233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed40b6260 0x7faed414ccd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faec400d830 tx=0x7faec400dcf0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.803+0000 7faed9e00640 1 -- 172.21.15.88:0/1581034233 shutdown_connections 2024-04-24T08:25:04.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.803+0000 7faed9e00640 1 --2- 172.21.15.88:0/1581034233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faed41487a0 0x7faed41e4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.803+0000 7faed9e00640 1 --2- 172.21.15.88:0/1581034233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed40b6640 0x7faed41e4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.803+0000 7faed9e00640 1 --2- 172.21.15.88:0/1581034233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faed40b6260 0x7faed414ccd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.803+0000 7faed9e00640 1 -- 172.21.15.88:0/1581034233 >> 172.21.15.88:0/1581034233 conn(0x7faed40bd5c0 msgr2=0x7faed4147d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.803+0000 7faed9e00640 1 -- 172.21.15.88:0/1581034233 shutdown_connections 2024-04-24T08:25:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:04.803+0000 7faed9e00640 1 -- 172.21.15.88:0/1581034233 wait complete. 2024-04-24T08:25:04.822 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-24T08:25:04.822 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-24T08:25:04.882 INFO:tasks.ceph.mgr.y.smithi088.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-24T08:25:04.882 INFO:tasks.ceph.mgr.y.smithi088.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-24T08:25:04.882 INFO:tasks.ceph.mgr.y.smithi088.stderr: from numpy import show_config as show_numpy_config 2024-04-24T08:25:04.927 INFO:tasks.ceph.mgr.x.smithi142.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-24T08:25:04.927 INFO:tasks.ceph.mgr.x.smithi142.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-24T08:25:04.928 INFO:tasks.ceph.mgr.x.smithi142.stderr: from numpy import show_config as show_numpy_config 2024-04-24T08:25:04.930 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:04.927+0000 7fbf69328180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T08:25:04.983 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:04.980+0000 7fe426a4c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T08:25:05.079 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:05.075+0000 7fbf69328180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T08:25:05.132 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:05.132+0000 7fe426a4c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T08:25:05.177 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-24T08:25:05.175+0000 7fd649a8a7c0 -1 Falling back to public interface 2024-04-24T08:25:05.221 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-04-24T08:25:05.220+0000 7f13b8be17c0 -1 Falling back to public interface 2024-04-24T08:25:05.221 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-24T08:25:05.220+0000 7f9eb19037c0 -1 Falling back to public interface 2024-04-24T08:25:05.221 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-24T08:25:05.220+0000 7f9eb0400640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-04-24T08:25:05.248 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:05.247+0000 7fbf69328180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T08:25:05.253 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-04-24T08:25:05.251+0000 7fa7cb6b87c0 -1 Falling back to public interface 2024-04-24T08:25:05.256 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-04-24T08:25:05.256+0000 7f0c5ded47c0 -1 Falling back to public interface 2024-04-24T08:25:05.268 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-04-24T08:25:05.268+0000 7f473d96e7c0 -1 Falling back to public interface 2024-04-24T08:25:05.269 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-04-24T08:25:05.267+0000 7f0f1c56c7c0 -1 Falling back to public interface 2024-04-24T08:25:05.270 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-04-24T08:25:05.267+0000 7f612cce07c0 -1 Falling back to public interface 2024-04-24T08:25:05.323 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:05.320+0000 7fe426a4c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T08:25:05.332 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:05.331+0000 7fbf69328180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T08:25:05.395 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:05.396+0000 7fe426a4c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T08:25:05.481 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:05.479+0000 7fbf69328180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T08:25:05.545 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:05.544+0000 7fe426a4c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T08:25:05.628 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:05.754 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9bd200640 1 Processor -- start 2024-04-24T08:25:05.754 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9bd200640 1 -- start start 2024-04-24T08:25:05.755 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9bd200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b806e6e0 0x7fc9b80b5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:05.755 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9bd200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9b8072520 0x7fc9b814b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:05.755 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9bd200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9b80b76d0 con 0x7fc9b814b9a0 2024-04-24T08:25:05.755 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9bd200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc9b80b59b0 con 0x7fc9b8072520 2024-04-24T08:25:05.756 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9bd200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b806eac0 con 0x7fc9b806e6e0 2024-04-24T08:25:05.756 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9afe00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9b8072520 0x7fc9b814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:05.756 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9afe00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9b8072520 0x7fc9b814b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43756/0 (socket says 172.21.15.88:43756) 2024-04-24T08:25:05.756 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9afe00640 1 -- 172.21.15.88:0/1965128176 learned_addr learned my addr 172.21.15.88:0/1965128176 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:05.756 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9b5e00640 1 --2- 172.21.15.88:0/1965128176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b806e6e0 0x7fc9b80b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:05.757 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9afe00640 1 -- 172.21.15.88:0/1965128176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b806e6e0 msgr2=0x7fc9b80b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:05.757 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9afe00640 1 --2- 172.21.15.88:0/1965128176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b806e6e0 0x7fc9b80b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:05.757 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.751+0000 7fc9afe00640 1 -- 172.21.15.88:0/1965128176 >> v1:172.21.15.142:6789/0 conn(0x7fc9b814b9a0 legacy=0x7fc9b81482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:05.757 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9afe00640 1 -- 172.21.15.88:0/1965128176 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b806dc80 con 0x7fc9b8072520 2024-04-24T08:25:05.759 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9afe00640 1 --2- 172.21.15.88:0/1965128176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9b8072520 0x7fc9b814b460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009870 tx=0x7fc9a001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc22a0919a2fee60 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:05.759 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9b5400640 1 -- 172.21.15.88:0/1965128176 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00aa600 con 0x7fc9b8072520 2024-04-24T08:25:05.759 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9b5400640 1 -- 172.21.15.88:0/1965128176 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a00af070 con 0x7fc9b8072520 2024-04-24T08:25:05.759 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9b5400640 1 -- 172.21.15.88:0/1965128176 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00aa9c0 con 0x7fc9b8072520 2024-04-24T08:25:05.760 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9bd200640 1 -- 172.21.15.88:0/1965128176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9b8072520 msgr2=0x7fc9b814b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:05.760 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9bd200640 1 --2- 172.21.15.88:0/1965128176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9b8072520 0x7fc9b814b460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009870 tx=0x7fc9a001c4a0 comp rx=0 tx=0).stop 2024-04-24T08:25:05.760 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9bd200640 1 -- 172.21.15.88:0/1965128176 shutdown_connections 2024-04-24T08:25:05.760 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9bd200640 1 --2- 172.21.15.88:0/1965128176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9b8072520 0x7fc9b814b460 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:05.760 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9bd200640 1 --2- 172.21.15.88:0/1965128176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b806e6e0 0x7fc9b80b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:05.760 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9bd200640 1 -- 172.21.15.88:0/1965128176 >> 172.21.15.88:0/1965128176 conn(0x7fc9b80bb490 msgr2=0x7fc9b80bb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:05.760 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9bd200640 1 -- 172.21.15.88:0/1965128176 shutdown_connections 2024-04-24T08:25:05.760 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.755+0000 7fc9bd200640 1 -- 172.21.15.88:0/1965128176 wait complete. 2024-04-24T08:25:05.761 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9bd200640 1 Processor -- start 2024-04-24T08:25:05.761 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9bd200640 1 -- start start 2024-04-24T08:25:05.764 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9bd200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b806e6e0 0x7fc9b8142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:05.764 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9bd200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9b8072520 0x7fc9b813b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:05.764 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9bd200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b814b9a0 0x7fc9b813bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:05.764 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9bd200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b814c1c0 con 0x7fc9b8072520 2024-04-24T08:25:05.764 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9bd200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b806d5e0 con 0x7fc9b806e6e0 2024-04-24T08:25:05.764 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9bd200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b806d900 con 0x7fc9b814b9a0 2024-04-24T08:25:05.764 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9afe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9b8072520 0x7fc9b813b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:05.764 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9afe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9b8072520 0x7fc9b813b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43772/0 (socket says 172.21.15.88:43772) 2024-04-24T08:25:05.765 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9afe00640 1 -- 172.21.15.88:0/2725928595 learned_addr learned my addr 172.21.15.88:0/2725928595 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:05.765 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9b5e00640 1 --2- 172.21.15.88:0/2725928595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b806e6e0 0x7fc9b8142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:05.765 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9afe00640 1 -- 172.21.15.88:0/2725928595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b814b9a0 msgr2=0x7fc9b813bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:05.765 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9afe00640 1 --2- 172.21.15.88:0/2725928595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b814b9a0 0x7fc9b813bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:05.765 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9afe00640 1 -- 172.21.15.88:0/2725928595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b806e6e0 msgr2=0x7fc9b8142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:05.765 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9afe00640 1 --2- 172.21.15.88:0/2725928595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b806e6e0 0x7fc9b8142500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:05.765 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9afe00640 1 -- 172.21.15.88:0/2725928595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b81e46d0 con 0x7fc9b8072520 2024-04-24T08:25:05.765 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9afe00640 1 --2- 172.21.15.88:0/2725928595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9b8072520 0x7fc9b813b7e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00ac040 tx=0x7fc9a001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:05.765 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9ae000640 1 -- 172.21.15.88:0/2725928595 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00bd5f0 con 0x7fc9b8072520 2024-04-24T08:25:05.765 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9ae000640 1 -- 172.21.15.88:0/2725928595 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a00bd790 con 0x7fc9b8072520 2024-04-24T08:25:05.765 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9ae000640 1 -- 172.21.15.88:0/2725928595 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00bdb80 con 0x7fc9b8072520 2024-04-24T08:25:05.766 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9bd200640 1 -- 172.21.15.88:0/2725928595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b813d060 con 0x7fc9b8072520 2024-04-24T08:25:05.766 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9bd200640 1 -- 172.21.15.88:0/2725928595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b8140f10 con 0x7fc9b8072520 2024-04-24T08:25:05.766 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.759+0000 7fc9ae000640 1 -- 172.21.15.88:0/2725928595 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc9a00a9070 con 0x7fc9b8072520 2024-04-24T08:25:05.766 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.763+0000 7fc9ae000640 1 -- 172.21.15.88:0/2725928595 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc9a00b33f0 con 0x7fc9b8072520 2024-04-24T08:25:05.766 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.763+0000 7fc9bd200640 1 -- 172.21.15.88:0/2725928595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b804fda0 con 0x7fc9b8072520 2024-04-24T08:25:05.767 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.763+0000 7fc9ae000640 1 -- 172.21.15.88:0/2725928595 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc9a0016150 con 0x7fc9b8072520 2024-04-24T08:25:05.824 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.819+0000 7fc9bd200640 1 -- 172.21.15.88:0/2725928595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9b80b3de0 con 0x7fc9b8072520 2024-04-24T08:25:05.824 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.823+0000 7fc9ae000640 1 -- 172.21.15.88:0/2725928595 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc9a00cd090 con 0x7fc9b8072520 2024-04-24T08:25:05.825 INFO:teuthology.misc.health.smithi088.stdout: 2024-04-24T08:25:05.825 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":10,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:04.482429+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:05.826 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.823+0000 7fc9bd200640 1 -- 172.21.15.88:0/2725928595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9b8072520 msgr2=0x7fc9b813b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:05.826 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.823+0000 7fc9bd200640 1 --2- 172.21.15.88:0/2725928595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9b8072520 0x7fc9b813b7e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00ac040 tx=0x7fc9a001ace0 comp rx=0 tx=0).stop 2024-04-24T08:25:05.826 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.823+0000 7fc9bd200640 1 -- 172.21.15.88:0/2725928595 shutdown_connections 2024-04-24T08:25:05.826 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.823+0000 7fc9bd200640 1 --2- 172.21.15.88:0/2725928595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b814b9a0 0x7fc9b813bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:05.826 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.823+0000 7fc9bd200640 1 --2- 172.21.15.88:0/2725928595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9b8072520 0x7fc9b813b7e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:05.826 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.823+0000 7fc9bd200640 1 --2- 172.21.15.88:0/2725928595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b806e6e0 0x7fc9b8142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:05.826 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.823+0000 7fc9bd200640 1 -- 172.21.15.88:0/2725928595 >> 172.21.15.88:0/2725928595 conn(0x7fc9b80bb490 msgr2=0x7fc9b80b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:05.827 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.823+0000 7fc9bd200640 1 -- 172.21.15.88:0/2725928595 shutdown_connections 2024-04-24T08:25:05.827 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:05.823+0000 7fc9bd200640 1 -- 172.21.15.88:0/2725928595 wait complete. 2024-04-24T08:25:05.842 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-24T08:25:06.197 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:06.195+0000 7fbf69328180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T08:25:06.243 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:06.240+0000 7fe426a4c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T08:25:06.284 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:06.279+0000 7fbf69328180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T08:25:06.329 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:06.328+0000 7fe426a4c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T08:25:06.489 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:06.487+0000 7fbf69328180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T08:25:06.532 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:06.532+0000 7fe426a4c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T08:25:06.574 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:06.571+0000 7fbf69328180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T08:25:06.617 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:06.616+0000 7fe426a4c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T08:25:06.901 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:06.899+0000 7fbf69328180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T08:25:06.945 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:06.944+0000 7fe426a4c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T08:25:06.970 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:06.967+0000 7fbf69328180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T08:25:07.021 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-04-24T08:25:07.020+0000 7fe426a4c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T08:25:07.990 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:07.987+0000 7fbf0f400640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-24T08:25:07.990 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-24T08:25:07.987+0000 7fbf0f400640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-24T08:25:09.088 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-04-24T08:25:09.088+0000 7f13b8be17c0 -1 osd.4 0 log_to_monitors true 2024-04-24T08:25:09.093 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-24T08:25:09.091+0000 7fd649a8a7c0 -1 osd.0 0 log_to_monitors true 2024-04-24T08:25:09.113 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-24T08:25:09.112+0000 7f9eb19037c0 -1 osd.6 0 log_to_monitors true 2024-04-24T08:25:09.177 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-04-24T08:25:09.176+0000 7f0c5ded47c0 -1 osd.7 0 log_to_monitors true 2024-04-24T08:25:09.230 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-04-24T08:25:09.227+0000 7fa7cb6b87c0 -1 osd.2 0 log_to_monitors true 2024-04-24T08:25:09.241 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-04-24T08:25:09.239+0000 7f612cce07c0 -1 osd.3 0 log_to_monitors true 2024-04-24T08:25:09.264 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-04-24T08:25:09.264+0000 7f473d96e7c0 -1 osd.5 0 log_to_monitors true 2024-04-24T08:25:09.332 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-04-24T08:25:09.327+0000 7f0f1c56c7c0 -1 osd.1 0 log_to_monitors true 2024-04-24T08:25:12.648 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:12.864 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.859+0000 7f42bd400640 1 Processor -- start 2024-04-24T08:25:12.864 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.859+0000 7f42bd400640 1 -- start start 2024-04-24T08:25:12.865 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42bd400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b814f800 0x7f42b814fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:12.866 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42bd400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b8150120 con 0x7f42b809c790 2024-04-24T08:25:12.866 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42bd400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b80b2bf0 con 0x7f42b814c030 2024-04-24T08:25:12.866 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42bd400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f42b809cd40 con 0x7f42b814f800 2024-04-24T08:25:12.866 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42b7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b814f800 0x7f42b814fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:12.866 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42b7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b814f800 0x7f42b814fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:50744/0 (socket says 172.21.15.88:50744) 2024-04-24T08:25:12.866 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42bca00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f42b814c030 0x7f42b814c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:46812/0 (socket says 172.21.15.88:46812) 2024-04-24T08:25:12.866 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42bca00640 1 -- 172.21.15.88:0/1219434480 learned_addr learned my addr 172.21.15.88:0/1219434480 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:12.867 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42b7400640 1 -- 172.21.15.88:0/1219434480 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 931552276 0 0) 0x7f42b80b2bf0 con 0x7f42b814c030 2024-04-24T08:25:12.867 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42b7400640 1 -- 172.21.15.88:0/1219434480 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f429c003530 con 0x7f42b814c030 2024-04-24T08:25:12.867 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42b7e00640 1 -- 172.21.15.88:0/1219434480 >> v1:172.21.15.142:6789/0 conn(0x7f42b814c030 legacy=0x7f42b814c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:12.871 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42b7e00640 1 -- 172.21.15.88:0/1219434480 >> v1:172.21.15.88:6789/0 conn(0x7f42b809c790 legacy=0x7f42b809ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:12.871 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.863+0000 7f42b7e00640 1 -- 172.21.15.88:0/1219434480 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b809c020 con 0x7f42b814f800 2024-04-24T08:25:12.871 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.867+0000 7f42b7e00640 1 --2- 172.21.15.88:0/1219434480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b814f800 0x7f42b814fbe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f42a80097f0 tx=0x7f42a801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e9115af540add4d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:12.872 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.871+0000 7f42b7400640 1 -- 172.21.15.88:0/1219434480 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a80aa5f0 con 0x7f42b814f800 2024-04-24T08:25:12.873 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.871+0000 7f42b7400640 1 -- 172.21.15.88:0/1219434480 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a80af070 con 0x7f42b814f800 2024-04-24T08:25:12.874 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.871+0000 7f42b7400640 1 -- 172.21.15.88:0/1219434480 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a80aa9f0 con 0x7f42b814f800 2024-04-24T08:25:12.874 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.871+0000 7f42bd400640 1 -- 172.21.15.88:0/1219434480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b814f800 msgr2=0x7f42b814fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:12.874 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.871+0000 7f42bd400640 1 --2- 172.21.15.88:0/1219434480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b814f800 0x7f42b814fbe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f42a80097f0 tx=0x7f42a801c470 comp rx=0 tx=0).stop 2024-04-24T08:25:12.875 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.871+0000 7f42bd400640 1 -- 172.21.15.88:0/1219434480 shutdown_connections 2024-04-24T08:25:12.875 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.871+0000 7f42bd400640 1 --2- 172.21.15.88:0/1219434480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b814f800 0x7f42b814fbe0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:12.875 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.871+0000 7f42bd400640 1 -- 172.21.15.88:0/1219434480 >> 172.21.15.88:0/1219434480 conn(0x7f42b80bd5e0 msgr2=0x7f42b80bd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:12.875 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.871+0000 7f42bd400640 1 -- 172.21.15.88:0/1219434480 shutdown_connections 2024-04-24T08:25:12.875 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.871+0000 7f42bd400640 1 -- 172.21.15.88:0/1219434480 wait complete. 2024-04-24T08:25:12.876 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bd400640 1 Processor -- start 2024-04-24T08:25:12.877 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bd400640 1 -- start start 2024-04-24T08:25:12.877 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bd400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42b809c790 0x7f42b80bc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:12.877 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bd400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b814c030 0x7f42b8070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:12.878 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bd400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42b814f800 0x7f42b81e8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:12.878 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bd400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f42b815aab0 con 0x7f42b809c790 2024-04-24T08:25:12.878 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bd400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f42b815a930 con 0x7f42b814f800 2024-04-24T08:25:12.878 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bd400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f42b815ac30 con 0x7f42b814c030 2024-04-24T08:25:12.879 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42b814f800 0x7f42b81e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:12.879 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42afe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b814c030 0x7f42b8070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:12.879 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42b814f800 0x7f42b81e8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:40212/0 (socket says 172.21.15.88:40212) 2024-04-24T08:25:12.879 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bca00640 1 -- 172.21.15.88:0/2911311170 learned_addr learned my addr 172.21.15.88:0/2911311170 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:12.879 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bca00640 1 -- 172.21.15.88:0/2911311170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b814c030 msgr2=0x7f42b8070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:12.879 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bca00640 1 --2- 172.21.15.88:0/2911311170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b814c030 0x7f42b8070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:12.879 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bca00640 1 -- 172.21.15.88:0/2911311170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42b809c790 msgr2=0x7f42b80bc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:12.879 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bca00640 1 --2- 172.21.15.88:0/2911311170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42b809c790 0x7f42b80bc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:12.879 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bca00640 1 -- 172.21.15.88:0/2911311170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b80715a0 con 0x7f42b814f800 2024-04-24T08:25:12.880 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42bca00640 1 --2- 172.21.15.88:0/2911311170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42b814f800 0x7f42b81e8390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f42b000cb70 tx=0x7f42b000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:12.880 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42b4c00640 1 -- 172.21.15.88:0/2911311170 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0017070 con 0x7f42b814f800 2024-04-24T08:25:12.880 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42b4c00640 1 -- 172.21.15.88:0/2911311170 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b000ad40 con 0x7f42b814f800 2024-04-24T08:25:12.880 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.875+0000 7f42b4c00640 1 -- 172.21.15.88:0/2911311170 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0012620 con 0x7f42b814f800 2024-04-24T08:25:12.880 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.879+0000 7f42bd400640 1 -- 172.21.15.88:0/2911311170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b8071880 con 0x7f42b814f800 2024-04-24T08:25:12.881 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.879+0000 7f42bd400640 1 -- 172.21.15.88:0/2911311170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b806f3e0 con 0x7f42b814f800 2024-04-24T08:25:12.882 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.879+0000 7f42bd400640 1 -- 172.21.15.88:0/2911311170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b804fda0 con 0x7f42b814f800 2024-04-24T08:25:12.883 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.879+0000 7f42b4c00640 1 -- 172.21.15.88:0/2911311170 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f42b001a070 con 0x7f42b814f800 2024-04-24T08:25:12.884 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.879+0000 7f42b4c00640 1 --2- 172.21.15.88:0/2911311170 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4294068340 0x7f429406a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:12.884 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.883+0000 7f42b4c00640 1 -- 172.21.15.88:0/2911311170 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f42b00858b0 con 0x7f42b814f800 2024-04-24T08:25:12.885 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.883+0000 7f42b7e00640 1 --2- 172.21.15.88:0/2911311170 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4294068340 0x7f429406a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:12.886 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.883+0000 7f42b7e00640 1 --2- 172.21.15.88:0/2911311170 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4294068340 0x7f429406a800 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f42a80ae000 tx=0x7f42a8004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:12.894 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:12.891+0000 7f42b4c00640 1 -- 172.21.15.88:0/2911311170 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f42b0056d50 con 0x7f42b814f800 2024-04-24T08:25:13.190 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-04-24T08:25:13.188+0000 7f13b3a00640 -1 osd.4 0 waiting for initial osdmap 2024-04-24T08:25:13.216 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.211+0000 7f42bd400640 1 -- 172.21.15.88:0/2911311170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42b8149170 con 0x7f42b814f800 2024-04-24T08:25:13.216 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.215+0000 7f42b4c00640 1 -- 172.21.15.88:0/2911311170 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f42b0056650 con 0x7f42b814f800 2024-04-24T08:25:13.217 INFO:teuthology.misc.health.smithi088.stdout: 2024-04-24T08:25:13.217 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":12,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:11.006294+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:13.219 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-04-24T08:25:13.216+0000 7f13a9a00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T08:25:13.221 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.219+0000 7f42bd400640 1 -- 172.21.15.88:0/2911311170 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4294068340 msgr2=0x7f429406a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:13.221 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.219+0000 7f42bd400640 1 --2- 172.21.15.88:0/2911311170 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4294068340 0x7f429406a800 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f42a80ae000 tx=0x7f42a8004740 comp rx=0 tx=0).stop 2024-04-24T08:25:13.221 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.219+0000 7f42bd400640 1 -- 172.21.15.88:0/2911311170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42b814f800 msgr2=0x7f42b81e8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:13.221 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.219+0000 7f42bd400640 1 --2- 172.21.15.88:0/2911311170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42b814f800 0x7f42b81e8390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f42b000cb70 tx=0x7f42b000a430 comp rx=0 tx=0).stop 2024-04-24T08:25:13.221 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.219+0000 7f42bd400640 1 -- 172.21.15.88:0/2911311170 shutdown_connections 2024-04-24T08:25:13.221 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.219+0000 7f42bd400640 1 --2- 172.21.15.88:0/2911311170 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4294068340 0x7f429406a800 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:13.221 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.219+0000 7f42bd400640 1 --2- 172.21.15.88:0/2911311170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42b814f800 0x7f42b81e8390 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:13.221 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.219+0000 7f42bd400640 1 --2- 172.21.15.88:0/2911311170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b814c030 0x7f42b8070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:13.222 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.219+0000 7f42bd400640 1 --2- 172.21.15.88:0/2911311170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42b809c790 0x7f42b80bc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:13.222 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.219+0000 7f42bd400640 1 -- 172.21.15.88:0/2911311170 >> 172.21.15.88:0/2911311170 conn(0x7f42b80bd5e0 msgr2=0x7f42b814b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:13.222 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.219+0000 7f42bd400640 1 -- 172.21.15.88:0/2911311170 shutdown_connections 2024-04-24T08:25:13.222 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:13.219+0000 7f42bd400640 1 -- 172.21.15.88:0/2911311170 wait complete. 2024-04-24T08:25:13.250 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-24T08:25:13.302 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-24T08:25:13.300+0000 7f9eac800640 -1 osd.6 0 waiting for initial osdmap 2024-04-24T08:25:13.319 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-04-24T08:25:13.320+0000 7f4738800640 -1 osd.5 0 waiting for initial osdmap 2024-04-24T08:25:13.324 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-24T08:25:13.324+0000 7f9ea2800640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T08:25:13.353 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-04-24T08:25:13.352+0000 7f472e800640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T08:25:13.355 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-04-24T08:25:13.352+0000 7f0c59800640 -1 osd.7 0 waiting for initial osdmap 2024-04-24T08:25:13.392 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-04-24T08:25:13.392+0000 7f0c4ee00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T08:25:13.395 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-04-24T08:25:13.391+0000 7fa7c6600640 -1 osd.2 0 waiting for initial osdmap 2024-04-24T08:25:13.397 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-24T08:25:13.395+0000 7fd644a00640 -1 osd.0 0 waiting for initial osdmap 2024-04-24T08:25:13.399 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-04-24T08:25:13.395+0000 7f6127c00640 -1 osd.3 0 waiting for initial osdmap 2024-04-24T08:25:13.402 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-04-24T08:25:13.399+0000 7f0f17400640 -1 osd.1 0 waiting for initial osdmap 2024-04-24T08:25:13.422 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-04-24T08:25:13.419+0000 7f611dc00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T08:25:13.422 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-24T08:25:13.419+0000 7fd63aa00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T08:25:13.422 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-04-24T08:25:13.419+0000 7fa7bc600640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T08:25:13.433 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-04-24T08:25:13.431+0000 7f0f0d400640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T08:25:20.057 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:20.194 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.190+0000 7f5415c00640 1 Processor -- start 2024-04-24T08:25:20.194 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.190+0000 7f5415c00640 1 -- start start 2024-04-24T08:25:20.195 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.190+0000 7f5415c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54100b6840 0x7f5410150340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.195 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.190+0000 7f5415c00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54100ae9b0 con 0x7f54100b6380 2024-04-24T08:25:20.195 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.190+0000 7f5415c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54100af910 con 0x7f54100ae5d0 2024-04-24T08:25:20.195 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.190+0000 7f5415c00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f54100b0440 con 0x7f54100b6840 2024-04-24T08:25:20.195 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.190+0000 7f540f400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54100b6840 0x7f5410150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.196 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.190+0000 7f540e000640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f54100b6380 0x7f5410073860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40796/0 (socket says 172.21.15.88:40796) 2024-04-24T08:25:20.196 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.190+0000 7f540e000640 1 -- 172.21.15.88:0/3410795850 learned_addr learned my addr 172.21.15.88:0/3410795850 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:20.196 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.190+0000 7f540f400640 1 -- 172.21.15.88:0/3410795850 >> v1:172.21.15.142:6789/0 conn(0x7f54100ae5d0 legacy=0x7f5410144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.196 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.190+0000 7f540f400640 1 -- 172.21.15.88:0/3410795850 >> v1:172.21.15.88:6789/0 conn(0x7f54100b6380 legacy=0x7f5410073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.196 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.190+0000 7f540f400640 1 -- 172.21.15.88:0/3410795850 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54100b5b80 con 0x7f54100b6840 2024-04-24T08:25:20.198 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.194+0000 7f540f400640 1 --2- 172.21.15.88:0/3410795850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54100b6840 0x7f5410150340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5408009d90 tx=0x7f540801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cf2cfcd9ead109 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:20.198 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.194+0000 7f540d600640 1 -- 172.21.15.88:0/3410795850 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54080b2070 con 0x7f54100b6840 2024-04-24T08:25:20.199 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.194+0000 7f540d600640 1 -- 172.21.15.88:0/3410795850 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54080a58b0 con 0x7f54100b6840 2024-04-24T08:25:20.199 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.194+0000 7f540d600640 1 -- 172.21.15.88:0/3410795850 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54080a5c80 con 0x7f54100b6840 2024-04-24T08:25:20.199 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.194+0000 7f5415c00640 1 -- 172.21.15.88:0/3410795850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54100b6840 msgr2=0x7f5410150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.199 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.194+0000 7f5415c00640 1 --2- 172.21.15.88:0/3410795850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54100b6840 0x7f5410150340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5408009d90 tx=0x7f540801c8e0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.199 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.194+0000 7f5415c00640 1 -- 172.21.15.88:0/3410795850 shutdown_connections 2024-04-24T08:25:20.199 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.194+0000 7f5415c00640 1 --2- 172.21.15.88:0/3410795850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54100b6840 0x7f5410150340 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.200 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.194+0000 7f5415c00640 1 -- 172.21.15.88:0/3410795850 >> 172.21.15.88:0/3410795850 conn(0x7f54100b9350 msgr2=0x7f54100b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:20.200 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.194+0000 7f5415c00640 1 -- 172.21.15.88:0/3410795850 shutdown_connections 2024-04-24T08:25:20.200 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.194+0000 7f5415c00640 1 -- 172.21.15.88:0/3410795850 wait complete. 2024-04-24T08:25:20.201 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5415c00640 1 Processor -- start 2024-04-24T08:25:20.201 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5415c00640 1 -- start start 2024-04-24T08:25:20.202 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5415c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54100ae5d0 0x7f541009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.202 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5415c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54100b6380 0x7f54101368a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.202 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5415c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54100b6840 0x7f5410136de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.202 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5415c00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f54100740f0 con 0x7f54100ae5d0 2024-04-24T08:25:20.202 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5415c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5410073f70 con 0x7f54100b6840 2024-04-24T08:25:20.202 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5415c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f54101534b0 con 0x7f54100b6380 2024-04-24T08:25:20.203 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f540ea00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54100ae5d0 0x7f541009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.203 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f540ea00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54100ae5d0 0x7f541009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35506/0 (socket says 172.21.15.88:35506) 2024-04-24T08:25:20.203 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f540ea00640 1 -- 172.21.15.88:0/537563631 learned_addr learned my addr 172.21.15.88:0/537563631 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:20.203 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f540ea00640 1 -- 172.21.15.88:0/537563631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54100b6380 msgr2=0x7f54101368a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.203 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f540ea00640 1 --2- 172.21.15.88:0/537563631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54100b6380 0x7f54101368a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.203 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f540ea00640 1 -- 172.21.15.88:0/537563631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54100b6840 msgr2=0x7f5410136de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.203 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f540ea00640 1 --2- 172.21.15.88:0/537563631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54100b6840 0x7f5410136de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.203 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f540ea00640 1 -- 172.21.15.88:0/537563631 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5410138200 con 0x7f54100ae5d0 2024-04-24T08:25:20.204 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f540ea00640 1 --2- 172.21.15.88:0/537563631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54100ae5d0 0x7f541009dac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f540000c3a0 tx=0x7f540000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:20.204 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5406a00640 1 -- 172.21.15.88:0/537563631 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54000052d0 con 0x7f54100ae5d0 2024-04-24T08:25:20.204 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5406a00640 1 -- 172.21.15.88:0/537563631 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5400005470 con 0x7f54100ae5d0 2024-04-24T08:25:20.204 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5415c00640 1 -- 172.21.15.88:0/537563631 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541009c370 con 0x7f54100ae5d0 2024-04-24T08:25:20.204 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5406a00640 1 -- 172.21.15.88:0/537563631 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400007260 con 0x7f54100ae5d0 2024-04-24T08:25:20.204 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5415c00640 1 -- 172.21.15.88:0/537563631 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54101384e0 con 0x7f54100ae5d0 2024-04-24T08:25:20.204 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.198+0000 7f5415c00640 1 -- 172.21.15.88:0/537563631 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f541009c160 con 0x7f54100ae5d0 2024-04-24T08:25:20.206 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.202+0000 7f5406a00640 1 -- 172.21.15.88:0/537563631 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5400007400 con 0x7f54100ae5d0 2024-04-24T08:25:20.207 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.202+0000 7f5406a00640 1 --2- 172.21.15.88:0/537563631 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f53f0068380 0x7f53f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.207 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.202+0000 7f5406a00640 1 -- 172.21.15.88:0/537563631 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5400085a90 con 0x7f54100ae5d0 2024-04-24T08:25:20.207 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.202+0000 7f540e000640 1 --2- 172.21.15.88:0/537563631 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f53f0068380 0x7f53f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.207 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.202+0000 7f540e000640 1 --2- 172.21.15.88:0/537563631 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f53f0068380 0x7f53f006a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f54100b3840 tx=0x7f53fc007a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:20.212 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.206+0000 7f5406a00640 1 -- 172.21.15.88:0/537563631 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5400056430 con 0x7f54100ae5d0 2024-04-24T08:25:20.368 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.362+0000 7f5415c00640 1 -- 172.21.15.88:0/537563631 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5410144780 con 0x7f54100ae5d0 2024-04-24T08:25:20.369 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5406a00640 1 -- 172.21.15.88:0/537563631 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f5400055d30 con 0x7f54100ae5d0 2024-04-24T08:25:20.370 INFO:teuthology.misc.health.smithi088.stdout: 2024-04-24T08:25:20.370 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":16,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:17.313377+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:20.372 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5415c00640 1 -- 172.21.15.88:0/537563631 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f53f0068380 msgr2=0x7f53f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.372 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5415c00640 1 --2- 172.21.15.88:0/537563631 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f53f0068380 0x7f53f006a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f54100b3840 tx=0x7f53fc007a50 comp rx=0 tx=0).stop 2024-04-24T08:25:20.372 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5415c00640 1 -- 172.21.15.88:0/537563631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54100ae5d0 msgr2=0x7f541009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.372 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5415c00640 1 --2- 172.21.15.88:0/537563631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54100ae5d0 0x7f541009dac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f540000c3a0 tx=0x7f540000c860 comp rx=0 tx=0).stop 2024-04-24T08:25:20.372 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5415c00640 1 -- 172.21.15.88:0/537563631 shutdown_connections 2024-04-24T08:25:20.372 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5415c00640 1 --2- 172.21.15.88:0/537563631 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f53f0068380 0x7f53f006a840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.372 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5415c00640 1 --2- 172.21.15.88:0/537563631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54100b6840 0x7f5410136de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.372 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5415c00640 1 --2- 172.21.15.88:0/537563631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54100b6380 0x7f54101368a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.372 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5415c00640 1 --2- 172.21.15.88:0/537563631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54100ae5d0 0x7f541009dac0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.373 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5415c00640 1 -- 172.21.15.88:0/537563631 >> 172.21.15.88:0/537563631 conn(0x7f54100b9350 msgr2=0x7f5410143070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:20.373 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5415c00640 1 -- 172.21.15.88:0/537563631 shutdown_connections 2024-04-24T08:25:20.373 INFO:teuthology.misc.health.smithi088.stderr:2024-04-24T08:25:20.366+0000 7f5415c00640 1 -- 172.21.15.88:0/537563631 wait complete. 2024-04-24T08:25:20.389 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-24T08:25:20.389 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-24T08:25:20.390 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-24T08:25:20.390 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-24T08:25:20.393 INFO:tasks.ceph.mds.a:Started 2024-04-24T08:25:20.394 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-24T08:25:20.394 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-24T08:25:20.398 INFO:tasks.ceph.mds.b:Started 2024-04-24T08:25:20.398 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-24T08:25:20.398 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:20.493 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2024-04-24T08:25:20.512 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-04-24T08:25:20.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f462f200640 1 Processor -- start 2024-04-24T08:25:20.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f462f200640 1 -- start start 2024-04-24T08:25:20.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f462f200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46280a94c0 0x7f46280ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f462f200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4628145ec0 0x7f4628150780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f462f200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46280b64e0 con 0x7f46280b7400 2024-04-24T08:25:20.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f462f200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f46280b77e0 con 0x7f46280a94c0 2024-04-24T08:25:20.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f462f200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f46280b69e0 con 0x7f4628145ec0 2024-04-24T08:25:20.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f4627400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46280a94c0 0x7f46280ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f4627400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46280a94c0 0x7f46280ab360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35526/0 (socket says 172.21.15.88:35526) 2024-04-24T08:25:20.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f4627400640 1 -- 172.21.15.88:0/1872334124 learned_addr learned my addr 172.21.15.88:0/1872334124 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:20.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f462d200640 1 --2- 172.21.15.88:0/1872334124 >> v2:172.21.15.142:3300/0 conn(0x7f4628145ec0 0x7f4628150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f4627400640 1 -- 172.21.15.88:0/1872334124 >> v2:172.21.15.142:3300/0 conn(0x7f4628145ec0 msgr2=0x7f4628150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:20.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f4627400640 1 --2- 172.21.15.88:0/1872334124 >> v2:172.21.15.142:3300/0 conn(0x7f4628145ec0 0x7f4628150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f4627400640 1 -- 172.21.15.88:0/1872334124 >> v1:172.21.15.142:6789/0 conn(0x7f46280b7400 legacy=0x7f46281466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.534+0000 7f4627400640 1 -- 172.21.15.88:0/1872334124 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46280b6700 con 0x7f46280a94c0 2024-04-24T08:25:20.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f4627400640 1 --2- 172.21.15.88:0/1872334124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46280a94c0 0x7f46280ab360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46280aaa70 tx=0x7f461401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f8ecdf452ea693 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:20.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f4626a00640 1 -- 172.21.15.88:0/1872334124 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46140b2070 con 0x7f46280a94c0 2024-04-24T08:25:20.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f4626a00640 1 -- 172.21.15.88:0/1872334124 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46140a9070 con 0x7f46280a94c0 2024-04-24T08:25:20.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f4626a00640 1 -- 172.21.15.88:0/1872334124 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46140ad880 con 0x7f46280a94c0 2024-04-24T08:25:20.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f462f200640 1 -- 172.21.15.88:0/1872334124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46280a94c0 msgr2=0x7f46280ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f462f200640 1 --2- 172.21.15.88:0/1872334124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46280a94c0 0x7f46280ab360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46280aaa70 tx=0x7f461401c490 comp rx=0 tx=0).stop 2024-04-24T08:25:20.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f462f200640 1 -- 172.21.15.88:0/1872334124 shutdown_connections 2024-04-24T08:25:20.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f462f200640 1 --2- 172.21.15.88:0/1872334124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46280a94c0 0x7f46280ab360 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f462f200640 1 --2- 172.21.15.88:0/1872334124 >> v2:172.21.15.142:3300/0 conn(0x7f4628145ec0 0x7f4628150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f462f200640 1 -- 172.21.15.88:0/1872334124 >> 172.21.15.88:0/1872334124 conn(0x7f4628067810 msgr2=0x7f4628067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:20.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f462f200640 1 -- 172.21.15.88:0/1872334124 shutdown_connections 2024-04-24T08:25:20.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f462f200640 1 -- 172.21.15.88:0/1872334124 wait complete. 2024-04-24T08:25:20.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f462f200640 1 Processor -- start 2024-04-24T08:25:20.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.538+0000 7f462f200640 1 -- start start 2024-04-24T08:25:20.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f462f200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46280b7400 0x7f4628142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f462f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4628145ec0 0x7f46281489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f462f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4628148ee0 0x7f462813e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f462f200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f46280b7cd0 con 0x7f46280b7400 2024-04-24T08:25:20.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f462f200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f46280b5eb0 con 0x7f4628145ec0 2024-04-24T08:25:20.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f462f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f46280b7e50 con 0x7f4628148ee0 2024-04-24T08:25:20.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f4627e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46280b7400 0x7f4628142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f4627e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46280b7400 0x7f4628142820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35540/0 (socket says 172.21.15.88:35540) 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f4627e00640 1 -- 172.21.15.88:0/2464736194 learned_addr learned my addr 172.21.15.88:0/2464736194 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f4627400640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4628145ec0 0x7f46281489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f4627e00640 1 -- 172.21.15.88:0/2464736194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4628148ee0 msgr2=0x7f462813e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f4627e00640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4628148ee0 0x7f462813e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f4627e00640 1 -- 172.21.15.88:0/2464736194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4628145ec0 msgr2=0x7f46281489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f4627e00640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4628145ec0 0x7f46281489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f4627e00640 1 -- 172.21.15.88:0/2464736194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46280acb10 con 0x7f46280b7400 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f4627e00640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46280b7400 0x7f4628142820 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f461800c450 tx=0x7f461800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f461fe00640 1 -- 172.21.15.88:0/2464736194 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46180052d0 con 0x7f46280b7400 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f461fe00640 1 -- 172.21.15.88:0/2464736194 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4618005470 con 0x7f46280b7400 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f461fe00640 1 -- 172.21.15.88:0/2464736194 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4618007260 con 0x7f46280b7400 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f462f200640 1 -- 172.21.15.88:0/2464736194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4628149370 con 0x7f46280b7400 2024-04-24T08:25:20.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f462f200640 1 -- 172.21.15.88:0/2464736194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462814a2e0 con 0x7f46280b7400 2024-04-24T08:25:20.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f462f200640 1 -- 172.21.15.88:0/2464736194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4628068b90 con 0x7f46280b7400 2024-04-24T08:25:20.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.542+0000 7f461fe00640 1 -- 172.21.15.88:0/2464736194 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4618007400 con 0x7f46280b7400 2024-04-24T08:25:20.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.546+0000 7f461fe00640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f46080683b0 0x7f460806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.546+0000 7f461fe00640 1 -- 172.21.15.88:0/2464736194 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4618085a70 con 0x7f46280b7400 2024-04-24T08:25:20.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.546+0000 7f4627400640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f46080683b0 0x7f460806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.546+0000 7f4627400640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f46080683b0 0x7f460806a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f46140af000 tx=0x7f4614008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:20.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.550+0000 7f461fe00640 1 -- 172.21.15.88:0/2464736194 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4618056410 con 0x7f46280b7400 2024-04-24T08:25:20.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.706+0000 7f462f200640 1 -- 172.21.15.88:0/2464736194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4628143b10 con 0x7f46280b7400 2024-04-24T08:25:20.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.706+0000 7f461fe00640 1 -- 172.21.15.88:0/2464736194 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f4618055d10 con 0x7f46280b7400 2024-04-24T08:25:20.711 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:20.711 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:17.313377+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:20.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.710+0000 7f462f200640 1 -- 172.21.15.88:0/2464736194 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f46080683b0 msgr2=0x7f460806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.710+0000 7f462f200640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f46080683b0 0x7f460806a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f46140af000 tx=0x7f4614008040 comp rx=0 tx=0).stop 2024-04-24T08:25:20.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.710+0000 7f462f200640 1 -- 172.21.15.88:0/2464736194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46280b7400 msgr2=0x7f4628142820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.710+0000 7f462f200640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46280b7400 0x7f4628142820 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f461800c450 tx=0x7f461800c910 comp rx=0 tx=0).stop 2024-04-24T08:25:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.710+0000 7f462f200640 1 -- 172.21.15.88:0/2464736194 shutdown_connections 2024-04-24T08:25:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.710+0000 7f462f200640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f46080683b0 0x7f460806a870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.710+0000 7f462f200640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4628148ee0 0x7f462813e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.710+0000 7f462f200640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4628145ec0 0x7f46281489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.710+0000 7f462f200640 1 --2- 172.21.15.88:0/2464736194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46280b7400 0x7f4628142820 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.710+0000 7f462f200640 1 -- 172.21.15.88:0/2464736194 >> 172.21.15.88:0/2464736194 conn(0x7f4628067810 msgr2=0x7f46280b9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.710+0000 7f462f200640 1 -- 172.21.15.88:0/2464736194 shutdown_connections 2024-04-24T08:25:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.710+0000 7f462f200640 1 -- 172.21.15.88:0/2464736194 wait complete. 2024-04-24T08:25:20.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:25:20.732 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:25:20.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8bd200640 1 Processor -- start 2024-04-24T08:25:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8bd200640 1 -- start start 2024-04-24T08:25:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8bd200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b80b01a0 0x7ff8b806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8bd200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff8b80ae4e0 0x7ff8b813e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8bd200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8b80737c0 0x7ff8b813eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8bd200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ff8b80b0580 con 0x7ff8b80ae4e0 2024-04-24T08:25:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8bd200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff8b80b59d0 con 0x7ff8b80737c0 2024-04-24T08:25:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8bd200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b80ae970 con 0x7ff8b80b01a0 2024-04-24T08:25:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8b5400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff8b80ae4e0 0x7ff8b813e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8b5400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff8b80ae4e0 0x7ff8b813e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35548/0 (socket says 172.21.15.88:35548) 2024-04-24T08:25:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8b5400640 1 -- 172.21.15.88:0/2870803273 learned_addr learned my addr 172.21.15.88:0/2870803273 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8b6800640 1 --2- 172.21.15.88:0/2870803273 >> v2:172.21.15.142:3300/0 conn(0x7ff8b80737c0 0x7ff8b813eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8b5e00640 1 --2- 172.21.15.88:0/2870803273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b80b01a0 0x7ff8b806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8b5400640 1 -- 172.21.15.88:0/2870803273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b80b01a0 msgr2=0x7ff8b806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8b5400640 1 --2- 172.21.15.88:0/2870803273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b80b01a0 0x7ff8b806d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8b5400640 1 -- 172.21.15.88:0/2870803273 >> v2:172.21.15.142:3300/0 conn(0x7ff8b80737c0 msgr2=0x7ff8b813eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8b5400640 1 --2- 172.21.15.88:0/2870803273 >> v2:172.21.15.142:3300/0 conn(0x7ff8b80737c0 0x7ff8b813eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8b5400640 1 -- 172.21.15.88:0/2870803273 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b80b53a0 con 0x7ff8b80ae4e0 2024-04-24T08:25:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.866+0000 7ff8b5e00640 1 --2- 172.21.15.88:0/2870803273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b80b01a0 0x7ff8b806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:20.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8b5400640 1 --2- 172.21.15.88:0/2870803273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b80ae4e0 0x7ff8b813e980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8145cc0 tx=0x7ff8a401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9533c7c8a422fc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:20.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8b4a00640 1 -- 172.21.15.88:0/2870803273 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a40b0070 con 0x7ff8b80ae4e0 2024-04-24T08:25:20.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8b4a00640 1 -- 172.21.15.88:0/2870803273 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a40ab600 con 0x7ff8b80ae4e0 2024-04-24T08:25:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8b4a00640 1 -- 172.21.15.88:0/2870803273 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a40ab9d0 con 0x7ff8b80ae4e0 2024-04-24T08:25:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8bd200640 1 -- 172.21.15.88:0/2870803273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b80ae4e0 msgr2=0x7ff8b813e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8bd200640 1 --2- 172.21.15.88:0/2870803273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b80ae4e0 0x7ff8b813e980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8145cc0 tx=0x7ff8a401c400 comp rx=0 tx=0).stop 2024-04-24T08:25:20.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8bd200640 1 -- 172.21.15.88:0/2870803273 shutdown_connections 2024-04-24T08:25:20.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8bd200640 1 --2- 172.21.15.88:0/2870803273 >> v2:172.21.15.142:3300/0 conn(0x7ff8b80737c0 0x7ff8b813eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8bd200640 1 --2- 172.21.15.88:0/2870803273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b80ae4e0 0x7ff8b813e980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8bd200640 1 --2- 172.21.15.88:0/2870803273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b80b01a0 0x7ff8b806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8bd200640 1 -- 172.21.15.88:0/2870803273 >> 172.21.15.88:0/2870803273 conn(0x7ff8b80b9690 msgr2=0x7ff8b80b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:20.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8bd200640 1 -- 172.21.15.88:0/2870803273 shutdown_connections 2024-04-24T08:25:20.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.870+0000 7ff8bd200640 1 -- 172.21.15.88:0/2870803273 wait complete. 2024-04-24T08:25:20.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8bd200640 1 Processor -- start 2024-04-24T08:25:20.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8bd200640 1 -- start start 2024-04-24T08:25:20.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8bd200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b80737c0 0x7ff8b814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8bd200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b80b01a0 0x7ff8b809d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8bd200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b8136740 0x7ff8b8136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8bd200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b8148910 con 0x7ff8b8136740 2024-04-24T08:25:20.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8bd200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b806e470 con 0x7ff8b80737c0 2024-04-24T08:25:20.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8bd200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b8148a90 con 0x7ff8b80b01a0 2024-04-24T08:25:20.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8b6800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b8136740 0x7ff8b8136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8b6800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b8136740 0x7ff8b8136bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35560/0 (socket says 172.21.15.88:35560) 2024-04-24T08:25:20.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8b6800640 1 -- 172.21.15.88:0/3692901148 learned_addr learned my addr 172.21.15.88:0/3692901148 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:20.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8b5e00640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b80737c0 0x7ff8b814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8b5400640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b80b01a0 0x7ff8b809d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8b6800640 1 -- 172.21.15.88:0/3692901148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b80b01a0 msgr2=0x7ff8b809d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8b6800640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b80b01a0 0x7ff8b809d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8b6800640 1 -- 172.21.15.88:0/3692901148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b80737c0 msgr2=0x7ff8b814dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:20.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8b6800640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b80737c0 0x7ff8b814dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:20.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8b6800640 1 -- 172.21.15.88:0/3692901148 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b809c4f0 con 0x7ff8b8136740 2024-04-24T08:25:20.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8b5e00640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b80737c0 0x7ff8b814dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:20.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8b6800640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b8136740 0x7ff8b8136bd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000ef00 tx=0x7ff8b000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:20.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8ae000640 1 -- 172.21.15.88:0/3692901148 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0018020 con 0x7ff8b8136740 2024-04-24T08:25:20.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8ae000640 1 -- 172.21.15.88:0/3692901148 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b0014400 con 0x7ff8b8136740 2024-04-24T08:25:20.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8bd200640 1 -- 172.21.15.88:0/3692901148 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b809d5b0 con 0x7ff8b8136740 2024-04-24T08:25:20.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8ae000640 1 -- 172.21.15.88:0/3692901148 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b00147f0 con 0x7ff8b8136740 2024-04-24T08:25:20.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.874+0000 7ff8bd200640 1 -- 172.21.15.88:0/3692901148 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b809c770 con 0x7ff8b8136740 2024-04-24T08:25:20.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.878+0000 7ff8bd200640 1 -- 172.21.15.88:0/3692901148 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b8068c00 con 0x7ff8b8136740 2024-04-24T08:25:20.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.878+0000 7ff8ae000640 1 -- 172.21.15.88:0/3692901148 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff8b001b020 con 0x7ff8b8136740 2024-04-24T08:25:20.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.878+0000 7ff8ae000640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff898068380 0x7ff89806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:20.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.878+0000 7ff8ae000640 1 -- 172.21.15.88:0/3692901148 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff8b0086c40 con 0x7ff8b8136740 2024-04-24T08:25:20.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.878+0000 7ff8b5e00640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff898068380 0x7ff89806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:20.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.878+0000 7ff8b5e00640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff898068380 0x7ff89806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800b990 tx=0x7ff8a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:20.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:20.882+0000 7ff8ae000640 1 -- 172.21.15.88:0/3692901148 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff8b0022070 con 0x7ff8b8136740 2024-04-24T08:25:21.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.038+0000 7ff8bd200640 1 -- 172.21.15.88:0/3692901148 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff8b809acf0 con 0x7ff8b8136740 2024-04-24T08:25:21.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.038+0000 7ff8ae000640 1 -- 172.21.15.88:0/3692901148 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7ff8b809d5b0 con 0x7ff8b8136740 2024-04-24T08:25:21.044 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:25:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.042+0000 7ff8bd200640 1 -- 172.21.15.88:0/3692901148 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff898068380 msgr2=0x7ff89806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.042+0000 7ff8bd200640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff898068380 0x7ff89806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800b990 tx=0x7ff8a8008040 comp rx=0 tx=0).stop 2024-04-24T08:25:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.042+0000 7ff8bd200640 1 -- 172.21.15.88:0/3692901148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b8136740 msgr2=0x7ff8b8136bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.042+0000 7ff8bd200640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b8136740 0x7ff8b8136bd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000ef00 tx=0x7ff8b000b480 comp rx=0 tx=0).stop 2024-04-24T08:25:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.042+0000 7ff8bd200640 1 -- 172.21.15.88:0/3692901148 shutdown_connections 2024-04-24T08:25:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.042+0000 7ff8bd200640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff898068380 0x7ff89806a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.042+0000 7ff8bd200640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b8136740 0x7ff8b8136bd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.042+0000 7ff8bd200640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b80b01a0 0x7ff8b809d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.042+0000 7ff8bd200640 1 --2- 172.21.15.88:0/3692901148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b80737c0 0x7ff8b814dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.042+0000 7ff8bd200640 1 -- 172.21.15.88:0/3692901148 >> 172.21.15.88:0/3692901148 conn(0x7ff8b80b9690 msgr2=0x7ff8b809b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:21.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.042+0000 7ff8bd200640 1 -- 172.21.15.88:0/3692901148 shutdown_connections 2024-04-24T08:25:21.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.042+0000 7ff8bd200640 1 -- 172.21.15.88:0/3692901148 wait complete. 2024-04-24T08:25:21.064 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:25:21.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7fede7400640 1 Processor -- start 2024-04-24T08:25:21.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7fede7400640 1 -- start start 2024-04-24T08:25:21.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7fede7400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fede00b9d90 0x7fede01450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:21.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7fede7400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fede00b44e0 0x7fede00b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:21.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7fede7400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede0145620 con 0x7fede0148130 2024-04-24T08:25:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7fede7400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fede0145b80 con 0x7fede00b9d90 2024-04-24T08:25:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7fede7400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fede00ba170 con 0x7fede00b44e0 2024-04-24T08:25:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7feddfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fede00b44e0 0x7fede00b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7fede4a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fede00b9d90 0x7fede01450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7feddfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fede00b44e0 0x7fede00b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:44474/0 (socket says 172.21.15.88:44474) 2024-04-24T08:25:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7feddfe00640 1 -- 172.21.15.88:0/236822457 learned_addr learned my addr 172.21.15.88:0/236822457 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7feddfe00640 1 -- 172.21.15.88:0/236822457 >> v2:172.21.15.142:3300/0 conn(0x7fede00b9d90 msgr2=0x7fede01450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7feddfe00640 1 --2- 172.21.15.88:0/236822457 >> v2:172.21.15.142:3300/0 conn(0x7fede00b9d90 0x7fede01450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7feddfe00640 1 -- 172.21.15.88:0/236822457 >> v1:172.21.15.142:6789/0 conn(0x7fede0148130 legacy=0x7fede01485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:21.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.194+0000 7feddfe00640 1 -- 172.21.15.88:0/236822457 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede01458a0 con 0x7fede00b44e0 2024-04-24T08:25:21.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.198+0000 7feddfe00640 1 --2- 172.21.15.88:0/236822457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fede00b44e0 0x7fede00b4940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00bb10 tx=0x7fedcc01ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=218daea6b3545558 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:21.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.198+0000 7feddf400640 1 -- 172.21.15.88:0/236822457 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0b4070 con 0x7fede00b44e0 2024-04-24T08:25:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.198+0000 7feddf400640 1 -- 172.21.15.88:0/236822457 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc0a7a00 con 0x7fede00b44e0 2024-04-24T08:25:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.198+0000 7feddf400640 1 -- 172.21.15.88:0/236822457 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0a7dd0 con 0x7fede00b44e0 2024-04-24T08:25:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.198+0000 7fede7400640 1 -- 172.21.15.88:0/236822457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fede00b44e0 msgr2=0x7fede00b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:21.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.198+0000 7fede7400640 1 --2- 172.21.15.88:0/236822457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fede00b44e0 0x7fede00b4940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00bb10 tx=0x7fedcc01ec30 comp rx=0 tx=0).stop 2024-04-24T08:25:21.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.198+0000 7fede7400640 1 -- 172.21.15.88:0/236822457 shutdown_connections 2024-04-24T08:25:21.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.198+0000 7fede7400640 1 --2- 172.21.15.88:0/236822457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fede00b44e0 0x7fede00b4940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.198+0000 7fede7400640 1 --2- 172.21.15.88:0/236822457 >> v2:172.21.15.142:3300/0 conn(0x7fede00b9d90 0x7fede01450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.198+0000 7fede7400640 1 -- 172.21.15.88:0/236822457 >> 172.21.15.88:0/236822457 conn(0x7fede006c0d0 msgr2=0x7fede00b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:21.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.198+0000 7fede7400640 1 -- 172.21.15.88:0/236822457 shutdown_connections 2024-04-24T08:25:21.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.198+0000 7fede7400640 1 -- 172.21.15.88:0/236822457 wait complete. 2024-04-24T08:25:21.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede7400640 1 Processor -- start 2024-04-24T08:25:21.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede7400640 1 -- start start 2024-04-24T08:25:21.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede7400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede00b44e0 0x7fede01dfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:21.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede7400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fede00b9d90 0x7fede013de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:21.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede7400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede0148130 0x7fede013cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:21.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede7400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fede006dba0 con 0x7fede0148130 2024-04-24T08:25:21.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede7400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fede006da20 con 0x7fede00b44e0 2024-04-24T08:25:21.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede7400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fede006dd20 con 0x7fede00b9d90 2024-04-24T08:25:21.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede4a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede00b44e0 0x7fede01dfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:21.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede5400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede0148130 0x7fede013cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:21.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede4a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede00b44e0 0x7fede01dfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:59628/0 (socket says 172.21.15.88:59628) 2024-04-24T08:25:21.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede4a00640 1 -- 172.21.15.88:0/2890577187 learned_addr learned my addr 172.21.15.88:0/2890577187 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:21.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7feddfe00640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fede00b9d90 0x7fede013de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:21.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede4a00640 1 -- 172.21.15.88:0/2890577187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fede00b9d90 msgr2=0x7fede013de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:21.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede4a00640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fede00b9d90 0x7fede013de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede4a00640 1 -- 172.21.15.88:0/2890577187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede0148130 msgr2=0x7fede013cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:21.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede4a00640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede0148130 0x7fede013cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede4a00640 1 -- 172.21.15.88:0/2890577187 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede00b1a90 con 0x7fede00b44e0 2024-04-24T08:25:21.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede5400640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede0148130 0x7fede013cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:21.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede4a00640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede00b44e0 0x7fede01dfc30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fedd400e960 tx=0x7fedd400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:21.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7feddcc00640 1 -- 172.21.15.88:0/2890577187 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4017070 con 0x7fede00b44e0 2024-04-24T08:25:21.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7feddcc00640 1 -- 172.21.15.88:0/2890577187 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd400ca00 con 0x7fede00b44e0 2024-04-24T08:25:21.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7feddcc00640 1 -- 172.21.15.88:0/2890577187 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd400cdb0 con 0x7fede00b44e0 2024-04-24T08:25:21.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede7400640 1 -- 172.21.15.88:0/2890577187 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede00b2cb0 con 0x7fede00b44e0 2024-04-24T08:25:21.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.202+0000 7fede7400640 1 -- 172.21.15.88:0/2890577187 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede013f8d0 con 0x7fede00b44e0 2024-04-24T08:25:21.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.206+0000 7fede7400640 1 -- 172.21.15.88:0/2890577187 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede0068b90 con 0x7fede00b44e0 2024-04-24T08:25:21.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.206+0000 7feddcc00640 1 -- 172.21.15.88:0/2890577187 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fedd401a070 con 0x7fede00b44e0 2024-04-24T08:25:21.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.206+0000 7feddcc00640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fedc0068380 0x7fedc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:21.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.206+0000 7feddcc00640 1 -- 172.21.15.88:0/2890577187 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fedd40869c0 con 0x7fede00b44e0 2024-04-24T08:25:21.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.206+0000 7feddfe00640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fedc0068380 0x7fedc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:21.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.206+0000 7feddfe00640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fedc0068380 0x7fedc006a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0b1000 tx=0x7fedcc0a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:21.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.210+0000 7feddcc00640 1 -- 172.21.15.88:0/2890577187 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fedd4056c70 con 0x7fede00b44e0 2024-04-24T08:25:21.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.398+0000 7fede7400640 1 -- 172.21.15.88:0/2890577187 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fede00b7940 con 0x7fede00b44e0 2024-04-24T08:25:21.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7feddcc00640 1 -- 172.21.15.88:0/2890577187 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fedd405af70 con 0x7fede00b44e0 2024-04-24T08:25:21.405 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:21.405 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2851985776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2851985776},{"type":"v1","addr":"172.21.15.88:6835","nonce":2851985776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-24T08:25:21.405 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 2 2024-04-24T08:25:21.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7fede7400640 1 -- 172.21.15.88:0/2890577187 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fedc0068380 msgr2=0x7fedc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7fede7400640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fedc0068380 0x7fedc006a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0b1000 tx=0x7fedcc0a9070 comp rx=0 tx=0).stop 2024-04-24T08:25:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7fede7400640 1 -- 172.21.15.88:0/2890577187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede00b44e0 msgr2=0x7fede01dfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7fede7400640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede00b44e0 0x7fede01dfc30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fedd400e960 tx=0x7fedd400ee20 comp rx=0 tx=0).stop 2024-04-24T08:25:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7fede7400640 1 -- 172.21.15.88:0/2890577187 shutdown_connections 2024-04-24T08:25:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7fede7400640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fedc0068380 0x7fedc006a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7fede7400640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fede0148130 0x7fede013cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7fede7400640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fede00b9d90 0x7fede013de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7fede7400640 1 --2- 172.21.15.88:0/2890577187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede00b44e0 0x7fede01dfc30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7fede7400640 1 -- 172.21.15.88:0/2890577187 >> 172.21.15.88:0/2890577187 conn(0x7fede006c0d0 msgr2=0x7fede00b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7fede7400640 1 -- 172.21.15.88:0/2890577187 shutdown_connections 2024-04-24T08:25:21.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:21.402+0000 7fede7400640 1 -- 172.21.15.88:0/2890577187 wait complete. 2024-04-24T08:25:23.427 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:25:23.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.566+0000 7fd2b7200640 1 Processor -- start 2024-04-24T08:25:23.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.566+0000 7fd2b7200640 1 -- start start 2024-04-24T08:25:23.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.570+0000 7fd2b7200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2b009be30 0x7fd2b0145f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:23.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.570+0000 7fd2b7200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b00ba170 con 0x7fd2b00b9d90 2024-04-24T08:25:23.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.570+0000 7fd2b7200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b014a060 con 0x7fd2b006d920 2024-04-24T08:25:23.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.570+0000 7fd2b7200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b009cd30 con 0x7fd2b009be30 2024-04-24T08:25:23.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.570+0000 7fd2afe00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd2b00b9d90 0x7fd2b006d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40820/0 (socket says 172.21.15.88:40820) 2024-04-24T08:25:23.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.570+0000 7fd2afe00640 1 -- 172.21.15.88:0/265972217 learned_addr learned my addr 172.21.15.88:0/265972217 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:23.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.570+0000 7fd2af400640 1 --2- 172.21.15.88:0/265972217 >> v2:172.21.15.88:3300/0 conn(0x7fd2b009be30 0x7fd2b0145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:23.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.570+0000 7fd2aea00640 1 -- 172.21.15.88:0/265972217 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178055586 0 0) 0x7fd2b00ba170 con 0x7fd2b00b9d90 2024-04-24T08:25:23.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.570+0000 7fd2aea00640 1 -- 172.21.15.88:0/265972217 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd294003530 con 0x7fd2b00b9d90 2024-04-24T08:25:23.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.570+0000 7fd2af400640 1 -- 172.21.15.88:0/265972217 >> v1:172.21.15.142:6789/0 conn(0x7fd2b006d920 legacy=0x7fd2b01504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:23.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.570+0000 7fd2af400640 1 -- 172.21.15.88:0/265972217 >> v1:172.21.15.88:6789/0 conn(0x7fd2b00b9d90 legacy=0x7fd2b006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:23.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.570+0000 7fd2af400640 1 -- 172.21.15.88:0/265972217 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b0149860 con 0x7fd2b009be30 2024-04-24T08:25:23.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2af400640 1 --2- 172.21.15.88:0/265972217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2b009be30 0x7fd2b0145f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0097c0 tx=0x7fd29c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578e9ecf4a7f76e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:23.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2aea00640 1 -- 172.21.15.88:0/265972217 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0b0070 con 0x7fd2b009be30 2024-04-24T08:25:23.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2aea00640 1 -- 172.21.15.88:0/265972217 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c0ab600 con 0x7fd2b009be30 2024-04-24T08:25:23.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2aea00640 1 -- 172.21.15.88:0/265972217 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0ab9d0 con 0x7fd2b009be30 2024-04-24T08:25:23.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 -- 172.21.15.88:0/265972217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2b009be30 msgr2=0x7fd2b0145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:23.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 --2- 172.21.15.88:0/265972217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2b009be30 0x7fd2b0145f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0097c0 tx=0x7fd29c01c340 comp rx=0 tx=0).stop 2024-04-24T08:25:23.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 -- 172.21.15.88:0/265972217 shutdown_connections 2024-04-24T08:25:23.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 --2- 172.21.15.88:0/265972217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2b009be30 0x7fd2b0145f20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:23.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 -- 172.21.15.88:0/265972217 >> 172.21.15.88:0/265972217 conn(0x7fd2b006c0d0 msgr2=0x7fd2b00b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:23.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 -- 172.21.15.88:0/265972217 shutdown_connections 2024-04-24T08:25:23.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 -- 172.21.15.88:0/265972217 wait complete. 2024-04-24T08:25:23.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 Processor -- start 2024-04-24T08:25:23.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 -- start start 2024-04-24T08:25:23.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b006d920 0x7fd2b00b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:23.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b009be30 0x7fd2b00b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:23.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2b00b9d90 0x7fd2b00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b01545a0 con 0x7fd2b00b9d90 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b0154420 con 0x7fd2b006d920 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b7200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b0154720 con 0x7fd2b009be30 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b5200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2b00b9d90 0x7fd2b00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b5200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2b00b9d90 0x7fd2b00b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35592/0 (socket says 172.21.15.88:35592) 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.574+0000 7fd2b5200640 1 -- 172.21.15.88:0/4124810134 learned_addr learned my addr 172.21.15.88:0/4124810134 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2afe00640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b006d920 0x7fd2b00b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2af400640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b009be30 0x7fd2b00b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2b5200640 1 -- 172.21.15.88:0/4124810134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b009be30 msgr2=0x7fd2b00b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2b5200640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b009be30 0x7fd2b00b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2b5200640 1 -- 172.21.15.88:0/4124810134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b006d920 msgr2=0x7fd2b00b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2b5200640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b006d920 0x7fd2b00b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2b5200640 1 -- 172.21.15.88:0/4124810134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b00703f0 con 0x7fd2b00b9d90 2024-04-24T08:25:23.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2af400640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b009be30 0x7fd2b00b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:23.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2b5200640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2b00b9d90 0x7fd2b00b1130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800c3c0 tx=0x7fd2a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:23.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2a7e00640 1 -- 172.21.15.88:0/4124810134 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8011790 con 0x7fd2b00b9d90 2024-04-24T08:25:23.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2a7e00640 1 -- 172.21.15.88:0/4124810134 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a8017070 con 0x7fd2b00b9d90 2024-04-24T08:25:23.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2a7e00640 1 -- 172.21.15.88:0/4124810134 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8011b70 con 0x7fd2b00b9d90 2024-04-24T08:25:23.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2b7200640 1 -- 172.21.15.88:0/4124810134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b01deed0 con 0x7fd2b00b9d90 2024-04-24T08:25:23.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2b7200640 1 -- 172.21.15.88:0/4124810134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b013f700 con 0x7fd2b00b9d90 2024-04-24T08:25:23.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2b7200640 1 -- 172.21.15.88:0/4124810134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b0068b90 con 0x7fd2b00b9d90 2024-04-24T08:25:23.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2a7e00640 1 -- 172.21.15.88:0/4124810134 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd2a8011d10 con 0x7fd2b00b9d90 2024-04-24T08:25:23.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2a7e00640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd290068380 0x7fd29006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:23.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2a7e00640 1 -- 172.21.15.88:0/4124810134 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd2a8086480 con 0x7fd2b00b9d90 2024-04-24T08:25:23.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.578+0000 7fd2afe00640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd290068380 0x7fd29006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:23.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.582+0000 7fd2afe00640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd290068380 0x7fd29006a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0005c10 tx=0x7fd2a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:23.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.586+0000 7fd2a7e00640 1 -- 172.21.15.88:0/4124810134 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd2a8056d80 con 0x7fd2b00b9d90 2024-04-24T08:25:23.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.770+0000 7fd2b7200640 1 -- 172.21.15.88:0/4124810134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2b006d700 con 0x7fd2b00b9d90 2024-04-24T08:25:23.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2a7e00640 1 -- 172.21.15.88:0/4124810134 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2219 (secure 0 0 0) 0x7fd2a8056680 con 0x7fd2b00b9d90 2024-04-24T08:25:23.777 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:23.777 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1421585339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1421585339},{"type":"v1","addr":"172.21.15.142:6833","nonce":1421585339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2851985776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2851985776},{"type":"v1","addr":"172.21.15.88:6835","nonce":2851985776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-24T08:25:23.777 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 3 2024-04-24T08:25:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2b7200640 1 -- 172.21.15.88:0/4124810134 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd290068380 msgr2=0x7fd29006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2b7200640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd290068380 0x7fd29006a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0005c10 tx=0x7fd2a0009040 comp rx=0 tx=0).stop 2024-04-24T08:25:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2b7200640 1 -- 172.21.15.88:0/4124810134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2b00b9d90 msgr2=0x7fd2b00b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2b7200640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2b00b9d90 0x7fd2b00b1130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800c3c0 tx=0x7fd2a800c880 comp rx=0 tx=0).stop 2024-04-24T08:25:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2b7200640 1 -- 172.21.15.88:0/4124810134 shutdown_connections 2024-04-24T08:25:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2b7200640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd290068380 0x7fd29006a840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2b7200640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2b00b9d90 0x7fd2b00b1130 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2b7200640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b009be30 0x7fd2b00b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2b7200640 1 --2- 172.21.15.88:0/4124810134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b006d920 0x7fd2b00b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2b7200640 1 -- 172.21.15.88:0/4124810134 >> 172.21.15.88:0/4124810134 conn(0x7fd2b006c0d0 msgr2=0x7fd2b00aec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2b7200640 1 -- 172.21.15.88:0/4124810134 shutdown_connections 2024-04-24T08:25:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.774+0000 7fd2b7200640 1 -- 172.21.15.88:0/4124810134 wait complete. 2024-04-24T08:25:23.798 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:23.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3929600640 1 Processor -- start 2024-04-24T08:25:23.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3929600640 1 -- start start 2024-04-24T08:25:23.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3929600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39240b9d90 0x7f39241450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:23.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3929600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3924145620 con 0x7f39240b4970 2024-04-24T08:25:23.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3929600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3924148f50 con 0x7f39240b44e0 2024-04-24T08:25:23.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3929600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f39240b4de0 con 0x7f39240b9d90 2024-04-24T08:25:23.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3923400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f39240b4970 0x7f3924148840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40822/0 (socket says 172.21.15.88:40822) 2024-04-24T08:25:23.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3922a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39240b9d90 0x7f39241450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:23.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3923400640 1 -- 172.21.15.88:0/175691286 learned_addr learned my addr 172.21.15.88:0/175691286 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:23.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3922a00640 1 -- 172.21.15.88:0/175691286 >> v1:172.21.15.142:6789/0 conn(0x7f39240b44e0 legacy=0x7f3924148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:23.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3922a00640 1 -- 172.21.15.88:0/175691286 >> v1:172.21.15.88:6789/0 conn(0x7f39240b4970 legacy=0x7f3924148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:23.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3922a00640 1 -- 172.21.15.88:0/175691286 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39240ba170 con 0x7f39240b9d90 2024-04-24T08:25:23.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.930+0000 7f3921600640 1 -- 172.21.15.88:0/175691286 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 637819634 0 0) 0x7f391c0014a0 con 0x7f39240b4970 2024-04-24T08:25:23.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.934+0000 7f3922a00640 1 --2- 172.21.15.88:0/175691286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39240b9d90 0x7f39241450e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f39140097f0 tx=0x7f391401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d6df1fce4e31f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:23.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.934+0000 7f3921600640 1 -- 172.21.15.88:0/175691286 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39140b0070 con 0x7f39240b9d90 2024-04-24T08:25:23.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.934+0000 7f3921600640 1 -- 172.21.15.88:0/175691286 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39140ab600 con 0x7f39240b9d90 2024-04-24T08:25:23.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.934+0000 7f3921600640 1 -- 172.21.15.88:0/175691286 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39140a4e60 con 0x7f39240b9d90 2024-04-24T08:25:23.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.934+0000 7f3929600640 1 -- 172.21.15.88:0/175691286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39240b9d90 msgr2=0x7f39241450e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:23.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.934+0000 7f3929600640 1 --2- 172.21.15.88:0/175691286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39240b9d90 0x7f39241450e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f39140097f0 tx=0x7f391401c3d0 comp rx=0 tx=0).stop 2024-04-24T08:25:23.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.934+0000 7f3929600640 1 -- 172.21.15.88:0/175691286 shutdown_connections 2024-04-24T08:25:23.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.934+0000 7f3929600640 1 --2- 172.21.15.88:0/175691286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39240b9d90 0x7f39241450e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:23.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.934+0000 7f3929600640 1 -- 172.21.15.88:0/175691286 >> 172.21.15.88:0/175691286 conn(0x7f392406c0d0 msgr2=0x7f39240b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:23.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.934+0000 7f3929600640 1 -- 172.21.15.88:0/175691286 shutdown_connections 2024-04-24T08:25:23.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.934+0000 7f3929600640 1 -- 172.21.15.88:0/175691286 wait complete. 2024-04-24T08:25:23.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.934+0000 7f3929600640 1 Processor -- start 2024-04-24T08:25:23.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3929600640 1 -- start start 2024-04-24T08:25:23.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3929600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39240b44e0 0x7f39240b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:23.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3929600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39240b4970 0x7f39240711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:23.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3929600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39240b9d90 0x7f392414d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:23.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3929600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f392409e3d0 con 0x7f39240b4970 2024-04-24T08:25:23.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3929600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3924152ea0 con 0x7f39240b44e0 2024-04-24T08:25:23.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3929600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3924071720 con 0x7f39240b9d90 2024-04-24T08:25:23.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3922000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39240b4970 0x7f39240711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:23.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3922000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39240b4970 0x7f39240711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35618/0 (socket says 172.21.15.88:35618) 2024-04-24T08:25:23.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3922000640 1 -- 172.21.15.88:0/2595956636 learned_addr learned my addr 172.21.15.88:0/2595956636 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:23.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3923400640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39240b9d90 0x7f392414d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:23.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3922a00640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39240b44e0 0x7f39240b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:23.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3922000640 1 -- 172.21.15.88:0/2595956636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39240b9d90 msgr2=0x7f392414d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:23.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3922000640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39240b9d90 0x7f392414d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:23.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3922000640 1 -- 172.21.15.88:0/2595956636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39240b44e0 msgr2=0x7f39240b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:23.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3922000640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39240b44e0 0x7f39240b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:23.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3922000640 1 -- 172.21.15.88:0/2595956636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39240719d0 con 0x7f39240b4970 2024-04-24T08:25:23.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3922000640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39240b4970 0x7f39240711e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f391000c480 tx=0x7f391000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:23.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f391aa00640 1 -- 172.21.15.88:0/2595956636 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910012830 con 0x7f39240b4970 2024-04-24T08:25:23.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f391aa00640 1 -- 172.21.15.88:0/2595956636 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3910017070 con 0x7f39240b4970 2024-04-24T08:25:23.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f391aa00640 1 -- 172.21.15.88:0/2595956636 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910012c30 con 0x7f39240b4970 2024-04-24T08:25:23.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3929600640 1 -- 172.21.15.88:0/2595956636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392414f020 con 0x7f39240b4970 2024-04-24T08:25:23.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3929600640 1 -- 172.21.15.88:0/2595956636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3924070b90 con 0x7f39240b4970 2024-04-24T08:25:23.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.938+0000 7f3929600640 1 -- 172.21.15.88:0/2595956636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3924068b90 con 0x7f39240b4970 2024-04-24T08:25:23.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.942+0000 7f391aa00640 1 -- 172.21.15.88:0/2595956636 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f391001c460 con 0x7f39240b4970 2024-04-24T08:25:23.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.942+0000 7f391aa00640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3904068380 0x7f390406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:23.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.942+0000 7f391aa00640 1 -- 172.21.15.88:0/2595956636 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f39100864d0 con 0x7f39240b4970 2024-04-24T08:25:23.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.942+0000 7f3922a00640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3904068380 0x7f390406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:23.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.942+0000 7f3922a00640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3904068380 0x7f390406a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f39140ad000 tx=0x7f39140a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:23.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:23.946+0000 7f391aa00640 1 -- 172.21.15.88:0/2595956636 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3910056dd0 con 0x7f39240b4970 2024-04-24T08:25:24.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.102+0000 7f3929600640 1 -- 172.21.15.88:0/2595956636 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3924146d30 con 0x7f39240b4970 2024-04-24T08:25:24.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f391aa00640 1 -- 172.21.15.88:0/2595956636 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f39100566d0 con 0x7f39240b4970 2024-04-24T08:25:24.109 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:24.109 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:17.313377+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:24.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f3929600640 1 -- 172.21.15.88:0/2595956636 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3904068380 msgr2=0x7f390406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f3929600640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3904068380 0x7f390406a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f39140ad000 tx=0x7f39140a6000 comp rx=0 tx=0).stop 2024-04-24T08:25:24.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f3929600640 1 -- 172.21.15.88:0/2595956636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39240b4970 msgr2=0x7f39240711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f3929600640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39240b4970 0x7f39240711e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f391000c480 tx=0x7f391000c940 comp rx=0 tx=0).stop 2024-04-24T08:25:24.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f3929600640 1 -- 172.21.15.88:0/2595956636 shutdown_connections 2024-04-24T08:25:24.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f3929600640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3904068380 0x7f390406a840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f3929600640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39240b9d90 0x7f392414d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f3929600640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39240b4970 0x7f39240711e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f3929600640 1 --2- 172.21.15.88:0/2595956636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39240b44e0 0x7f39240b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f3929600640 1 -- 172.21.15.88:0/2595956636 >> 172.21.15.88:0/2595956636 conn(0x7f392406c0d0 msgr2=0x7f39240b8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:24.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f3929600640 1 -- 172.21.15.88:0/2595956636 shutdown_connections 2024-04-24T08:25:24.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.106+0000 7f3929600640 1 -- 172.21.15.88:0/2595956636 wait complete. 2024-04-24T08:25:24.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:25:24.130 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:25:24.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.262+0000 7efc87600640 1 Processor -- start 2024-04-24T08:25:24.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.262+0000 7efc87600640 1 -- start start 2024-04-24T08:25:24.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc87600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc80146690 0x7efc8009e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc87600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc8006e490 0x7efc8009e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc87600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc8006d4f0 con 0x7efc800b4c90 2024-04-24T08:25:24.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc87600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7efc8006d2a0 con 0x7efc8006e490 2024-04-24T08:25:24.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc87600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7efc8006d7d0 con 0x7efc80146690 2024-04-24T08:25:24.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc85600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc8006e490 0x7efc8009e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc84c00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efc800b4c90 0x7efc80145f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40828/0 (socket says 172.21.15.88:40828) 2024-04-24T08:25:24.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc84c00640 1 -- 172.21.15.88:0/3988446375 learned_addr learned my addr 172.21.15.88:0/3988446375 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:24.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc77e00640 1 --2- 172.21.15.88:0/3988446375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc80146690 0x7efc8009e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc85600640 1 -- 172.21.15.88:0/3988446375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc80146690 msgr2=0x7efc8009e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:24.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc85600640 1 --2- 172.21.15.88:0/3988446375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc80146690 0x7efc8009e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc85600640 1 -- 172.21.15.88:0/3988446375 >> v1:172.21.15.88:6789/0 conn(0x7efc800b4c90 legacy=0x7efc80145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc85600640 1 -- 172.21.15.88:0/3988446375 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc8009c570 con 0x7efc8006e490 2024-04-24T08:25:24.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.266+0000 7efc77e00640 1 --2- 172.21.15.88:0/3988446375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc80146690 0x7efc8009e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:24.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc85600640 1 --2- 172.21.15.88:0/3988446375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc8006e490 0x7efc8009e5d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc78009d90 tx=0x7efc7801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fceb80ffa26dc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:24.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc7fe00640 1 -- 172.21.15.88:0/3988446375 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780b2070 con 0x7efc8006e490 2024-04-24T08:25:24.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc7fe00640 1 -- 172.21.15.88:0/3988446375 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc780a57a0 con 0x7efc8006e490 2024-04-24T08:25:24.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc7fe00640 1 -- 172.21.15.88:0/3988446375 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780a5b70 con 0x7efc8006e490 2024-04-24T08:25:24.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 -- 172.21.15.88:0/3988446375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc8006e490 msgr2=0x7efc8009e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 --2- 172.21.15.88:0/3988446375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc8006e490 0x7efc8009e5d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc78009d90 tx=0x7efc7801c8e0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 -- 172.21.15.88:0/3988446375 shutdown_connections 2024-04-24T08:25:24.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 --2- 172.21.15.88:0/3988446375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc8006e490 0x7efc8009e5d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 --2- 172.21.15.88:0/3988446375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc80146690 0x7efc8009e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 -- 172.21.15.88:0/3988446375 >> 172.21.15.88:0/3988446375 conn(0x7efc800b9690 msgr2=0x7efc800b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:24.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 -- 172.21.15.88:0/3988446375 shutdown_connections 2024-04-24T08:25:24.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 -- 172.21.15.88:0/3988446375 wait complete. 2024-04-24T08:25:24.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 Processor -- start 2024-04-24T08:25:24.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 -- start start 2024-04-24T08:25:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc8006e490 0x7efc801e0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc800b4c90 0x7efc80148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc80146690 0x7efc801e38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efc80152fc0 con 0x7efc80146690 2024-04-24T08:25:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7efc80152e40 con 0x7efc8006e490 2024-04-24T08:25:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc87600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7efc80153140 con 0x7efc800b4c90 2024-04-24T08:25:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc85600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc80146690 0x7efc801e38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc85600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc80146690 0x7efc801e38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35634/0 (socket says 172.21.15.88:35634) 2024-04-24T08:25:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc85600640 1 -- 172.21.15.88:0/321697696 learned_addr learned my addr 172.21.15.88:0/321697696 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc77e00640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc800b4c90 0x7efc80148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.270+0000 7efc84c00640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc8006e490 0x7efc801e0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc85600640 1 -- 172.21.15.88:0/321697696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc800b4c90 msgr2=0x7efc80148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc85600640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc800b4c90 0x7efc80148c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc85600640 1 -- 172.21.15.88:0/321697696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc8006e490 msgr2=0x7efc801e0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc85600640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc8006e490 0x7efc801e0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc85600640 1 -- 172.21.15.88:0/321697696 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc801e0360 con 0x7efc80146690 2024-04-24T08:25:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc77e00640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc800b4c90 0x7efc80148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc84c00640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc8006e490 0x7efc801e0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc85600640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc80146690 0x7efc801e38d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc780b0040 tx=0x7efc78019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:24.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc7d600640 1 -- 172.21.15.88:0/321697696 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780b2050 con 0x7efc80146690 2024-04-24T08:25:24.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc7d600640 1 -- 172.21.15.88:0/321697696 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc780be070 con 0x7efc80146690 2024-04-24T08:25:24.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc87600640 1 -- 172.21.15.88:0/321697696 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc801e0620 con 0x7efc80146690 2024-04-24T08:25:24.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc7d600640 1 -- 172.21.15.88:0/321697696 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780ada90 con 0x7efc80146690 2024-04-24T08:25:24.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc87600640 1 -- 172.21.15.88:0/321697696 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc80146c90 con 0x7efc80146690 2024-04-24T08:25:24.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc87600640 1 -- 172.21.15.88:0/321697696 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc80068c00 con 0x7efc80146690 2024-04-24T08:25:24.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc7d600640 1 -- 172.21.15.88:0/321697696 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc780adc30 con 0x7efc80146690 2024-04-24T08:25:24.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc7d600640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efc5c0683b0 0x7efc5c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.274+0000 7efc7d600640 1 -- 172.21.15.88:0/321697696 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7efc781216c0 con 0x7efc80146690 2024-04-24T08:25:24.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.278+0000 7efc84c00640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efc5c0683b0 0x7efc5c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.278+0000 7efc84c00640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efc5c0683b0 0x7efc5c06a870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efc70000f70 tx=0x7efc70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:24.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.278+0000 7efc7d600640 1 -- 172.21.15.88:0/321697696 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efc78016560 con 0x7efc80146690 2024-04-24T08:25:24.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.434+0000 7efc87600640 1 -- 172.21.15.88:0/321697696 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efc80143150 con 0x7efc80146690 2024-04-24T08:25:24.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc7d600640 1 -- 172.21.15.88:0/321697696 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7efc780ab340 con 0x7efc80146690 2024-04-24T08:25:24.441 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:25:24.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc87600640 1 -- 172.21.15.88:0/321697696 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efc5c0683b0 msgr2=0x7efc5c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc87600640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efc5c0683b0 0x7efc5c06a870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efc70000f70 tx=0x7efc70009040 comp rx=0 tx=0).stop 2024-04-24T08:25:24.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc87600640 1 -- 172.21.15.88:0/321697696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc80146690 msgr2=0x7efc801e38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc87600640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc80146690 0x7efc801e38d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc780b0040 tx=0x7efc78019680 comp rx=0 tx=0).stop 2024-04-24T08:25:24.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc87600640 1 -- 172.21.15.88:0/321697696 shutdown_connections 2024-04-24T08:25:24.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc87600640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efc5c0683b0 0x7efc5c06a870 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc87600640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc80146690 0x7efc801e38d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc87600640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc800b4c90 0x7efc80148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc87600640 1 --2- 172.21.15.88:0/321697696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc8006e490 0x7efc801e0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc87600640 1 -- 172.21.15.88:0/321697696 >> 172.21.15.88:0/321697696 conn(0x7efc800b9690 msgr2=0x7efc8009b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:24.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc87600640 1 -- 172.21.15.88:0/321697696 shutdown_connections 2024-04-24T08:25:24.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.438+0000 7efc87600640 1 -- 172.21.15.88:0/321697696 wait complete. 2024-04-24T08:25:24.462 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-24T08:25:24.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.590+0000 7f4d06e00640 1 Processor -- start 2024-04-24T08:25:24.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.590+0000 7f4d06e00640 1 -- start start 2024-04-24T08:25:24.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4d06e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d0009be30 0x7f4d00145f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4d06e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4d0006d920 0x7f4d001504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4d06e00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d000ba170 con 0x7f4d000b9d90 2024-04-24T08:25:24.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4d06e00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0009cd30 con 0x7f4d0009be30 2024-04-24T08:25:24.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4d06e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4d00146460 con 0x7f4d0006d920 2024-04-24T08:25:24.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4cffe00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4d000b9d90 0x7f4d0006d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40844/0 (socket says 172.21.15.88:40844) 2024-04-24T08:25:24.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4cff400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d0009be30 0x7f4d00145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4cffe00640 1 -- 172.21.15.88:0/2997150015 learned_addr learned my addr 172.21.15.88:0/2997150015 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:24.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4d04e00640 1 --2- 172.21.15.88:0/2997150015 >> v2:172.21.15.142:3300/0 conn(0x7f4d0006d920 0x7f4d001504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4cfea00640 1 -- 172.21.15.88:0/2997150015 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683333535 0 0) 0x7f4d000ba170 con 0x7f4d000b9d90 2024-04-24T08:25:24.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4cfea00640 1 -- 172.21.15.88:0/2997150015 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ce4003530 con 0x7f4d000b9d90 2024-04-24T08:25:24.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4cff400640 1 -- 172.21.15.88:0/2997150015 >> v2:172.21.15.142:3300/0 conn(0x7f4d0006d920 msgr2=0x7f4d001504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:24.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4cff400640 1 --2- 172.21.15.88:0/2997150015 >> v2:172.21.15.142:3300/0 conn(0x7f4d0006d920 0x7f4d001504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4cff400640 1 -- 172.21.15.88:0/2997150015 >> v1:172.21.15.88:6789/0 conn(0x7f4d000b9d90 legacy=0x7f4d0006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4cff400640 1 -- 172.21.15.88:0/2997150015 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0014a060 con 0x7f4d0009be30 2024-04-24T08:25:24.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.594+0000 7f4d04e00640 1 --2- 172.21.15.88:0/2997150015 >> v2:172.21.15.142:3300/0 conn(0x7f4d0006d920 0x7f4d001504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:24.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4cff400640 1 --2- 172.21.15.88:0/2997150015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d0009be30 0x7f4d00145f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d0009c6d0 tx=0x7f4cf001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae7231bedcadab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:24.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4cfea00640 1 -- 172.21.15.88:0/2997150015 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00b0070 con 0x7f4d0009be30 2024-04-24T08:25:24.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4cfea00640 1 -- 172.21.15.88:0/2997150015 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf00ab600 con 0x7f4d0009be30 2024-04-24T08:25:24.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4cfea00640 1 -- 172.21.15.88:0/2997150015 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00ab9d0 con 0x7f4d0009be30 2024-04-24T08:25:24.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 -- 172.21.15.88:0/2997150015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d0009be30 msgr2=0x7f4d00145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 --2- 172.21.15.88:0/2997150015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d0009be30 0x7f4d00145f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d0009c6d0 tx=0x7f4cf001c340 comp rx=0 tx=0).stop 2024-04-24T08:25:24.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 -- 172.21.15.88:0/2997150015 shutdown_connections 2024-04-24T08:25:24.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 --2- 172.21.15.88:0/2997150015 >> v2:172.21.15.142:3300/0 conn(0x7f4d0006d920 0x7f4d001504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 --2- 172.21.15.88:0/2997150015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d0009be30 0x7f4d00145f20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 -- 172.21.15.88:0/2997150015 >> 172.21.15.88:0/2997150015 conn(0x7f4d0006c0d0 msgr2=0x7f4d000b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:24.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 -- 172.21.15.88:0/2997150015 shutdown_connections 2024-04-24T08:25:24.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 -- 172.21.15.88:0/2997150015 wait complete. 2024-04-24T08:25:24.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 Processor -- start 2024-04-24T08:25:24.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 -- start start 2024-04-24T08:25:24.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d0006d920 0x7f4d00148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d0009be30 0x7f4d001e3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d000b9d90 0x7f4d001e4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4d000b3fa0 con 0x7f4d000b9d90 2024-04-24T08:25:24.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4d000b3e20 con 0x7f4d0006d920 2024-04-24T08:25:24.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d06e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4d00153240 con 0x7f4d0009be30 2024-04-24T08:25:24.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.598+0000 7f4d04e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d000b9d90 0x7f4d001e4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4d04e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d000b9d90 0x7f4d001e4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35646/0 (socket says 172.21.15.88:35646) 2024-04-24T08:25:24.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4d04e00640 1 -- 172.21.15.88:0/1039613390 learned_addr learned my addr 172.21.15.88:0/1039613390 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:24.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4cffe00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d0006d920 0x7f4d00148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4cff400640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d0009be30 0x7f4d001e3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4d04e00640 1 -- 172.21.15.88:0/1039613390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d0009be30 msgr2=0x7f4d001e3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4d04e00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d0009be30 0x7f4d001e3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4d04e00640 1 -- 172.21.15.88:0/1039613390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d0006d920 msgr2=0x7f4d00148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4d04e00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d0006d920 0x7f4d00148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4d04e00640 1 -- 172.21.15.88:0/1039613390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d00147e40 con 0x7f4d000b9d90 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4cffe00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d0006d920 0x7f4d00148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4cff400640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d0009be30 0x7f4d001e3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4d04e00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d000b9d90 0x7f4d001e4410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800cf20 tx=0x7f4cf800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4cf7e00640 1 -- 172.21.15.88:0/1039613390 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf801a070 con 0x7f4d000b9d90 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4cf7e00640 1 -- 172.21.15.88:0/1039613390 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf800d840 con 0x7f4d000b9d90 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4cf7e00640 1 -- 172.21.15.88:0/1039613390 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800dc30 con 0x7f4d000b9d90 2024-04-24T08:25:24.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4d06e00640 1 -- 172.21.15.88:0/1039613390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d000b89d0 con 0x7f4d000b9d90 2024-04-24T08:25:24.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4d06e00640 1 -- 172.21.15.88:0/1039613390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d000b2bb0 con 0x7f4d000b9d90 2024-04-24T08:25:24.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4d06e00640 1 -- 172.21.15.88:0/1039613390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d00068b90 con 0x7f4d000b9d90 2024-04-24T08:25:24.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.602+0000 7f4cf7e00640 1 -- 172.21.15.88:0/1039613390 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4cf801d070 con 0x7f4d000b9d90 2024-04-24T08:25:24.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.606+0000 7f4cf7e00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4cdc068380 0x7f4cdc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.606+0000 7f4cf7e00640 1 -- 172.21.15.88:0/1039613390 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4cf8086e90 con 0x7f4d000b9d90 2024-04-24T08:25:24.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.606+0000 7f4cffe00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4cdc068380 0x7f4cdc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.606+0000 7f4cffe00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4cdc068380 0x7f4cdc06a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8005890 tx=0x7f4ce8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:24.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.610+0000 7f4cf7e00640 1 -- 172.21.15.88:0/1039613390 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4cf8057830 con 0x7f4d000b9d90 2024-04-24T08:25:24.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 -- 172.21.15.88:0/1039613390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4d000ba170 con 0x7f4d000b9d90 2024-04-24T08:25:24.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4cf7e00640 1 -- 172.21.15.88:0/1039613390 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f4cf8057130 con 0x7f4d000b9d90 2024-04-24T08:25:24.770 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:24.770 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2024-04-24T08:25:24.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:25:24.771 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2024-04-24T08:25:24.771 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2024-04-24T08:25:24.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:25:24.771 INFO:teuthology.orchestra.run.smithi088.stdout:] 2024-04-24T08:25:24.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 -- 172.21.15.88:0/1039613390 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4cdc068380 msgr2=0x7f4cdc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4cdc068380 0x7f4cdc06a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8005890 tx=0x7f4ce8009040 comp rx=0 tx=0).stop 2024-04-24T08:25:24.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 -- 172.21.15.88:0/1039613390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d000b9d90 msgr2=0x7f4d001e4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d000b9d90 0x7f4d001e4410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800cf20 tx=0x7f4cf800a7d0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 -- 172.21.15.88:0/1039613390 shutdown_connections 2024-04-24T08:25:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4cdc068380 0x7f4cdc06a840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d000b9d90 0x7f4d001e4410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d0009be30 0x7f4d001e3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 --2- 172.21.15.88:0/1039613390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d0006d920 0x7f4d00148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 -- 172.21.15.88:0/1039613390 >> 172.21.15.88:0/1039613390 conn(0x7f4d0006c0d0 msgr2=0x7f4d001450c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 -- 172.21.15.88:0/1039613390 shutdown_connections 2024-04-24T08:25:24.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.766+0000 7f4d06e00640 1 -- 172.21.15.88:0/1039613390 wait complete. 2024-04-24T08:25:24.792 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-24T08:25:24.792 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-24T08:25:24.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b6e00640 1 Processor -- start 2024-04-24T08:25:24.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b6e00640 1 -- start start 2024-04-24T08:25:24.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b6e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93b00b6500 0x7f93b00b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b6e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93b014e3d0 0x7f93b01507c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b6e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93b00b68e0 con 0x7f93b00b29d0 2024-04-24T08:25:24.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b6e00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f93b00b44e0 con 0x7f93b014e3d0 2024-04-24T08:25:24.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b6e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f93b00b3a00 con 0x7f93b00b6500 2024-04-24T08:25:24.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b4e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93b014e3d0 0x7f93b01507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b4e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93b014e3d0 0x7f93b01507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35652/0 (socket says 172.21.15.88:35652) 2024-04-24T08:25:24.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b4e00640 1 -- 172.21.15.88:0/9278111 learned_addr learned my addr 172.21.15.88:0/9278111 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:24.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93afe00640 1 --2- 172.21.15.88:0/9278111 >> v2:172.21.15.142:3300/0 conn(0x7f93b00b6500 0x7f93b00b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b4e00640 1 -- 172.21.15.88:0/9278111 >> v2:172.21.15.142:3300/0 conn(0x7f93b00b6500 msgr2=0x7f93b00b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:24.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b4e00640 1 --2- 172.21.15.88:0/9278111 >> v2:172.21.15.142:3300/0 conn(0x7f93b00b6500 0x7f93b00b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b4e00640 1 -- 172.21.15.88:0/9278111 >> v1:172.21.15.142:6789/0 conn(0x7f93b00b29d0 legacy=0x7f93b013fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.926+0000 7f93b4e00640 1 -- 172.21.15.88:0/9278111 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b00b7c50 con 0x7f93b014e3d0 2024-04-24T08:25:24.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.930+0000 7f93b4e00640 1 --2- 172.21.15.88:0/9278111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b014e3d0 0x7f93b01507c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f93b00705b0 tx=0x7f93a801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1e6ffde01c1856 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:24.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.930+0000 7f93aea00640 1 -- 172.21.15.88:0/9278111 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a80a57a0 con 0x7f93b014e3d0 2024-04-24T08:25:24.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.930+0000 7f93aea00640 1 -- 172.21.15.88:0/9278111 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a80a5940 con 0x7f93b014e3d0 2024-04-24T08:25:24.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.930+0000 7f93aea00640 1 -- 172.21.15.88:0/9278111 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a80a5d10 con 0x7f93b014e3d0 2024-04-24T08:25:24.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.930+0000 7f93b6e00640 1 -- 172.21.15.88:0/9278111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b014e3d0 msgr2=0x7f93b01507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.930+0000 7f93b6e00640 1 --2- 172.21.15.88:0/9278111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b014e3d0 0x7f93b01507c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f93b00705b0 tx=0x7f93a801c9f0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.930+0000 7f93b6e00640 1 -- 172.21.15.88:0/9278111 shutdown_connections 2024-04-24T08:25:24.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.930+0000 7f93b6e00640 1 --2- 172.21.15.88:0/9278111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b014e3d0 0x7f93b01507c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.930+0000 7f93b6e00640 1 --2- 172.21.15.88:0/9278111 >> v2:172.21.15.142:3300/0 conn(0x7f93b00b6500 0x7f93b00b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.930+0000 7f93b6e00640 1 -- 172.21.15.88:0/9278111 >> 172.21.15.88:0/9278111 conn(0x7f93b00bb4d0 msgr2=0x7f93b00bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:24.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.930+0000 7f93b6e00640 1 -- 172.21.15.88:0/9278111 shutdown_connections 2024-04-24T08:25:24.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.930+0000 7f93b6e00640 1 -- 172.21.15.88:0/9278111 wait complete. 2024-04-24T08:25:24.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b6e00640 1 Processor -- start 2024-04-24T08:25:24.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b6e00640 1 -- start start 2024-04-24T08:25:24.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b6e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b00b29d0 0x7f93b0140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b6e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b00b6500 0x7f93b0142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b6e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b014e3d0 0x7f93b013cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b6e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f93b00b73a0 con 0x7f93b00b6500 2024-04-24T08:25:24.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b6e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f93b00b7220 con 0x7f93b00b29d0 2024-04-24T08:25:24.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b6e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f93b0140120 con 0x7f93b014e3d0 2024-04-24T08:25:24.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93af400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b00b6500 0x7f93b0142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93af400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b00b6500 0x7f93b0142fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35660/0 (socket says 172.21.15.88:35660) 2024-04-24T08:25:24.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93af400640 1 -- 172.21.15.88:0/2734798249 learned_addr learned my addr 172.21.15.88:0/2734798249 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:24.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93afe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b00b29d0 0x7f93b0140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b4e00640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b014e3d0 0x7f93b013cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93af400640 1 -- 172.21.15.88:0/2734798249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b014e3d0 msgr2=0x7f93b013cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93af400640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b014e3d0 0x7f93b013cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93af400640 1 -- 172.21.15.88:0/2734798249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b00b29d0 msgr2=0x7f93b0140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:24.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93af400640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b00b29d0 0x7f93b0140ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:24.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93af400640 1 -- 172.21.15.88:0/2734798249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b0142b40 con 0x7f93b00b6500 2024-04-24T08:25:24.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b4e00640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b014e3d0 0x7f93b013cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:24.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93af400640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b00b6500 0x7f93b0142fd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f939c00c450 tx=0x7f939c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:24.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93a7e00640 1 -- 172.21.15.88:0/2734798249 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c016020 con 0x7f93b00b6500 2024-04-24T08:25:24.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93a7e00640 1 -- 172.21.15.88:0/2734798249 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939c0052d0 con 0x7f93b00b6500 2024-04-24T08:25:24.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93a7e00640 1 -- 172.21.15.88:0/2734798249 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c007260 con 0x7f93b00b6500 2024-04-24T08:25:24.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b6e00640 1 -- 172.21.15.88:0/2734798249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b0140630 con 0x7f93b00b6500 2024-04-24T08:25:24.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b6e00640 1 -- 172.21.15.88:0/2734798249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b01415c0 con 0x7f93b00b6500 2024-04-24T08:25:24.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.934+0000 7f93b6e00640 1 -- 172.21.15.88:0/2734798249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b01417c0 con 0x7f93b00b6500 2024-04-24T08:25:24.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.938+0000 7f93a7e00640 1 -- 172.21.15.88:0/2734798249 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f939c007400 con 0x7f93b00b6500 2024-04-24T08:25:24.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.938+0000 7f93a7e00640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9390068380 0x7f939006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:24.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.938+0000 7f93a7e00640 1 -- 172.21.15.88:0/2734798249 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f939c085f20 con 0x7f93b00b6500 2024-04-24T08:25:24.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.938+0000 7f93afe00640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9390068380 0x7f939006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:24.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.938+0000 7f93afe00640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9390068380 0x7f939006a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f93b00b29a0 tx=0x7f93a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:24.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:24.942+0000 7f93a7e00640 1 -- 172.21.15.88:0/2734798249 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f93b01417c0 con 0x7f93b00b6500 2024-04-24T08:25:25.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:25.102+0000 7f93b6e00640 1 -- 172.21.15.88:0/2734798249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f93b0068ca0 con 0x7f93b00b6500 2024-04-24T08:25:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.074+0000 7f93a7e00640 1 -- 172.21.15.88:0/2734798249 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f939c020020 con 0x7f93b00b6500 2024-04-24T08:25:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2024-04-24T08:25:26.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.078+0000 7f93b6e00640 1 -- 172.21.15.88:0/2734798249 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9390068380 msgr2=0x7f939006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:26.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.078+0000 7f93b6e00640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9390068380 0x7f939006a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f93b00b29a0 tx=0x7f93a0008040 comp rx=0 tx=0).stop 2024-04-24T08:25:26.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.078+0000 7f93b6e00640 1 -- 172.21.15.88:0/2734798249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b00b6500 msgr2=0x7f93b0142fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:26.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.078+0000 7f93b6e00640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b00b6500 0x7f93b0142fd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f939c00c450 tx=0x7f939c00c910 comp rx=0 tx=0).stop 2024-04-24T08:25:26.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.078+0000 7f93b6e00640 1 -- 172.21.15.88:0/2734798249 shutdown_connections 2024-04-24T08:25:26.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.078+0000 7f93b6e00640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9390068380 0x7f939006a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:26.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.078+0000 7f93b6e00640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b014e3d0 0x7f93b013cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:26.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.078+0000 7f93b6e00640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b00b6500 0x7f93b0142fd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:26.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.078+0000 7f93b6e00640 1 --2- 172.21.15.88:0/2734798249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b00b29d0 0x7f93b0140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:26.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.078+0000 7f93b6e00640 1 -- 172.21.15.88:0/2734798249 >> 172.21.15.88:0/2734798249 conn(0x7f93b00bb4d0 msgr2=0x7f93b0074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:26.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.078+0000 7f93b6e00640 1 -- 172.21.15.88:0/2734798249 shutdown_connections 2024-04-24T08:25:26.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.078+0000 7f93b6e00640 1 -- 172.21.15.88:0/2734798249 wait complete. 2024-04-24T08:25:26.112 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-24T08:25:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc21da00640 1 Processor -- start 2024-04-24T08:25:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc21da00640 1 -- start start 2024-04-24T08:25:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc21da00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc21806e320 0x7fc21809d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc21da00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2181456c0 0x7fc21809ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc21da00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc218073e90 con 0x7fc21813ee40 2024-04-24T08:25:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc21da00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc21813f220 con 0x7fc2181456c0 2024-04-24T08:25:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc21da00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc218144a60 con 0x7fc21806e320 2024-04-24T08:25:26.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc217400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2181456c0 0x7fc21809ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:26.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc217400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2181456c0 0x7fc21809ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:59704/0 (socket says 172.21.15.88:59704) 2024-04-24T08:25:26.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc20e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc21806e320 0x7fc21809d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:26.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc217400640 1 -- 172.21.15.88:0/3479568682 learned_addr learned my addr 172.21.15.88:0/3479568682 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:26.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc217400640 1 -- 172.21.15.88:0/3479568682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc21806e320 msgr2=0x7fc21809d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:26.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc217400640 1 --2- 172.21.15.88:0/3479568682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc21806e320 0x7fc21809d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:26.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc217400640 1 -- 172.21.15.88:0/3479568682 >> v1:172.21.15.142:6789/0 conn(0x7fc21813ee40 legacy=0x7fc218144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:26.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.254+0000 7fc217400640 1 -- 172.21.15.88:0/3479568682 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21809e410 con 0x7fc2181456c0 2024-04-24T08:25:26.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc217400640 1 --2- 172.21.15.88:0/3479568682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2181456c0 0x7fc21809ded0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc210009e80 tx=0x7fc21001ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35d78fe15ef0b636 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:26.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc216000640 1 -- 172.21.15.88:0/3479568682 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2100a56e0 con 0x7fc2181456c0 2024-04-24T08:25:26.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc216000640 1 -- 172.21.15.88:0/3479568682 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2100a5880 con 0x7fc2181456c0 2024-04-24T08:25:26.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc216000640 1 -- 172.21.15.88:0/3479568682 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2100a5c50 con 0x7fc2181456c0 2024-04-24T08:25:26.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc21da00640 1 -- 172.21.15.88:0/3479568682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2181456c0 msgr2=0x7fc21809ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:26.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc21da00640 1 --2- 172.21.15.88:0/3479568682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2181456c0 0x7fc21809ded0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc210009e80 tx=0x7fc21001ca10 comp rx=0 tx=0).stop 2024-04-24T08:25:26.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc21da00640 1 -- 172.21.15.88:0/3479568682 shutdown_connections 2024-04-24T08:25:26.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc21da00640 1 --2- 172.21.15.88:0/3479568682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc21806e320 0x7fc21809d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:26.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc21da00640 1 --2- 172.21.15.88:0/3479568682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2181456c0 0x7fc21809ded0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:26.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc21da00640 1 -- 172.21.15.88:0/3479568682 >> 172.21.15.88:0/3479568682 conn(0x7fc2180b9390 msgr2=0x7fc2180b97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:26.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc21da00640 1 -- 172.21.15.88:0/3479568682 shutdown_connections 2024-04-24T08:25:26.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc21da00640 1 -- 172.21.15.88:0/3479568682 wait complete. 2024-04-24T08:25:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.258+0000 7fc21da00640 1 Processor -- start 2024-04-24T08:25:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc21da00640 1 -- start start 2024-04-24T08:25:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc21da00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc21806e320 0x7fc21814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc21da00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc21813ee40 0x7fc21813d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc21da00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2181456c0 0x7fc2180b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc21da00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc218151eb0 con 0x7fc21813ee40 2024-04-24T08:25:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc21da00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc218151d30 con 0x7fc21806e320 2024-04-24T08:25:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc21da00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc218152030 con 0x7fc2181456c0 2024-04-24T08:25:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc20e000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc21813ee40 0x7fc21813d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc20e000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc21813ee40 0x7fc21813d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35662/0 (socket says 172.21.15.88:35662) 2024-04-24T08:25:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc20e000640 1 -- 172.21.15.88:0/2369821630 learned_addr learned my addr 172.21.15.88:0/2369821630 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc217400640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2181456c0 0x7fc2180b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc216a00640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc21806e320 0x7fc21814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc20e000640 1 -- 172.21.15.88:0/2369821630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2181456c0 msgr2=0x7fc2180b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc20e000640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2181456c0 0x7fc2180b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc20e000640 1 -- 172.21.15.88:0/2369821630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc21806e320 msgr2=0x7fc21814e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc20e000640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc21806e320 0x7fc21814e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc20e000640 1 -- 172.21.15.88:0/2369821630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc218143cd0 con 0x7fc21813ee40 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc216a00640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc21806e320 0x7fc21814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc20e000640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc21813ee40 0x7fc21813d150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc20000e8d0 tx=0x7fc20000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc20f400640 1 -- 172.21.15.88:0/2369821630 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200017070 con 0x7fc21813ee40 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc20f400640 1 -- 172.21.15.88:0/2369821630 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20000c940 con 0x7fc21813ee40 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc20f400640 1 -- 172.21.15.88:0/2369821630 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20000ccf0 con 0x7fc21813ee40 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc21da00640 1 -- 172.21.15.88:0/2369821630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2180b8970 con 0x7fc21813ee40 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc21da00640 1 -- 172.21.15.88:0/2369821630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21813c890 con 0x7fc21813ee40 2024-04-24T08:25:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.262+0000 7fc21da00640 1 -- 172.21.15.88:0/2369821630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc218068b90 con 0x7fc21813ee40 2024-04-24T08:25:26.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.266+0000 7fc20f400640 1 -- 172.21.15.88:0/2369821630 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc20001a070 con 0x7fc21813ee40 2024-04-24T08:25:26.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.266+0000 7fc20f400640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc1f4068380 0x7fc1f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:26.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.266+0000 7fc20f400640 1 -- 172.21.15.88:0/2369821630 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fc200086d80 con 0x7fc21813ee40 2024-04-24T08:25:26.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.266+0000 7fc216a00640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc1f4068380 0x7fc1f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:26.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.266+0000 7fc216a00640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc1f4068380 0x7fc1f406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc208001710 tx=0x7fc208009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:26.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.270+0000 7fc20f400640 1 -- 172.21.15.88:0/2369821630 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc200056f40 con 0x7fc21813ee40 2024-04-24T08:25:26.304 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T08:25:26.307 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T08:25:26.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:26.430+0000 7fc21da00640 1 -- 172.21.15.88:0/2369821630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc21809c6c0 con 0x7fc21813ee40 2024-04-24T08:25:27.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.082+0000 7fc20f400640 1 -- 172.21.15.88:0/2369821630 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fc20005b240 con 0x7fc21813ee40 2024-04-24T08:25:27.086 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2024-04-24T08:25:27.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.082+0000 7fc21da00640 1 -- 172.21.15.88:0/2369821630 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc1f4068380 msgr2=0x7fc1f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:27.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.082+0000 7fc21da00640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc1f4068380 0x7fc1f406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc208001710 tx=0x7fc208009040 comp rx=0 tx=0).stop 2024-04-24T08:25:27.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.082+0000 7fc21da00640 1 -- 172.21.15.88:0/2369821630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc21813ee40 msgr2=0x7fc21813d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:27.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.082+0000 7fc21da00640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc21813ee40 0x7fc21813d150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc20000e8d0 tx=0x7fc20000ecd0 comp rx=0 tx=0).stop 2024-04-24T08:25:27.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.086+0000 7fc21da00640 1 -- 172.21.15.88:0/2369821630 shutdown_connections 2024-04-24T08:25:27.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.086+0000 7fc21da00640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc1f4068380 0x7fc1f406a840 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc208001710 tx=0x7fc208009040 comp rx=0 tx=0).stop 2024-04-24T08:25:27.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.086+0000 7fc21da00640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2181456c0 0x7fc2180b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:27.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.086+0000 7fc21da00640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc21813ee40 0x7fc21813d150 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:27.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.086+0000 7fc21da00640 1 --2- 172.21.15.88:0/2369821630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc21806e320 0x7fc21814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:27.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.086+0000 7fc21da00640 1 -- 172.21.15.88:0/2369821630 >> 172.21.15.88:0/2369821630 conn(0x7fc2180b9390 msgr2=0x7fc21806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:27.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.086+0000 7fc21da00640 1 -- 172.21.15.88:0/2369821630 shutdown_connections 2024-04-24T08:25:27.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.086+0000 7fc21da00640 1 -- 172.21.15.88:0/2369821630 wait complete. 2024-04-24T08:25:27.132 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-24T08:25:27.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c21200640 1 Processor -- start 2024-04-24T08:25:27.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c21200640 1 -- start start 2024-04-24T08:25:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c21200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3c1c13f090 0x7f3c1c150440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c21200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1c0b0580 con 0x7f3c1c0b01a0 2024-04-24T08:25:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c21200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1c0b59d0 con 0x7f3c1c0ae4e0 2024-04-24T08:25:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c21200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3c1c0ae970 con 0x7f3c1c13f090 2024-04-24T08:25:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c19e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3c1c0b01a0 0x7f3c1c06d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40860/0 (socket says 172.21.15.88:40860) 2024-04-24T08:25:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c19e00640 1 -- 172.21.15.88:0/1350705067 learned_addr learned my addr 172.21.15.88:0/1350705067 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c1a800640 1 --2- 172.21.15.88:0/1350705067 >> v2:172.21.15.142:3300/0 conn(0x7f3c1c13f090 0x7f3c1c150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:27.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c18a00640 1 -- 172.21.15.88:0/1350705067 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 323828184 0 0) 0x7f3c1c0b0580 con 0x7f3c1c0b01a0 2024-04-24T08:25:27.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c18a00640 1 -- 172.21.15.88:0/1350705067 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c00003530 con 0x7f3c1c0b01a0 2024-04-24T08:25:27.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c1a800640 1 -- 172.21.15.88:0/1350705067 >> v1:172.21.15.142:6789/0 conn(0x7f3c1c0ae4e0 legacy=0x7f3c1c13e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:27.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c18a00640 1 -- 172.21.15.88:0/1350705067 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602451096 0 0) 0x7f3c1c0b59d0 con 0x7f3c1c0ae4e0 2024-04-24T08:25:27.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.266+0000 7f3c1a800640 1 -- 172.21.15.88:0/1350705067 >> v1:172.21.15.88:6789/0 conn(0x7f3c1c0b01a0 legacy=0x7f3c1c06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:27.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.270+0000 7f3c1a800640 1 -- 172.21.15.88:0/1350705067 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c0b53a0 con 0x7f3c1c13f090 2024-04-24T08:25:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.270+0000 7f3c1a800640 1 --2- 172.21.15.88:0/1350705067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c1c13f090 0x7f3c1c150440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009d90 tx=0x7f3c1401c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a29de4e4cdc7cb8b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.270+0000 7f3c18a00640 1 -- 172.21.15.88:0/1350705067 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140b2070 con 0x7f3c1c13f090 2024-04-24T08:25:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.270+0000 7f3c18a00640 1 -- 172.21.15.88:0/1350705067 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c140a5820 con 0x7f3c1c13f090 2024-04-24T08:25:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.270+0000 7f3c18a00640 1 -- 172.21.15.88:0/1350705067 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140a5bf0 con 0x7f3c1c13f090 2024-04-24T08:25:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.270+0000 7f3c21200640 1 -- 172.21.15.88:0/1350705067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c1c13f090 msgr2=0x7f3c1c150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.270+0000 7f3c21200640 1 --2- 172.21.15.88:0/1350705067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c1c13f090 0x7f3c1c150440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009d90 tx=0x7f3c1401c850 comp rx=0 tx=0).stop 2024-04-24T08:25:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.270+0000 7f3c21200640 1 -- 172.21.15.88:0/1350705067 shutdown_connections 2024-04-24T08:25:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.270+0000 7f3c21200640 1 --2- 172.21.15.88:0/1350705067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c1c13f090 0x7f3c1c150440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.270+0000 7f3c21200640 1 -- 172.21.15.88:0/1350705067 >> 172.21.15.88:0/1350705067 conn(0x7f3c1c0b9690 msgr2=0x7f3c1c0b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c21200640 1 -- 172.21.15.88:0/1350705067 shutdown_connections 2024-04-24T08:25:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c21200640 1 -- 172.21.15.88:0/1350705067 wait complete. 2024-04-24T08:25:27.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c21200640 1 Processor -- start 2024-04-24T08:25:27.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c21200640 1 -- start start 2024-04-24T08:25:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c21200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c1c0b01a0 0x7f3c1c145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c21200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c1c13f090 0x7f3c1c144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c21200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c1c144860 0x7f3c1c0b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c21200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1537c0 con 0x7f3c1c13f090 2024-04-24T08:25:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c21200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c06e470 con 0x7f3c1c144860 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c21200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1c153940 con 0x7f3c1c0b01a0 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c19400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c1c13f090 0x7f3c1c144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c19400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c1c13f090 0x7f3c1c144320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35670/0 (socket says 172.21.15.88:35670) 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c19400640 1 -- 172.21.15.88:0/159306729 learned_addr learned my addr 172.21.15.88:0/159306729 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c19e00640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c1c0b01a0 0x7f3c1c145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c1a800640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c1c144860 0x7f3c1c0b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c19400640 1 -- 172.21.15.88:0/159306729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c1c0b01a0 msgr2=0x7f3c1c145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c19400640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c1c0b01a0 0x7f3c1c145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c19400640 1 -- 172.21.15.88:0/159306729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c1c144860 msgr2=0x7f3c1c0b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c19400640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c1c144860 0x7f3c1c0b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c19400640 1 -- 172.21.15.88:0/159306729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c143410 con 0x7f3c1c13f090 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c19400640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c1c13f090 0x7f3c1c144320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800c500 tx=0x7f3c0800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c12000640 1 -- 172.21.15.88:0/159306729 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c08017070 con 0x7f3c1c13f090 2024-04-24T08:25:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c12000640 1 -- 172.21.15.88:0/159306729 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c08003600 con 0x7f3c1c13f090 2024-04-24T08:25:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c12000640 1 -- 172.21.15.88:0/159306729 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c080039f0 con 0x7f3c1c13f090 2024-04-24T08:25:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c21200640 1 -- 172.21.15.88:0/159306729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1c1436f0 con 0x7f3c1c13f090 2024-04-24T08:25:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.274+0000 7f3c21200640 1 -- 172.21.15.88:0/159306729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1c0b2130 con 0x7f3c1c13f090 2024-04-24T08:25:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.278+0000 7f3c21200640 1 -- 172.21.15.88:0/159306729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c1c068c00 con 0x7f3c1c13f090 2024-04-24T08:25:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.278+0000 7f3c12000640 1 -- 172.21.15.88:0/159306729 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3c0801a070 con 0x7f3c1c13f090 2024-04-24T08:25:27.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.278+0000 7f3c12000640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3bfc0683b0 0x7f3bfc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:27.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.278+0000 7f3c12000640 1 -- 172.21.15.88:0/159306729 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f3c08085d00 con 0x7f3c1c13f090 2024-04-24T08:25:27.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.278+0000 7f3c19e00640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3bfc0683b0 0x7f3bfc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.278+0000 7f3c19e00640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3bfc0683b0 0x7f3bfc06a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c007fd0 tx=0x7f3c0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:27.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.282+0000 7f3c12000640 1 -- 172.21.15.88:0/159306729 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3c08055d80 con 0x7f3c1c13f090 2024-04-24T08:25:27.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:27.470+0000 7f3c21200640 1 -- 172.21.15.88:0/159306729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3c1c144c70 con 0x7f3c1c13f090 2024-04-24T08:25:28.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.082+0000 7f3c12000640 1 -- 172.21.15.88:0/159306729 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f3c0805a080 con 0x7f3c1c13f090 2024-04-24T08:25:28.088 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 2 and data pool 3 2024-04-24T08:25:28.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.086+0000 7f3c21200640 1 -- 172.21.15.88:0/159306729 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3bfc0683b0 msgr2=0x7f3bfc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.086+0000 7f3c21200640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3bfc0683b0 0x7f3bfc06a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c007fd0 tx=0x7f3c0c009040 comp rx=0 tx=0).stop 2024-04-24T08:25:28.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.086+0000 7f3c21200640 1 -- 172.21.15.88:0/159306729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c1c13f090 msgr2=0x7f3c1c144320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.086+0000 7f3c21200640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c1c13f090 0x7f3c1c144320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800c500 tx=0x7f3c0800c9c0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.086+0000 7f3c21200640 1 -- 172.21.15.88:0/159306729 shutdown_connections 2024-04-24T08:25:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.086+0000 7f3c21200640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3bfc0683b0 0x7f3bfc06a870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.086+0000 7f3c21200640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c1c144860 0x7f3c1c0b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.086+0000 7f3c21200640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c1c13f090 0x7f3c1c144320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.086+0000 7f3c21200640 1 --2- 172.21.15.88:0/159306729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c1c0b01a0 0x7f3c1c145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.086+0000 7f3c21200640 1 -- 172.21.15.88:0/159306729 >> 172.21.15.88:0/159306729 conn(0x7f3c1c0b9690 msgr2=0x7f3c1c09aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.086+0000 7f3c21200640 1 -- 172.21.15.88:0/159306729 shutdown_connections 2024-04-24T08:25:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.086+0000 7f3c21200640 1 -- 172.21.15.88:0/159306729 wait complete. 2024-04-24T08:25:28.147 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e6ae00640 1 Processor -- start 2024-04-24T08:25:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e6ae00640 1 -- start start 2024-04-24T08:25:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e6ae00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6406e720 0x7f1e640b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e6ae00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e6406cbe0 0x7f1e640b7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e6ae00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1e6414c2c0 0x7f1e640b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e6ae00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f1e6414be30 con 0x7f1e6414c2c0 2024-04-24T08:25:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e6ae00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1e6406eb00 con 0x7f1e6406cbe0 2024-04-24T08:25:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e6ae00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1e6414b7e0 con 0x7f1e6406e720 2024-04-24T08:25:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e68e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1e6414c2c0 0x7f1e640b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e68e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1e6414c2c0 0x7f1e640b7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34406/0 (socket says 172.21.15.88:34406) 2024-04-24T08:25:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e68e00640 1 -- 172.21.15.88:0/467832268 learned_addr learned my addr 172.21.15.88:0/467832268 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e63e00640 1 --2- 172.21.15.88:0/467832268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6406e720 0x7f1e640b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e5b400640 1 --2- 172.21.15.88:0/467832268 >> v2:172.21.15.142:3300/0 conn(0x7f1e6406cbe0 0x7f1e640b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e68e00640 1 -- 172.21.15.88:0/467832268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6406e720 msgr2=0x7f1e640b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e68e00640 1 --2- 172.21.15.88:0/467832268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6406e720 0x7f1e640b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e68e00640 1 -- 172.21.15.88:0/467832268 >> v2:172.21.15.142:3300/0 conn(0x7f1e6406cbe0 msgr2=0x7f1e640b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e68e00640 1 --2- 172.21.15.88:0/467832268 >> v2:172.21.15.142:3300/0 conn(0x7f1e6406cbe0 0x7f1e640b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e68e00640 1 -- 172.21.15.88:0/467832268 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6414bac0 con 0x7f1e6414c2c0 2024-04-24T08:25:28.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.278+0000 7f1e5b400640 1 --2- 172.21.15.88:0/467832268 >> v2:172.21.15.142:3300/0 conn(0x7f1e6406cbe0 0x7f1e640b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:28.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e68e00640 1 --2- 172.21.15.88:0/467832268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6414c2c0 0x7f1e640b7a90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e640688d0 tx=0x7f1e5c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9001cfeb0dedba30 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:28.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e63400640 1 -- 172.21.15.88:0/467832268 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0a5660 con 0x7f1e6414c2c0 2024-04-24T08:25:28.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e63400640 1 -- 172.21.15.88:0/467832268 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5c0a5800 con 0x7f1e6414c2c0 2024-04-24T08:25:28.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e63400640 1 -- 172.21.15.88:0/467832268 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0a5bd0 con 0x7f1e6414c2c0 2024-04-24T08:25:28.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e6ae00640 1 -- 172.21.15.88:0/467832268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6414c2c0 msgr2=0x7f1e640b7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e6ae00640 1 --2- 172.21.15.88:0/467832268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6414c2c0 0x7f1e640b7a90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e640688d0 tx=0x7f1e5c01c8d0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e6ae00640 1 -- 172.21.15.88:0/467832268 shutdown_connections 2024-04-24T08:25:28.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e6ae00640 1 --2- 172.21.15.88:0/467832268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6414c2c0 0x7f1e640b7a90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e6ae00640 1 --2- 172.21.15.88:0/467832268 >> v2:172.21.15.142:3300/0 conn(0x7f1e6406cbe0 0x7f1e640b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e6ae00640 1 --2- 172.21.15.88:0/467832268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6406e720 0x7f1e640b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e6ae00640 1 -- 172.21.15.88:0/467832268 >> 172.21.15.88:0/467832268 conn(0x7f1e64067810 msgr2=0x7f1e64067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:28.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e6ae00640 1 -- 172.21.15.88:0/467832268 shutdown_connections 2024-04-24T08:25:28.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.282+0000 7f1e6ae00640 1 -- 172.21.15.88:0/467832268 wait complete. 2024-04-24T08:25:28.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e6ae00640 1 Processor -- start 2024-04-24T08:25:28.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e6ae00640 1 -- start start 2024-04-24T08:25:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e6ae00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6406cbe0 0x7f1e64144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e6ae00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6406e720 0x7f1e640ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e6ae00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6414c2c0 0x7f1e641e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e6ae00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1e64148ce0 con 0x7f1e6406cbe0 2024-04-24T08:25:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e6ae00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1e64148b60 con 0x7f1e6406e720 2024-04-24T08:25:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e6ae00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1e64148e60 con 0x7f1e6414c2c0 2024-04-24T08:25:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e63e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6406cbe0 0x7f1e64144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e63e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6406cbe0 0x7f1e64144ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34418/0 (socket says 172.21.15.88:34418) 2024-04-24T08:25:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e63e00640 1 -- 172.21.15.88:0/2280071878 learned_addr learned my addr 172.21.15.88:0/2280071878 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e5b400640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6406e720 0x7f1e640ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e68e00640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6414c2c0 0x7f1e641e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e63e00640 1 -- 172.21.15.88:0/2280071878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6414c2c0 msgr2=0x7f1e641e3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e63e00640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6414c2c0 0x7f1e641e3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e63e00640 1 -- 172.21.15.88:0/2280071878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6406e720 msgr2=0x7f1e640ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e63e00640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6406e720 0x7f1e640ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e63e00640 1 -- 172.21.15.88:0/2280071878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e64152020 con 0x7f1e6406cbe0 2024-04-24T08:25:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e68e00640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6414c2c0 0x7f1e641e3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e5b400640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6406e720 0x7f1e640ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e63e00640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6406cbe0 0x7f1e64144ee0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400d800 tx=0x7f1e5400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e60c00640 1 -- 172.21.15.88:0/2280071878 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5400b660 con 0x7f1e6406cbe0 2024-04-24T08:25:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e60c00640 1 -- 172.21.15.88:0/2280071878 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e54019070 con 0x7f1e6406cbe0 2024-04-24T08:25:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e6ae00640 1 -- 172.21.15.88:0/2280071878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6414d6d0 con 0x7f1e6406cbe0 2024-04-24T08:25:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e60c00640 1 -- 172.21.15.88:0/2280071878 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5400ba00 con 0x7f1e6406cbe0 2024-04-24T08:25:28.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.286+0000 7f1e6ae00640 1 -- 172.21.15.88:0/2280071878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e640ad980 con 0x7f1e6406cbe0 2024-04-24T08:25:28.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.290+0000 7f1e6ae00640 1 -- 172.21.15.88:0/2280071878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e64068b90 con 0x7f1e6406cbe0 2024-04-24T08:25:28.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.290+0000 7f1e60c00640 1 -- 172.21.15.88:0/2280071878 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1e5400bba0 con 0x7f1e6406cbe0 2024-04-24T08:25:28.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.290+0000 7f1e60c00640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1e40068380 0x7f1e4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.290+0000 7f1e60c00640 1 -- 172.21.15.88:0/2280071878 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f1e54086d90 con 0x7f1e6406cbe0 2024-04-24T08:25:28.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.290+0000 7f1e5b400640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1e40068380 0x7f1e4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.290+0000 7f1e5b400640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1e40068380 0x7f1e4006a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c006fd0 tx=0x7f1e4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:28.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.294+0000 7f1e60c00640 1 -- 172.21.15.88:0/2280071878 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1e540573e0 con 0x7f1e6406cbe0 2024-04-24T08:25:28.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.450+0000 7f1e6ae00640 1 -- 172.21.15.88:0/2280071878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e640b9830 con 0x7f1e6406cbe0 2024-04-24T08:25:28.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e60c00640 1 -- 172.21.15.88:0/2280071878 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16618 (secure 0 0 0) 0x7f1e54056ce0 con 0x7f1e6406cbe0 2024-04-24T08:25:28.457 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:28.458 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:27.478102+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:28.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e6ae00640 1 -- 172.21.15.88:0/2280071878 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1e40068380 msgr2=0x7f1e4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e6ae00640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1e40068380 0x7f1e4006a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c006fd0 tx=0x7f1e4c008040 comp rx=0 tx=0).stop 2024-04-24T08:25:28.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e6ae00640 1 -- 172.21.15.88:0/2280071878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6406cbe0 msgr2=0x7f1e64144ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e6ae00640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6406cbe0 0x7f1e64144ee0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400d800 tx=0x7f1e5400dcc0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e6ae00640 1 -- 172.21.15.88:0/2280071878 shutdown_connections 2024-04-24T08:25:28.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e6ae00640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1e40068380 0x7f1e4006a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e6ae00640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6414c2c0 0x7f1e641e3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e6ae00640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6406e720 0x7f1e640ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e6ae00640 1 --2- 172.21.15.88:0/2280071878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6406cbe0 0x7f1e64144ee0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e6ae00640 1 -- 172.21.15.88:0/2280071878 >> 172.21.15.88:0/2280071878 conn(0x7f1e64067810 msgr2=0x7f1e640b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:28.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e6ae00640 1 -- 172.21.15.88:0/2280071878 shutdown_connections 2024-04-24T08:25:28.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.454+0000 7f1e6ae00640 1 -- 172.21.15.88:0/2280071878 wait complete. 2024-04-24T08:25:28.479 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:28.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.610+0000 7fec9f000640 1 Processor -- start 2024-04-24T08:25:28.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.610+0000 7fec9f000640 1 -- start start 2024-04-24T08:25:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.610+0000 7fec9f000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec980a94c0 0x7fec980ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.610+0000 7fec9f000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec980b64e0 con 0x7fec98145ec0 2024-04-24T08:25:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.610+0000 7fec9f000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec980b77e0 con 0x7fec980b7400 2024-04-24T08:25:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.610+0000 7fec9f000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fec980b69e0 con 0x7fec980a94c0 2024-04-24T08:25:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.610+0000 7fec97400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec980a94c0 0x7fec980ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.610+0000 7fec9d000640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fec98145ec0 0x7fec98150780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59492/0 (socket says 172.21.15.88:59492) 2024-04-24T08:25:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.610+0000 7fec9d000640 1 -- 172.21.15.88:0/869360774 learned_addr learned my addr 172.21.15.88:0/869360774 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.610+0000 7fec97400640 1 -- 172.21.15.88:0/869360774 >> v1:172.21.15.142:6789/0 conn(0x7fec980b7400 legacy=0x7fec981466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.610+0000 7fec97400640 1 -- 172.21.15.88:0/869360774 >> v1:172.21.15.88:6789/0 conn(0x7fec98145ec0 legacy=0x7fec98150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.610+0000 7fec97400640 1 -- 172.21.15.88:0/869360774 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec980b6700 con 0x7fec980a94c0 2024-04-24T08:25:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec97400640 1 --2- 172.21.15.88:0/869360774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec980a94c0 0x7fec980ab360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fec840097c0 tx=0x7fec8401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b10c0ff45af9af server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec96a00640 1 -- 172.21.15.88:0/869360774 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840b0070 con 0x7fec980a94c0 2024-04-24T08:25:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec96a00640 1 -- 172.21.15.88:0/869360774 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec840ab600 con 0x7fec980a94c0 2024-04-24T08:25:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec96a00640 1 -- 172.21.15.88:0/869360774 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840ab9d0 con 0x7fec980a94c0 2024-04-24T08:25:28.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec9f000640 1 -- 172.21.15.88:0/869360774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec980a94c0 msgr2=0x7fec980ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec9f000640 1 --2- 172.21.15.88:0/869360774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec980a94c0 0x7fec980ab360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fec840097c0 tx=0x7fec8401c410 comp rx=0 tx=0).stop 2024-04-24T08:25:28.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec9f000640 1 -- 172.21.15.88:0/869360774 shutdown_connections 2024-04-24T08:25:28.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec9f000640 1 --2- 172.21.15.88:0/869360774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec980a94c0 0x7fec980ab360 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec9f000640 1 -- 172.21.15.88:0/869360774 >> 172.21.15.88:0/869360774 conn(0x7fec98067810 msgr2=0x7fec98067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:28.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec9f000640 1 -- 172.21.15.88:0/869360774 shutdown_connections 2024-04-24T08:25:28.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec9f000640 1 -- 172.21.15.88:0/869360774 wait complete. 2024-04-24T08:25:28.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec9f000640 1 Processor -- start 2024-04-24T08:25:28.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.614+0000 7fec9f000640 1 -- start start 2024-04-24T08:25:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec9f000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec980b7400 0x7fec981e0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec9f000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec98145ec0 0x7fec98137e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec9f000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec9806d0f0 0x7fec981e4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec9f000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fec980b7cd0 con 0x7fec980b7400 2024-04-24T08:25:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec9f000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fec980b5eb0 con 0x7fec98145ec0 2024-04-24T08:25:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec9f000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fec980b7e50 con 0x7fec9806d0f0 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec97e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec980b7400 0x7fec981e0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec97e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec980b7400 0x7fec981e0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34422/0 (socket says 172.21.15.88:34422) 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec97e00640 1 -- 172.21.15.88:0/2546787281 learned_addr learned my addr 172.21.15.88:0/2546787281 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec97e00640 1 -- 172.21.15.88:0/2546787281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec9806d0f0 msgr2=0x7fec981e4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec97e00640 1 --2- 172.21.15.88:0/2546787281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec9806d0f0 0x7fec981e4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec97e00640 1 -- 172.21.15.88:0/2546787281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec98145ec0 msgr2=0x7fec98137e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec97e00640 1 --2- 172.21.15.88:0/2546787281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec98145ec0 0x7fec98137e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec97e00640 1 -- 172.21.15.88:0/2546787281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec981e3f70 con 0x7fec980b7400 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec97e00640 1 --2- 172.21.15.88:0/2546787281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec980b7400 0x7fec981e0820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c3a0 tx=0x7fec8800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec8fe00640 1 -- 172.21.15.88:0/2546787281 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec880052d0 con 0x7fec980b7400 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec8fe00640 1 -- 172.21.15.88:0/2546787281 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec88005470 con 0x7fec980b7400 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec8fe00640 1 -- 172.21.15.88:0/2546787281 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88007240 con 0x7fec980b7400 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec9f000640 1 -- 172.21.15.88:0/2546787281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec980b4a90 con 0x7fec980b7400 2024-04-24T08:25:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec9f000640 1 -- 172.21.15.88:0/2546787281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec980af170 con 0x7fec980b7400 2024-04-24T08:25:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec9f000640 1 -- 172.21.15.88:0/2546787281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9806d4e0 con 0x7fec980b7400 2024-04-24T08:25:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.618+0000 7fec8fe00640 1 -- 172.21.15.88:0/2546787281 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec880073e0 con 0x7fec980b7400 2024-04-24T08:25:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.622+0000 7fec8fe00640 1 --2- 172.21.15.88:0/2546787281 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fec780683b0 0x7fec7806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.622+0000 7fec8fe00640 1 -- 172.21.15.88:0/2546787281 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fec88085ed0 con 0x7fec980b7400 2024-04-24T08:25:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.622+0000 7fec97400640 1 --2- 172.21.15.88:0/2546787281 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fec780683b0 0x7fec7806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.622+0000 7fec97400640 1 --2- 172.21.15.88:0/2546787281 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fec780683b0 0x7fec7806a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec840ad000 tx=0x7fec84004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:28.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.626+0000 7fec8fe00640 1 -- 172.21.15.88:0/2546787281 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fec88056480 con 0x7fec980b7400 2024-04-24T08:25:28.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 -- 172.21.15.88:0/2546787281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec981e3d90 con 0x7fec980b7400 2024-04-24T08:25:28.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec8fe00640 1 -- 172.21.15.88:0/2546787281 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16618 (secure 0 0 0) 0x7fec981e3d90 con 0x7fec980b7400 2024-04-24T08:25:28.786 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:28.786 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:27.478102+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:28.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 -- 172.21.15.88:0/2546787281 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fec780683b0 msgr2=0x7fec7806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 --2- 172.21.15.88:0/2546787281 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fec780683b0 0x7fec7806a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec840ad000 tx=0x7fec84004740 comp rx=0 tx=0).stop 2024-04-24T08:25:28.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 -- 172.21.15.88:0/2546787281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec980b7400 msgr2=0x7fec981e0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 --2- 172.21.15.88:0/2546787281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec980b7400 0x7fec981e0820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c3a0 tx=0x7fec8800c860 comp rx=0 tx=0).stop 2024-04-24T08:25:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 -- 172.21.15.88:0/2546787281 shutdown_connections 2024-04-24T08:25:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 --2- 172.21.15.88:0/2546787281 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fec780683b0 0x7fec7806a870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 --2- 172.21.15.88:0/2546787281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec9806d0f0 0x7fec981e4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 --2- 172.21.15.88:0/2546787281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec98145ec0 0x7fec98137e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 --2- 172.21.15.88:0/2546787281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec980b7400 0x7fec981e0820 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 -- 172.21.15.88:0/2546787281 >> 172.21.15.88:0/2546787281 conn(0x7fec98067810 msgr2=0x7fec980b9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 -- 172.21.15.88:0/2546787281 shutdown_connections 2024-04-24T08:25:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.782+0000 7fec9f000640 1 -- 172.21.15.88:0/2546787281 wait complete. 2024-04-24T08:25:28.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-24T08:25:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f7e00640 1 Processor -- start 2024-04-24T08:25:28.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f7e00640 1 -- start start 2024-04-24T08:25:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f00b4c90 0x7f48f0145f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f7e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48f009e7a0 0x7f48f01464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f7e00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f006d4f0 con 0x7f48f006e490 2024-04-24T08:25:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f7e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f48f006d2a0 con 0x7f48f009e7a0 2024-04-24T08:25:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f48f006d7d0 con 0x7f48f00b4c90 2024-04-24T08:25:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f4a00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f48f006e490 0x7f48f009e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59494/0 (socket says 172.21.15.88:59494) 2024-04-24T08:25:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f4a00640 1 -- 172.21.15.88:0/2735810703 learned_addr learned my addr 172.21.15.88:0/2735810703 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f5400640 1 --2- 172.21.15.88:0/2735810703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f00b4c90 0x7f48f0145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f5e00640 1 --2- 172.21.15.88:0/2735810703 >> v2:172.21.15.142:3300/0 conn(0x7f48f009e7a0 0x7f48f01464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481077814 0 0) 0x7f48f006d4f0 con 0x7f48f006e490 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48d8003530 con 0x7f48f006e490 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3762262396 0 0) 0x7f48d8003530 con 0x7f48f006e490 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f00b4c90 msgr2=0x7f48f0145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 --2- 172.21.15.88:0/2735810703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f00b4c90 0x7f48f0145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 >> v2:172.21.15.142:3300/0 conn(0x7f48f009e7a0 msgr2=0x7f48f01464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 --2- 172.21.15.88:0/2735810703 >> v2:172.21.15.142:3300/0 conn(0x7f48f009e7a0 0x7f48f01464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f009c570 con 0x7f48f006e490 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f48dc001680 con 0x7f48f006e490 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 >> v1:172.21.15.88:6789/0 conn(0x7f48f006e490 legacy=0x7f48f009e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 --2- 172.21.15.88:0/2735810703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48d80039c0 0x7f48d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 --2- 172.21.15.88:0/2735810703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48d8004810 0x7f48d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 --2- 172.21.15.88:0/2735810703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f00b4c90 0x7f48d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f48f006d2a0 con 0x7f48d80039c0 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f48f006d7d0 con 0x7f48d8004810 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f48d800b9d0 con 0x7f48f00b4c90 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f5400640 1 --2- 172.21.15.88:0/2735810703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48d80039c0 0x7f48d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f4a00640 1 --2- 172.21.15.88:0/2735810703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48d8004810 0x7f48d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f5e00640 1 --2- 172.21.15.88:0/2735810703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f00b4c90 0x7f48d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f5400640 1 -- 172.21.15.88:0/2735810703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f00b4c90 msgr2=0x7f48d80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f5400640 1 --2- 172.21.15.88:0/2735810703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f00b4c90 0x7f48d80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f5400640 1 -- 172.21.15.88:0/2735810703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48d8004810 msgr2=0x7f48d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f5400640 1 --2- 172.21.15.88:0/2735810703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48d8004810 0x7f48d8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.942+0000 7f48f5400640 1 -- 172.21.15.88:0/2735810703 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d8003530 con 0x7f48d80039c0 2024-04-24T08:25:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.946+0000 7f48f5400640 1 --2- 172.21.15.88:0/2735810703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48d80039c0 0x7f48d8003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009b10 tx=0x7f48e401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46abd641dc50c285 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.946+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e40096b0 con 0x7f48d80039c0 2024-04-24T08:25:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.946+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e40a6480 con 0x7f48d80039c0 2024-04-24T08:25:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.946+0000 7f48efe00640 1 -- 172.21.15.88:0/2735810703 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e40a6870 con 0x7f48d80039c0 2024-04-24T08:25:28.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.946+0000 7f48f7e00640 1 -- 172.21.15.88:0/2735810703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48d80039c0 msgr2=0x7f48d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.946+0000 7f48f7e00640 1 --2- 172.21.15.88:0/2735810703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48d80039c0 0x7f48d8003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009b10 tx=0x7f48e401ca70 comp rx=0 tx=0).stop 2024-04-24T08:25:28.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.946+0000 7f48f5e00640 1 -- 172.21.15.88:0/2735810703 reap_dead start 2024-04-24T08:25:28.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.946+0000 7f48f7e00640 1 -- 172.21.15.88:0/2735810703 shutdown_connections 2024-04-24T08:25:28.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.946+0000 7f48f7e00640 1 -- 172.21.15.88:0/2735810703 >> 172.21.15.88:0/2735810703 conn(0x7f48f00b9690 msgr2=0x7f48f00b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:28.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.946+0000 7f48f7e00640 1 -- 172.21.15.88:0/2735810703 shutdown_connections 2024-04-24T08:25:28.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.946+0000 7f48f7e00640 1 -- 172.21.15.88:0/2735810703 wait complete. 2024-04-24T08:25:28.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f7e00640 1 Processor -- start 2024-04-24T08:25:28.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f7e00640 1 -- start start 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f7e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48d80039c0 0x7f48f00b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0148c00 0x7f48f01e3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f01e43d0 0x7f48f01e4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f7e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f48f0150fb0 con 0x7f48d80039c0 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f7e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f48f0150e30 con 0x7f48f0148c00 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f48f0151130 con 0x7f48f01e43d0 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f5400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48d80039c0 0x7f48f00b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f5400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48d80039c0 0x7f48f00b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34442/0 (socket says 172.21.15.88:34442) 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f5400640 1 -- 172.21.15.88:0/319721954 learned_addr learned my addr 172.21.15.88:0/319721954 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f4a00640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0148c00 0x7f48f01e3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f5e00640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f01e43d0 0x7f48f01e4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f5400640 1 -- 172.21.15.88:0/319721954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f01e43d0 msgr2=0x7f48f01e4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f5400640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f01e43d0 0x7f48f01e4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f5400640 1 -- 172.21.15.88:0/319721954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0148c00 msgr2=0x7f48f01e3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f5400640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0148c00 0x7f48f01e3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f5400640 1 -- 172.21.15.88:0/319721954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f0141d90 con 0x7f48d80039c0 2024-04-24T08:25:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f5e00640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f01e43d0 0x7f48f01e4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f5400640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48d80039c0 0x7f48f00b3140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f48e401c8a0 tx=0x7f48d8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48ed600640 1 -- 172.21.15.88:0/319721954 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e40be070 con 0x7f48d80039c0 2024-04-24T08:25:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48ed600640 1 -- 172.21.15.88:0/319721954 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e400f000 con 0x7f48d80039c0 2024-04-24T08:25:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48ed600640 1 -- 172.21.15.88:0/319721954 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e40a7460 con 0x7f48d80039c0 2024-04-24T08:25:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f7e00640 1 -- 172.21.15.88:0/319721954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f0148060 con 0x7f48d80039c0 2024-04-24T08:25:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.950+0000 7f48f7e00640 1 -- 172.21.15.88:0/319721954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f0141ab0 con 0x7f48d80039c0 2024-04-24T08:25:28.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.954+0000 7f48f7e00640 1 -- 172.21.15.88:0/319721954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f01406e0 con 0x7f48d80039c0 2024-04-24T08:25:28.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.954+0000 7f48ed600640 1 -- 172.21.15.88:0/319721954 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f48e40a7600 con 0x7f48d80039c0 2024-04-24T08:25:28.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.954+0000 7f48ed600640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f48d0068380 0x7f48d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:28.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.954+0000 7f48ed600640 1 -- 172.21.15.88:0/319721954 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f48e41202e0 con 0x7f48d80039c0 2024-04-24T08:25:28.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.954+0000 7f48f4a00640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f48d0068380 0x7f48d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:28.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.954+0000 7f48f4a00640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f48d0068380 0x7f48d006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f48dc001060 tx=0x7f48dc007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:28.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:28.958+0000 7f48ed600640 1 -- 172.21.15.88:0/319721954 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f48e40ac020 con 0x7f48d80039c0 2024-04-24T08:25:29.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:29.154+0000 7f48f7e00640 1 -- 172.21.15.88:0/319721954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f48f0068c00 con 0x7f48d80039c0 2024-04-24T08:25:30.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.118+0000 7f48ed600640 1 -- 172.21.15.88:0/319721954 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f48e40167c0 con 0x7f48d80039c0 2024-04-24T08:25:30.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.122+0000 7f48f7e00640 1 -- 172.21.15.88:0/319721954 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f48d0068380 msgr2=0x7f48d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:30.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.122+0000 7f48f7e00640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f48d0068380 0x7f48d006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f48dc001060 tx=0x7f48dc007040 comp rx=0 tx=0).stop 2024-04-24T08:25:30.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.122+0000 7f48f7e00640 1 -- 172.21.15.88:0/319721954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48d80039c0 msgr2=0x7f48f00b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:30.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.122+0000 7f48f7e00640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48d80039c0 0x7f48f00b3140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f48e401c8a0 tx=0x7f48d8005840 comp rx=0 tx=0).stop 2024-04-24T08:25:30.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.122+0000 7f48f7e00640 1 -- 172.21.15.88:0/319721954 shutdown_connections 2024-04-24T08:25:30.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.122+0000 7f48f7e00640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f48d0068380 0x7f48d006a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:30.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.122+0000 7f48f7e00640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f01e43d0 0x7f48f01e4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:30.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.122+0000 7f48f7e00640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0148c00 0x7f48f01e3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:30.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.122+0000 7f48f7e00640 1 --2- 172.21.15.88:0/319721954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48d80039c0 0x7f48f00b3140 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:30.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.122+0000 7f48f7e00640 1 -- 172.21.15.88:0/319721954 >> 172.21.15.88:0/319721954 conn(0x7f48f00b9690 msgr2=0x7f48f009b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:30.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.122+0000 7f48f7e00640 1 -- 172.21.15.88:0/319721954 shutdown_connections 2024-04-24T08:25:30.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.122+0000 7f48f7e00640 1 -- 172.21.15.88:0/319721954 wait complete. 2024-04-24T08:25:30.149 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-24T08:25:30.149 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-24T08:25:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.286+0000 7f2407a00640 1 Processor -- start 2024-04-24T08:25:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.286+0000 7f2407a00640 1 -- start start 2024-04-24T08:25:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.286+0000 7f2407a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b01a0 0x7f240006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.286+0000 7f2407a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f240013f090 0x7f240014f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.286+0000 7f2407a00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24000b0580 con 0x7f24000ae4e0 2024-04-24T08:25:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.286+0000 7f2407a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f24000b59d0 con 0x7f240013f090 2024-04-24T08:25:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.286+0000 7f2407a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f24000ae970 con 0x7f24000b01a0 2024-04-24T08:25:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.286+0000 7f23f7e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f24000ae4e0 0x7f240013e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59496/0 (socket says 172.21.15.88:59496) 2024-04-24T08:25:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.286+0000 7f23f7e00640 1 -- 172.21.15.88:0/1048176541 learned_addr learned my addr 172.21.15.88:0/1048176541 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:30.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.286+0000 7f2405000640 1 --2- 172.21.15.88:0/1048176541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b01a0 0x7f240006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:30.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.286+0000 7f2405a00640 1 --2- 172.21.15.88:0/1048176541 >> v2:172.21.15.142:3300/0 conn(0x7f240013f090 0x7f240014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:30.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.290+0000 7f23ffe00640 1 -- 172.21.15.88:0/1048176541 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216713318 0 0) 0x7f24000b0580 con 0x7f24000ae4e0 2024-04-24T08:25:30.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.290+0000 7f23ffe00640 1 -- 172.21.15.88:0/1048176541 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23e4003530 con 0x7f24000ae4e0 2024-04-24T08:25:30.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.290+0000 7f2405a00640 1 -- 172.21.15.88:0/1048176541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b01a0 msgr2=0x7f240006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:30.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.290+0000 7f2405a00640 1 --2- 172.21.15.88:0/1048176541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b01a0 0x7f240006d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:30.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.290+0000 7f2405a00640 1 -- 172.21.15.88:0/1048176541 >> v1:172.21.15.88:6789/0 conn(0x7f24000ae4e0 legacy=0x7f240013e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:30.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.290+0000 7f2405a00640 1 -- 172.21.15.88:0/1048176541 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24000b53a0 con 0x7f240013f090 2024-04-24T08:25:30.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.290+0000 7f2405a00640 1 --2- 172.21.15.88:0/1048176541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240013f090 0x7f240014f430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009d90 tx=0x7f23f801c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4476df381e977b03 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:30.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.290+0000 7f23ffe00640 1 -- 172.21.15.88:0/1048176541 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f80b2070 con 0x7f240013f090 2024-04-24T08:25:30.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.290+0000 7f23ffe00640 1 -- 172.21.15.88:0/1048176541 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f80a5720 con 0x7f240013f090 2024-04-24T08:25:30.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.290+0000 7f23ffe00640 1 -- 172.21.15.88:0/1048176541 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f80a5ad0 con 0x7f240013f090 2024-04-24T08:25:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 -- 172.21.15.88:0/1048176541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240013f090 msgr2=0x7f240014f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 --2- 172.21.15.88:0/1048176541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240013f090 0x7f240014f430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009d90 tx=0x7f23f801c850 comp rx=0 tx=0).stop 2024-04-24T08:25:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 -- 172.21.15.88:0/1048176541 shutdown_connections 2024-04-24T08:25:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 --2- 172.21.15.88:0/1048176541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240013f090 0x7f240014f430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 --2- 172.21.15.88:0/1048176541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b01a0 0x7f240006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 -- 172.21.15.88:0/1048176541 >> 172.21.15.88:0/1048176541 conn(0x7f24000b9690 msgr2=0x7f24000b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:30.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 -- 172.21.15.88:0/1048176541 shutdown_connections 2024-04-24T08:25:30.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 -- 172.21.15.88:0/1048176541 wait complete. 2024-04-24T08:25:30.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 Processor -- start 2024-04-24T08:25:30.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 -- start start 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b01a0 0x7f240009d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240013f090 0x7f240013ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2400130190 0x7f2400130620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f240009b260 con 0x7f2400130190 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f240006e470 con 0x7f240013f090 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2407a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f240009b3e0 con 0x7f24000b01a0 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2405a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2400130190 0x7f2400130620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2405a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2400130190 0x7f2400130620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34452/0 (socket says 172.21.15.88:34452) 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2405a00640 1 -- 172.21.15.88:0/909517818 learned_addr learned my addr 172.21.15.88:0/909517818 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f23f7e00640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240013f090 0x7f240013ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2405000640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b01a0 0x7f240009d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2405a00640 1 -- 172.21.15.88:0/909517818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b01a0 msgr2=0x7f240009d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:30.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2405a00640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b01a0 0x7f240009d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:30.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2405a00640 1 -- 172.21.15.88:0/909517818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240013f090 msgr2=0x7f240013ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:30.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2405a00640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240013f090 0x7f240013ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:30.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2405a00640 1 -- 172.21.15.88:0/909517818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24001453c0 con 0x7f2400130190 2024-04-24T08:25:30.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f23f7e00640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240013f090 0x7f240013ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:30.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f2405a00640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2400130190 0x7f2400130620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009d90 tx=0x7f23f80195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:30.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.294+0000 7f23fd600640 1 -- 172.21.15.88:0/909517818 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f80b2050 con 0x7f2400130190 2024-04-24T08:25:30.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.298+0000 7f23fd600640 1 -- 172.21.15.88:0/909517818 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f80be070 con 0x7f2400130190 2024-04-24T08:25:30.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.298+0000 7f2407a00640 1 -- 172.21.15.88:0/909517818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240013e1b0 con 0x7f2400130190 2024-04-24T08:25:30.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.298+0000 7f23fd600640 1 -- 172.21.15.88:0/909517818 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8009450 con 0x7f2400130190 2024-04-24T08:25:30.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.298+0000 7f2407a00640 1 -- 172.21.15.88:0/909517818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240009dda0 con 0x7f2400130190 2024-04-24T08:25:30.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.298+0000 7f2407a00640 1 -- 172.21.15.88:0/909517818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2400145590 con 0x7f2400130190 2024-04-24T08:25:30.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.298+0000 7f23fd600640 1 -- 172.21.15.88:0/909517818 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f23f80ad890 con 0x7f2400130190 2024-04-24T08:25:30.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.298+0000 7f23fd600640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f23dc0683b0 0x7f23dc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:30.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.298+0000 7f23fd600640 1 -- 172.21.15.88:0/909517818 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f23f8121900 con 0x7f2400130190 2024-04-24T08:25:30.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.298+0000 7f2405000640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f23dc0683b0 0x7f23dc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:30.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.298+0000 7f2405000640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f23dc0683b0 0x7f23dc06a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23f000bd90 tx=0x7f23f000b3a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:30.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.302+0000 7f23fd600640 1 -- 172.21.15.88:0/909517818 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f23f8016560 con 0x7f2400130190 2024-04-24T08:25:30.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:30.494+0000 7f2407a00640 1 -- 172.21.15.88:0/909517818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f24001451e0 con 0x7f2400130190 2024-04-24T08:25:30.508 INFO:tasks.ceph.mds.a.smithi088.stderr:2024-04-24T08:25:30.502+0000 7fe18f600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T08:25:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.122+0000 7f23fd600640 1 -- 172.21.15.88:0/909517818 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f24001451e0 con 0x7f2400130190 2024-04-24T08:25:31.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.126+0000 7f2407a00640 1 -- 172.21.15.88:0/909517818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f23dc0683b0 msgr2=0x7f23dc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.126+0000 7f2407a00640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f23dc0683b0 0x7f23dc06a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23f000bd90 tx=0x7f23f000b3a0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.126+0000 7f2407a00640 1 -- 172.21.15.88:0/909517818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2400130190 msgr2=0x7f2400130620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.126+0000 7f2407a00640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2400130190 0x7f2400130620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009d90 tx=0x7f23f80195f0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.126+0000 7f2407a00640 1 -- 172.21.15.88:0/909517818 shutdown_connections 2024-04-24T08:25:31.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.126+0000 7f2407a00640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f23dc0683b0 0x7f23dc06a870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.126+0000 7f2407a00640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2400130190 0x7f2400130620 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.126+0000 7f2407a00640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240013f090 0x7f240013ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.126+0000 7f2407a00640 1 --2- 172.21.15.88:0/909517818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b01a0 0x7f240009d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.126+0000 7f2407a00640 1 -- 172.21.15.88:0/909517818 >> 172.21.15.88:0/909517818 conn(0x7f24000b9690 msgr2=0x7f24000b89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:31.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.126+0000 7f2407a00640 1 -- 172.21.15.88:0/909517818 shutdown_connections 2024-04-24T08:25:31.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.126+0000 7f2407a00640 1 -- 172.21.15.88:0/909517818 wait complete. 2024-04-24T08:25:31.153 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-24T08:25:31.153 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:25:31.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa66400640 1 Processor -- start 2024-04-24T08:25:31.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa66400640 1 -- start start 2024-04-24T08:25:31.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa66400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa600b5e70 0x7ffa60148450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa66400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa600b6250 0x7ffa60141780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa66400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa601479d0 con 0x7ffa600b7fd0 2024-04-24T08:25:31.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa66400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ffa60148990 con 0x7ffa600b5e70 2024-04-24T08:25:31.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa66400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ffa600b9ba0 con 0x7ffa600b6250 2024-04-24T08:25:31.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa65000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa600b5e70 0x7ffa60148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa65a00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffa600b7fd0 0x7ffa6014afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59506/0 (socket says 172.21.15.88:59506) 2024-04-24T08:25:31.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa65a00640 1 -- 172.21.15.88:0/1110811823 learned_addr learned my addr 172.21.15.88:0/1110811823 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:31.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa5fe00640 1 --2- 172.21.15.88:0/1110811823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa600b6250 0x7ffa60141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa65000640 1 -- 172.21.15.88:0/1110811823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa600b6250 msgr2=0x7ffa60141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:31.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa65000640 1 --2- 172.21.15.88:0/1110811823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa600b6250 0x7ffa60141780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa65000640 1 -- 172.21.15.88:0/1110811823 >> v1:172.21.15.88:6789/0 conn(0x7ffa600b7fd0 legacy=0x7ffa6014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa65000640 1 -- 172.21.15.88:0/1110811823 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa600b7280 con 0x7ffa600b5e70 2024-04-24T08:25:31.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.286+0000 7ffa5f400640 1 -- 172.21.15.88:0/1110811823 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288977608 0 0) 0x7ffa580014a0 con 0x7ffa600b7fd0 2024-04-24T08:25:31.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa65000640 1 --2- 172.21.15.88:0/1110811823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa600b5e70 0x7ffa60148450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa540097c0 tx=0x7ffa5401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7040b39b0e9df731 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:31.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa5f400640 1 -- 172.21.15.88:0/1110811823 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa540b0070 con 0x7ffa600b5e70 2024-04-24T08:25:31.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa5f400640 1 -- 172.21.15.88:0/1110811823 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa540ab600 con 0x7ffa600b5e70 2024-04-24T08:25:31.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa5f400640 1 -- 172.21.15.88:0/1110811823 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa540ab9d0 con 0x7ffa600b5e70 2024-04-24T08:25:31.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa66400640 1 -- 172.21.15.88:0/1110811823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa600b5e70 msgr2=0x7ffa60148450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa66400640 1 --2- 172.21.15.88:0/1110811823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa600b5e70 0x7ffa60148450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa540097c0 tx=0x7ffa5401c3e0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa66400640 1 -- 172.21.15.88:0/1110811823 shutdown_connections 2024-04-24T08:25:31.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa66400640 1 --2- 172.21.15.88:0/1110811823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa600b6250 0x7ffa60141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa66400640 1 --2- 172.21.15.88:0/1110811823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa600b5e70 0x7ffa60148450 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa66400640 1 -- 172.21.15.88:0/1110811823 >> 172.21.15.88:0/1110811823 conn(0x7ffa600bd650 msgr2=0x7ffa600bda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:31.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa66400640 1 -- 172.21.15.88:0/1110811823 shutdown_connections 2024-04-24T08:25:31.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa66400640 1 -- 172.21.15.88:0/1110811823 wait complete. 2024-04-24T08:25:31.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa66400640 1 Processor -- start 2024-04-24T08:25:31.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.290+0000 7ffa66400640 1 -- start start 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa66400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa600b5e70 0x7ffa60140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa66400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa600b6250 0x7ffa601e1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa66400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa600b7fd0 0x7ffa601e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa66400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffa60155350 con 0x7ffa600b7fd0 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa66400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ffa600b6e70 con 0x7ffa600b5e70 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa66400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ffa601554d0 con 0x7ffa600b6250 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa65a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa600b7fd0 0x7ffa601e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa65a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa600b7fd0 0x7ffa601e3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34464/0 (socket says 172.21.15.88:34464) 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa65a00640 1 -- 172.21.15.88:0/3469301326 learned_addr learned my addr 172.21.15.88:0/3469301326 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa5fe00640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa600b6250 0x7ffa601e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa65000640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa600b5e70 0x7ffa60140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa65a00640 1 -- 172.21.15.88:0/3469301326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa600b6250 msgr2=0x7ffa601e1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa65a00640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa600b6250 0x7ffa601e1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa65a00640 1 -- 172.21.15.88:0/3469301326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa600b5e70 msgr2=0x7ffa60140840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa65a00640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa600b5e70 0x7ffa60140840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa65a00640 1 -- 172.21.15.88:0/3469301326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa60135c60 con 0x7ffa600b7fd0 2024-04-24T08:25:31.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa5fe00640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa600b6250 0x7ffa601e1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:31.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa65a00640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa600b7fd0 0x7ffa601e3d20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800c780 tx=0x7ffa5800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:31.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa5cc00640 1 -- 172.21.15.88:0/3469301326 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58018070 con 0x7ffa600b7fd0 2024-04-24T08:25:31.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa5cc00640 1 -- 172.21.15.88:0/3469301326 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa58004d70 con 0x7ffa600b7fd0 2024-04-24T08:25:31.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa5cc00640 1 -- 172.21.15.88:0/3469301326 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800a880 con 0x7ffa600b7fd0 2024-04-24T08:25:31.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa66400640 1 -- 172.21.15.88:0/3469301326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa601e09c0 con 0x7ffa600b7fd0 2024-04-24T08:25:31.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa66400640 1 -- 172.21.15.88:0/3469301326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6013a730 con 0x7ffa600b7fd0 2024-04-24T08:25:31.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa66400640 1 -- 172.21.15.88:0/3469301326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa60068b20 con 0x7ffa600b7fd0 2024-04-24T08:25:31.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.294+0000 7ffa5cc00640 1 -- 172.21.15.88:0/3469301326 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffa5801b070 con 0x7ffa600b7fd0 2024-04-24T08:25:31.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.298+0000 7ffa5cc00640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ffa40068380 0x7ffa4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.298+0000 7ffa5cc00640 1 -- 172.21.15.88:0/3469301326 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffa58085e80 con 0x7ffa600b7fd0 2024-04-24T08:25:31.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.298+0000 7ffa65000640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ffa40068380 0x7ffa4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.298+0000 7ffa65000640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ffa40068380 0x7ffa4006a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffa540ad000 tx=0x7ffa540a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:31.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.302+0000 7ffa5cc00640 1 -- 172.21.15.88:0/3469301326 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa601479d0 con 0x7ffa600b7fd0 2024-04-24T08:25:31.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.490+0000 7ffa66400640 1 -- 172.21.15.88:0/3469301326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa60153120 con 0x7ffa600b7fd0 2024-04-24T08:25:31.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.490+0000 7ffa5cc00640 1 -- 172.21.15.88:0/3469301326 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7ffa58055de0 con 0x7ffa600b7fd0 2024-04-24T08:25:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:31.495 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1421585339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1421585339},{"type":"v1","addr":"172.21.15.142:6833","nonce":1421585339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:25:27.478065+0000","modified":"2024-04-24T08:25:30.500783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2851985776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2851985776},{"type":"v1","addr":"172.21.15.88:6835","nonce":2851985776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-24T08:25:31.495 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2024-04-24T08:25:31.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.490+0000 7ffa66400640 1 -- 172.21.15.88:0/3469301326 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ffa40068380 msgr2=0x7ffa4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.490+0000 7ffa66400640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ffa40068380 0x7ffa4006a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffa540ad000 tx=0x7ffa540a6000 comp rx=0 tx=0).stop 2024-04-24T08:25:31.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.490+0000 7ffa66400640 1 -- 172.21.15.88:0/3469301326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa600b7fd0 msgr2=0x7ffa601e3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.490+0000 7ffa66400640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa600b7fd0 0x7ffa601e3d20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800c780 tx=0x7ffa5800cc40 comp rx=0 tx=0).stop 2024-04-24T08:25:31.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.494+0000 7ffa66400640 1 -- 172.21.15.88:0/3469301326 shutdown_connections 2024-04-24T08:25:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.494+0000 7ffa66400640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ffa40068380 0x7ffa4006a840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.494+0000 7ffa66400640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa600b7fd0 0x7ffa601e3d20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.494+0000 7ffa66400640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa600b6250 0x7ffa601e1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.494+0000 7ffa66400640 1 --2- 172.21.15.88:0/3469301326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa600b5e70 0x7ffa60140840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.494+0000 7ffa66400640 1 -- 172.21.15.88:0/3469301326 >> 172.21.15.88:0/3469301326 conn(0x7ffa600bd650 msgr2=0x7ffa60074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.494+0000 7ffa66400640 1 -- 172.21.15.88:0/3469301326 shutdown_connections 2024-04-24T08:25:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.494+0000 7ffa66400640 1 -- 172.21.15.88:0/3469301326 wait complete. 2024-04-24T08:25:31.515 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:31.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fcec00640 1 Processor -- start 2024-04-24T08:25:31.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fcec00640 1 -- start start 2024-04-24T08:25:31.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fcec00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0fc80bbe40 0x7f0fc80b7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fcec00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc813fc10 0x7f0fc8145c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fcec00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc80bc220 con 0x7f0fc8140090 2024-04-24T08:25:31.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fcec00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc80ae930 con 0x7f0fc80bbe40 2024-04-24T08:25:31.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fcec00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc80aec10 con 0x7f0fc813fc10 2024-04-24T08:25:31.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fccc00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0fc8140090 0x7f0fc8072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59508/0 (socket says 172.21.15.88:59508) 2024-04-24T08:25:31.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fccc00640 1 -- 172.21.15.88:0/4277251550 learned_addr learned my addr 172.21.15.88:0/4277251550 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:31.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fbf400640 1 --2- 172.21.15.88:0/4277251550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc813fc10 0x7f0fc8145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7e00640 1 --2- 172.21.15.88:0/4277251550 >> v2:172.21.15.142:3300/0 conn(0x7f0fc80bbe40 0x7f0fc80b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634237312 0 0) 0x7f0fc80bc220 con 0x7f0fc8140090 2024-04-24T08:25:31.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fac003530 con 0x7f0fc8140090 2024-04-24T08:25:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4211773315 0 0) 0x7f0fac003530 con 0x7f0fc8140090 2024-04-24T08:25:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc813fc10 msgr2=0x7f0fc8145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 --2- 172.21.15.88:0/4277251550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc813fc10 0x7f0fc8145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 >> v2:172.21.15.142:3300/0 conn(0x7f0fc80bbe40 msgr2=0x7f0fc80b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 --2- 172.21.15.88:0/4277251550 >> v2:172.21.15.142:3300/0 conn(0x7f0fc80bbe40 0x7f0fc80b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc80b7d50 con 0x7f0fc8140090 2024-04-24T08:25:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f0fc0001680 con 0x7f0fc8140090 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7e00640 1 --2- 172.21.15.88:0/4277251550 >> v2:172.21.15.142:3300/0 conn(0x7f0fc80bbe40 0x7f0fc80b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 >> v1:172.21.15.88:6789/0 conn(0x7f0fc8140090 legacy=0x7f0fc8072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 --2- 172.21.15.88:0/4277251550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc813fc10 0x7f0fac0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 --2- 172.21.15.88:0/4277251550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fac003f40 0x7f0fac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 --2- 172.21.15.88:0/4277251550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fac004d50 0x7f0fac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc80ae930 con 0x7f0fac004d50 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc80aec10 con 0x7f0fac003f40 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0fac00bab0 con 0x7f0fc813fc10 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fccc00640 1 --2- 172.21.15.88:0/4277251550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fac004d50 0x7f0fac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.646+0000 7f0fc7e00640 1 --2- 172.21.15.88:0/4277251550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc813fc10 0x7f0fac0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fbf400640 1 --2- 172.21.15.88:0/4277251550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fac003f40 0x7f0fac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fccc00640 1 -- 172.21.15.88:0/4277251550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc813fc10 msgr2=0x7f0fac0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fccc00640 1 --2- 172.21.15.88:0/4277251550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc813fc10 0x7f0fac0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fccc00640 1 -- 172.21.15.88:0/4277251550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fac003f40 msgr2=0x7f0fac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fccc00640 1 --2- 172.21.15.88:0/4277251550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fac003f40 0x7f0fac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fccc00640 1 -- 172.21.15.88:0/4277251550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fac003530 con 0x7f0fac004d50 2024-04-24T08:25:31.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fccc00640 1 --2- 172.21.15.88:0/4277251550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fac004d50 0x7f0fac0051d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000c290 tx=0x7f0fc001cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20b16b983d83187 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:31.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0007d60 con 0x7f0fac004d50 2024-04-24T08:25:31.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc00a9020 con 0x7f0fac004d50 2024-04-24T08:25:31.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fc7400640 1 -- 172.21.15.88:0/4277251550 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0005ae0 con 0x7f0fac004d50 2024-04-24T08:25:31.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fcec00640 1 -- 172.21.15.88:0/4277251550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fac004d50 msgr2=0x7f0fac0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fcec00640 1 --2- 172.21.15.88:0/4277251550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fac004d50 0x7f0fac0051d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000c290 tx=0x7f0fc001cd20 comp rx=0 tx=0).stop 2024-04-24T08:25:31.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fccc00640 1 -- 172.21.15.88:0/4277251550 reap_dead start 2024-04-24T08:25:31.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fcec00640 1 -- 172.21.15.88:0/4277251550 shutdown_connections 2024-04-24T08:25:31.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.650+0000 7f0fcec00640 1 -- 172.21.15.88:0/4277251550 >> 172.21.15.88:0/4277251550 conn(0x7f0fc8067e10 msgr2=0x7f0fc80bb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:31.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fcec00640 1 -- 172.21.15.88:0/4277251550 shutdown_connections 2024-04-24T08:25:31.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fcec00640 1 -- 172.21.15.88:0/4277251550 wait complete. 2024-04-24T08:25:31.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fcec00640 1 Processor -- start 2024-04-24T08:25:31.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fcec00640 1 -- start start 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fcec00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fac004d50 0x7f0fc81e37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fcec00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc8150bd0 0x7f0fc806d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fcec00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80ad8d0 0x7f0fc8142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fcec00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc81515b0 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fcec00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc8151430 con 0x7f0fc8150bd0 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fcec00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc8151730 con 0x7f0fac004d50 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fccc00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80ad8d0 0x7f0fc8142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fccc00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80ad8d0 0x7f0fc8142b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34494/0 (socket says 172.21.15.88:34494) 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fccc00640 1 -- 172.21.15.88:0/2676213419 learned_addr learned my addr 172.21.15.88:0/2676213419 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fc7e00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fac004d50 0x7f0fc81e37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fbf400640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc8150bd0 0x7f0fc806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fccc00640 1 -- 172.21.15.88:0/2676213419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fac004d50 msgr2=0x7f0fc81e37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fccc00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fac004d50 0x7f0fc81e37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fccc00640 1 -- 172.21.15.88:0/2676213419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc8150bd0 msgr2=0x7f0fc806d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fccc00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc8150bd0 0x7f0fc806d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fccc00640 1 -- 172.21.15.88:0/2676213419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc806eaa0 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fccc00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80ad8d0 0x7f0fc8142b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00ab040 tx=0x7f0fac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:31.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fc4c00640 1 -- 172.21.15.88:0/2676213419 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0001c90 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fc4c00640 1 -- 172.21.15.88:0/2676213419 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc0004c00 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fc4c00640 1 -- 172.21.15.88:0/2676213419 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc00070d0 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fcec00640 1 -- 172.21.15.88:0/2676213419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc806d030 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.654+0000 7f0fcec00640 1 -- 172.21.15.88:0/2676213419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc806e7c0 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.658+0000 7f0fcec00640 1 -- 172.21.15.88:0/2676213419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc8068b90 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.658+0000 7f0fc4c00640 1 -- 172.21.15.88:0/2676213419 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0fc0007290 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.658+0000 7f0fc4c00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0fa4068380 0x7f0fa406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.658+0000 7f0fc4c00640 1 -- 172.21.15.88:0/2676213419 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0fc011fca0 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.658+0000 7f0fc7e00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0fa4068380 0x7f0fa406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.658+0000 7f0fc7e00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0fa4068380 0x7f0fa406a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009d40 tx=0x7f0fb8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:31.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.662+0000 7f0fc4c00640 1 -- 172.21.15.88:0/2676213419 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0fc00b4070 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.822+0000 7f0fcec00640 1 -- 172.21.15.88:0/2676213419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0fc806edf0 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.822+0000 7f0fc4c00640 1 -- 172.21.15.88:0/2676213419 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f0fc0016a30 con 0x7f0fc80ad8d0 2024-04-24T08:25:31.827 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:31.828 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:31.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.826+0000 7f0fcec00640 1 -- 172.21.15.88:0/2676213419 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0fa4068380 msgr2=0x7f0fa406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.826+0000 7f0fcec00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0fa4068380 0x7f0fa406a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009d40 tx=0x7f0fb8009190 comp rx=0 tx=0).stop 2024-04-24T08:25:31.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.826+0000 7f0fcec00640 1 -- 172.21.15.88:0/2676213419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80ad8d0 msgr2=0x7f0fc8142b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.826+0000 7f0fcec00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80ad8d0 0x7f0fc8142b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00ab040 tx=0x7f0fac005840 comp rx=0 tx=0).stop 2024-04-24T08:25:31.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.826+0000 7f0fcec00640 1 -- 172.21.15.88:0/2676213419 shutdown_connections 2024-04-24T08:25:31.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.826+0000 7f0fcec00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0fa4068380 0x7f0fa406a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.826+0000 7f0fcec00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fc80ad8d0 0x7f0fc8142b30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.826+0000 7f0fcec00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc8150bd0 0x7f0fc806d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.826+0000 7f0fcec00640 1 --2- 172.21.15.88:0/2676213419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fac004d50 0x7f0fc81e37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.826+0000 7f0fcec00640 1 -- 172.21.15.88:0/2676213419 >> 172.21.15.88:0/2676213419 conn(0x7f0fc8067e10 msgr2=0x7f0fc813d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:31.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.826+0000 7f0fcec00640 1 -- 172.21.15.88:0/2676213419 shutdown_connections 2024-04-24T08:25:31.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.826+0000 7f0fcec00640 1 -- 172.21.15.88:0/2676213419 wait complete. 2024-04-24T08:25:31.848 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-24T08:25:31.849 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:25:31.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9837000640 1 Processor -- start 2024-04-24T08:25:31.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9837000640 1 -- start start 2024-04-24T08:25:31.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9837000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f98300b7400 0x7f98300ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9837000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9830145ec0 0x7f9830150780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9837000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98300b64e0 con 0x7f98300a94c0 2024-04-24T08:25:31.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9837000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f98300b77e0 con 0x7f9830145ec0 2024-04-24T08:25:31.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9837000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f98300b69e0 con 0x7f98300b7400 2024-04-24T08:25:31.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9835000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9830145ec0 0x7f9830150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9827400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f98300a94c0 0x7f98301466b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59522/0 (socket says 172.21.15.88:59522) 2024-04-24T08:25:31.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9827400640 1 -- 172.21.15.88:0/2531835013 learned_addr learned my addr 172.21.15.88:0/2531835013 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:31.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f982fe00640 1 --2- 172.21.15.88:0/2531835013 >> v2:172.21.15.142:3300/0 conn(0x7f98300b7400 0x7f98300ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9835000640 1 -- 172.21.15.88:0/2531835013 >> v2:172.21.15.142:3300/0 conn(0x7f98300b7400 msgr2=0x7f98300ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:31.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9835000640 1 --2- 172.21.15.88:0/2531835013 >> v2:172.21.15.142:3300/0 conn(0x7f98300b7400 0x7f98300ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9835000640 1 -- 172.21.15.88:0/2531835013 >> v1:172.21.15.88:6789/0 conn(0x7f98300a94c0 legacy=0x7f98301466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9835000640 1 -- 172.21.15.88:0/2531835013 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98300b6700 con 0x7f9830145ec0 2024-04-24T08:25:31.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f982f400640 1 -- 172.21.15.88:0/2531835013 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211348980 0 0) 0x7f98300b64e0 con 0x7f98300a94c0 2024-04-24T08:25:31.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9835000640 1 --2- 172.21.15.88:0/2531835013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9830145ec0 0x7f9830150780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98300bc670 tx=0x7f982801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9572cfd2f5fad9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:31.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f982f400640 1 -- 172.21.15.88:0/2531835013 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98280b2070 con 0x7f9830145ec0 2024-04-24T08:25:31.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f982f400640 1 -- 172.21.15.88:0/2531835013 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98280a5830 con 0x7f9830145ec0 2024-04-24T08:25:31.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f982f400640 1 -- 172.21.15.88:0/2531835013 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98280a5c00 con 0x7f9830145ec0 2024-04-24T08:25:31.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9837000640 1 -- 172.21.15.88:0/2531835013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9830145ec0 msgr2=0x7f9830150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.982+0000 7f9837000640 1 --2- 172.21.15.88:0/2531835013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9830145ec0 0x7f9830150780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98300bc670 tx=0x7f982801c8a0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 -- 172.21.15.88:0/2531835013 shutdown_connections 2024-04-24T08:25:31.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 --2- 172.21.15.88:0/2531835013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9830145ec0 0x7f9830150780 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 --2- 172.21.15.88:0/2531835013 >> v2:172.21.15.142:3300/0 conn(0x7f98300b7400 0x7f98300ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 -- 172.21.15.88:0/2531835013 >> 172.21.15.88:0/2531835013 conn(0x7f9830067810 msgr2=0x7f9830067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:31.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 -- 172.21.15.88:0/2531835013 shutdown_connections 2024-04-24T08:25:31.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 -- 172.21.15.88:0/2531835013 wait complete. 2024-04-24T08:25:31.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 Processor -- start 2024-04-24T08:25:31.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 -- start start 2024-04-24T08:25:31.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98300b7400 0x7f983013ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9830145ec0 0x7f98301e0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98300b9870 0x7f98301386a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f98300b7cd0 con 0x7f98300b9870 2024-04-24T08:25:31.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f98300b5eb0 con 0x7f98300b7400 2024-04-24T08:25:31.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f98300b7e50 con 0x7f9830145ec0 2024-04-24T08:25:31.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9835000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98300b9870 0x7f98301386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9835000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98300b9870 0x7f98301386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34510/0 (socket says 172.21.15.88:34510) 2024-04-24T08:25:31.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9835000640 1 -- 172.21.15.88:0/3693907783 learned_addr learned my addr 172.21.15.88:0/3693907783 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:31.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f982fe00640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98300b7400 0x7f983013ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9827400640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9830145ec0 0x7f98301e0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9835000640 1 -- 172.21.15.88:0/3693907783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9830145ec0 msgr2=0x7f98301e0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9835000640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9830145ec0 0x7f98301e0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9835000640 1 -- 172.21.15.88:0/3693907783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98300b7400 msgr2=0x7f983013ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9835000640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98300b7400 0x7f983013ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9835000640 1 -- 172.21.15.88:0/3693907783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98301e0a50 con 0x7f98300b9870 2024-04-24T08:25:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9827400640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9830145ec0 0x7f98301e0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9835000640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98300b9870 0x7f98301386a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f982801a4d0 tx=0x7f9828019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f982cc00640 1 -- 172.21.15.88:0/3693907783 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98280b2050 con 0x7f98300b9870 2024-04-24T08:25:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f982cc00640 1 -- 172.21.15.88:0/3693907783 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98280be070 con 0x7f98300b9870 2024-04-24T08:25:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f9837000640 1 -- 172.21.15.88:0/3693907783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98300bb380 con 0x7f98300b9870 2024-04-24T08:25:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.986+0000 7f982cc00640 1 -- 172.21.15.88:0/3693907783 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98280ada90 con 0x7f98300b9870 2024-04-24T08:25:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.990+0000 7f9837000640 1 -- 172.21.15.88:0/3693907783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98300ba060 con 0x7f98300b9870 2024-04-24T08:25:31.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.990+0000 7f9837000640 1 -- 172.21.15.88:0/3693907783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9830068b90 con 0x7f98300b9870 2024-04-24T08:25:31.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.990+0000 7f982cc00640 1 -- 172.21.15.88:0/3693907783 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98280a56b0 con 0x7f98300b9870 2024-04-24T08:25:31.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.990+0000 7f982cc00640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f980c068380 0x7f980c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:31.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.990+0000 7f982cc00640 1 -- 172.21.15.88:0/3693907783 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9828121a10 con 0x7f98300b9870 2024-04-24T08:25:31.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.990+0000 7f982fe00640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f980c068380 0x7f980c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:31.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.990+0000 7f982fe00640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f980c068380 0x7f980c06a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9820009b60 tx=0x7f9820009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:32.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:31.994+0000 7f982cc00640 1 -- 172.21.15.88:0/3693907783 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9828016520 con 0x7f98300b9870 2024-04-24T08:25:32.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.150+0000 7f9837000640 1 -- 172.21.15.88:0/3693907783 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f98301442b0 con 0x7f980c068380 2024-04-24T08:25:32.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f982cc00640 1 -- 172.21.15.88:0/3693907783 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251910 (secure 0 0 0) 0x7f98301442b0 con 0x7f980c068380 2024-04-24T08:25:32.165 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:32.167 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:25:32.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f9837000640 1 -- 172.21.15.88:0/3693907783 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f980c068380 msgr2=0x7f980c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f9837000640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f980c068380 0x7f980c06a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9820009b60 tx=0x7f9820009190 comp rx=0 tx=0).stop 2024-04-24T08:25:32.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f9837000640 1 -- 172.21.15.88:0/3693907783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98300b9870 msgr2=0x7f98301386a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f9837000640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98300b9870 0x7f98301386a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f982801a4d0 tx=0x7f9828019640 comp rx=0 tx=0).stop 2024-04-24T08:25:32.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f9837000640 1 -- 172.21.15.88:0/3693907783 shutdown_connections 2024-04-24T08:25:32.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f9837000640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f980c068380 0x7f980c06a840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f9837000640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98300b9870 0x7f98301386a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f9837000640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9830145ec0 0x7f98301e0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f9837000640 1 --2- 172.21.15.88:0/3693907783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98300b7400 0x7f983013ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f9837000640 1 -- 172.21.15.88:0/3693907783 >> 172.21.15.88:0/3693907783 conn(0x7f9830067810 msgr2=0x7f98301447d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:32.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f9837000640 1 -- 172.21.15.88:0/3693907783 shutdown_connections 2024-04-24T08:25:32.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.162+0000 7f9837000640 1 -- 172.21.15.88:0/3693907783 wait complete. 2024-04-24T08:25:32.184 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-24T08:25:30.988404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218936,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755784,"statfs":{"total":773094113280,"available":772869922816,"internally_reserved":0,"allocated":2830336,"data_stored":1721528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.906581"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487790+0000","last_change":"2024-04-24T08:25:28.122966+0000","last_active":"2024-04-24T08:25:29.487790+0000","last_peered":"2024-04-24T08:25:29.487790+0000","last_clean":"2024-04-24T08:25:29.487790+0000","last_became_active":"2024-04-24T08:25:28.122377+0000","last_became_peered":"2024-04-24T08:25:28.122377+0000","last_unstale":"2024-04-24T08:25:29.487790+0000","last_undegraded":"2024-04-24T08:25:29.487790+0000","last_fullsized":"2024-04-24T08:25:29.487790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:18.049288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116977+0000","last_change":"2024-04-24T08:25:28.107616+0000","last_active":"2024-04-24T08:25:29.116977+0000","last_peered":"2024-04-24T08:25:29.116977+0000","last_clean":"2024-04-24T08:25:29.116977+0000","last_became_active":"2024-04-24T08:25:28.107282+0000","last_became_peered":"2024-04-24T08:25:28.107282+0000","last_unstale":"2024-04-24T08:25:29.116977+0000","last_undegraded":"2024-04-24T08:25:29.116977+0000","last_fullsized":"2024-04-24T08:25:29.116977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.125657+0000","last_change":"2024-04-24T08:25:28.107850+0000","last_active":"2024-04-24T08:25:28.125657+0000","last_peered":"2024-04-24T08:25:28.125657+0000","last_clean":"2024-04-24T08:25:28.125657+0000","last_became_active":"2024-04-24T08:25:28.105595+0000","last_became_peered":"2024-04-24T08:25:28.105595+0000","last_unstale":"2024-04-24T08:25:28.125657+0000","last_undegraded":"2024-04-24T08:25:28.125657+0000","last_fullsized":"2024-04-24T08:25:28.125657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:30.858353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118650+0000","last_change":"2024-04-24T08:25:28.131587+0000","last_active":"2024-04-24T08:25:29.118650+0000","last_peered":"2024-04-24T08:25:29.118650+0000","last_clean":"2024-04-24T08:25:29.118650+0000","last_became_active":"2024-04-24T08:25:28.131271+0000","last_became_peered":"2024-04-24T08:25:28.131271+0000","last_unstale":"2024-04-24T08:25:29.118650+0000","last_undegraded":"2024-04-24T08:25:29.118650+0000","last_fullsized":"2024-04-24T08:25:29.118650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:17.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487906+0000","last_change":"2024-04-24T08:25:28.119186+0000","last_active":"2024-04-24T08:25:29.487906+0000","last_peered":"2024-04-24T08:25:29.487906+0000","last_clean":"2024-04-24T08:25:29.487906+0000","last_became_active":"2024-04-24T08:25:28.118470+0000","last_became_peered":"2024-04-24T08:25:28.118470+0000","last_unstale":"2024-04-24T08:25:29.487906+0000","last_undegraded":"2024-04-24T08:25:29.487906+0000","last_fullsized":"2024-04-24T08:25:29.487906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:08:53.886358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118414+0000","last_change":"2024-04-24T08:25:28.110827+0000","last_active":"2024-04-24T08:25:29.118414+0000","last_peered":"2024-04-24T08:25:29.118414+0000","last_clean":"2024-04-24T08:25:29.118414+0000","last_became_active":"2024-04-24T08:25:28.110542+0000","last_became_peered":"2024-04-24T08:25:28.110542+0000","last_unstale":"2024-04-24T08:25:29.118414+0000","last_undegraded":"2024-04-24T08:25:29.118414+0000","last_fullsized":"2024-04-24T08:25:29.118414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487112+0000","last_change":"2024-04-24T08:25:28.122530+0000","last_active":"2024-04-24T08:25:29.487112+0000","last_peered":"2024-04-24T08:25:29.487112+0000","last_clean":"2024-04-24T08:25:29.487112+0000","last_became_active":"2024-04-24T08:25:28.121676+0000","last_became_peered":"2024-04-24T08:25:28.121676+0000","last_unstale":"2024-04-24T08:25:29.487112+0000","last_undegraded":"2024-04-24T08:25:29.487112+0000","last_fullsized":"2024-04-24T08:25:29.487112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:27:07.262422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.137264+0000","last_change":"2024-04-24T08:25:28.133406+0000","last_active":"2024-04-24T08:25:28.137264+0000","last_peered":"2024-04-24T08:25:28.137264+0000","last_clean":"2024-04-24T08:25:28.137264+0000","last_became_active":"2024-04-24T08:25:28.132708+0000","last_became_peered":"2024-04-24T08:25:28.132708+0000","last_unstale":"2024-04-24T08:25:28.137264+0000","last_undegraded":"2024-04-24T08:25:28.137264+0000","last_fullsized":"2024-04-24T08:25:28.137264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:43:07.823084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487778+0000","last_change":"2024-04-24T08:25:28.126548+0000","last_active":"2024-04-24T08:25:29.487778+0000","last_peered":"2024-04-24T08:25:29.487778+0000","last_clean":"2024-04-24T08:25:29.487778+0000","last_became_active":"2024-04-24T08:25:28.126116+0000","last_became_peered":"2024-04-24T08:25:28.126116+0000","last_unstale":"2024-04-24T08:25:29.487778+0000","last_undegraded":"2024-04-24T08:25:29.487778+0000","last_fullsized":"2024-04-24T08:25:29.487778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:09.839576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.121293+0000","last_change":"2024-04-24T08:25:28.117731+0000","last_active":"2024-04-24T08:25:28.121293+0000","last_peered":"2024-04-24T08:25:28.121293+0000","last_clean":"2024-04-24T08:25:28.121293+0000","last_became_active":"2024-04-24T08:25:28.116901+0000","last_became_peered":"2024-04-24T08:25:28.116901+0000","last_unstale":"2024-04-24T08:25:28.121293+0000","last_undegraded":"2024-04-24T08:25:28.121293+0000","last_fullsized":"2024-04-24T08:25:28.121293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:54.349880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.128955+0000","last_change":"2024-04-24T08:25:28.120314+0000","last_active":"2024-04-24T08:25:28.128955+0000","last_peered":"2024-04-24T08:25:28.128955+0000","last_clean":"2024-04-24T08:25:28.128955+0000","last_became_active":"2024-04-24T08:25:28.118691+0000","last_became_peered":"2024-04-24T08:25:28.118691+0000","last_unstale":"2024-04-24T08:25:28.128955+0000","last_undegraded":"2024-04-24T08:25:28.128955+0000","last_fullsized":"2024-04-24T08:25:28.128955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:06:08.052785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.120168+0000","last_change":"2024-04-24T08:25:28.126862+0000","last_active":"2024-04-24T08:25:29.120168+0000","last_peered":"2024-04-24T08:25:29.120168+0000","last_clean":"2024-04-24T08:25:29.120168+0000","last_became_active":"2024-04-24T08:25:28.126543+0000","last_became_peered":"2024-04-24T08:25:28.126543+0000","last_unstale":"2024-04-24T08:25:29.120168+0000","last_undegraded":"2024-04-24T08:25:29.120168+0000","last_fullsized":"2024-04-24T08:25:29.120168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:54.349880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.135487+0000","last_change":"2024-04-24T08:25:28.127815+0000","last_active":"2024-04-24T08:25:28.135487+0000","last_peered":"2024-04-24T08:25:28.135487+0000","last_clean":"2024-04-24T08:25:28.135487+0000","last_became_active":"2024-04-24T08:25:28.127026+0000","last_became_peered":"2024-04-24T08:25:28.127026+0000","last_unstale":"2024-04-24T08:25:28.135487+0000","last_undegraded":"2024-04-24T08:25:28.135487+0000","last_fullsized":"2024-04-24T08:25:28.135487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:50.820048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.122022+0000","last_change":"2024-04-24T08:25:28.110471+0000","last_active":"2024-04-24T08:25:28.122022+0000","last_peered":"2024-04-24T08:25:28.122022+0000","last_clean":"2024-04-24T08:25:28.122022+0000","last_became_active":"2024-04-24T08:25:28.109175+0000","last_became_peered":"2024-04-24T08:25:28.109175+0000","last_unstale":"2024-04-24T08:25:28.122022+0000","last_undegraded":"2024-04-24T08:25:28.122022+0000","last_fullsized":"2024-04-24T08:25:28.122022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:50.820048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116748+0000","last_change":"2024-04-24T08:25:28.115093+0000","last_active":"2024-04-24T08:25:29.116748+0000","last_peered":"2024-04-24T08:25:29.116748+0000","last_clean":"2024-04-24T08:25:29.116748+0000","last_became_active":"2024-04-24T08:25:28.114782+0000","last_became_peered":"2024-04-24T08:25:28.114782+0000","last_unstale":"2024-04-24T08:25:29.116748+0000","last_undegraded":"2024-04-24T08:25:29.116748+0000","last_fullsized":"2024-04-24T08:25:29.116748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:03:04.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118502+0000","last_change":"2024-04-24T08:25:28.108967+0000","last_active":"2024-04-24T08:25:29.118502+0000","last_peered":"2024-04-24T08:25:29.118502+0000","last_clean":"2024-04-24T08:25:29.118502+0000","last_became_active":"2024-04-24T08:25:28.108627+0000","last_became_peered":"2024-04-24T08:25:28.108627+0000","last_unstale":"2024-04-24T08:25:29.118502+0000","last_undegraded":"2024-04-24T08:25:29.118502+0000","last_fullsized":"2024-04-24T08:25:29.118502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:01:48.875146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119667+0000","last_change":"2024-04-24T08:25:28.120983+0000","last_active":"2024-04-24T08:25:29.119667+0000","last_peered":"2024-04-24T08:25:29.119667+0000","last_clean":"2024-04-24T08:25:29.119667+0000","last_became_active":"2024-04-24T08:25:28.120054+0000","last_became_peered":"2024-04-24T08:25:28.120054+0000","last_unstale":"2024-04-24T08:25:29.119667+0000","last_undegraded":"2024-04-24T08:25:29.119667+0000","last_fullsized":"2024-04-24T08:25:29.119667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:09.839576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.134619+0000","last_change":"2024-04-24T08:25:28.119368+0000","last_active":"2024-04-24T08:25:28.134619+0000","last_peered":"2024-04-24T08:25:28.134619+0000","last_clean":"2024-04-24T08:25:28.134619+0000","last_became_active":"2024-04-24T08:25:28.118968+0000","last_became_peered":"2024-04-24T08:25:28.118968+0000","last_unstale":"2024-04-24T08:25:28.134619+0000","last_undegraded":"2024-04-24T08:25:28.134619+0000","last_fullsized":"2024-04-24T08:25:28.134619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:07.862635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487555+0000","last_change":"2024-04-24T08:25:28.136211+0000","last_active":"2024-04-24T08:25:29.487555+0000","last_peered":"2024-04-24T08:25:29.487555+0000","last_clean":"2024-04-24T08:25:29.487555+0000","last_became_active":"2024-04-24T08:25:28.135915+0000","last_became_peered":"2024-04-24T08:25:28.135915+0000","last_unstale":"2024-04-24T08:25:29.487555+0000","last_undegraded":"2024-04-24T08:25:29.487555+0000","last_fullsized":"2024-04-24T08:25:29.487555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:05:08.000888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.133156+0000","last_change":"2024-04-24T08:25:28.128288+0000","last_active":"2024-04-24T08:25:28.133156+0000","last_peered":"2024-04-24T08:25:28.133156+0000","last_clean":"2024-04-24T08:25:28.133156+0000","last_became_active":"2024-04-24T08:25:28.127975+0000","last_became_peered":"2024-04-24T08:25:28.127975+0000","last_unstale":"2024-04-24T08:25:28.133156+0000","last_undegraded":"2024-04-24T08:25:28.133156+0000","last_fullsized":"2024-04-24T08:25:28.133156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:20:03.401225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126265+0000","last_change":"2024-04-24T08:25:28.119997+0000","last_active":"2024-04-24T08:25:28.126265+0000","last_peered":"2024-04-24T08:25:28.126265+0000","last_clean":"2024-04-24T08:25:28.126265+0000","last_became_active":"2024-04-24T08:25:28.119394+0000","last_became_peered":"2024-04-24T08:25:28.119394+0000","last_unstale":"2024-04-24T08:25:28.126265+0000","last_undegraded":"2024-04-24T08:25:28.126265+0000","last_fullsized":"2024-04-24T08:25:28.126265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:55.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118478+0000","last_change":"2024-04-24T08:25:28.115607+0000","last_active":"2024-04-24T08:25:29.118478+0000","last_peered":"2024-04-24T08:25:29.118478+0000","last_clean":"2024-04-24T08:25:29.118478+0000","last_became_active":"2024-04-24T08:25:28.115310+0000","last_became_peered":"2024-04-24T08:25:28.115310+0000","last_unstale":"2024-04-24T08:25:29.118478+0000","last_undegraded":"2024-04-24T08:25:29.118478+0000","last_fullsized":"2024-04-24T08:25:29.118478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136473+0000","last_change":"2024-04-24T08:25:28.129517+0000","last_active":"2024-04-24T08:25:28.136473+0000","last_peered":"2024-04-24T08:25:28.136473+0000","last_clean":"2024-04-24T08:25:28.136473+0000","last_became_active":"2024-04-24T08:25:28.129258+0000","last_became_peered":"2024-04-24T08:25:28.129258+0000","last_unstale":"2024-04-24T08:25:28.136473+0000","last_undegraded":"2024-04-24T08:25:28.136473+0000","last_fullsized":"2024-04-24T08:25:28.136473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:55.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118686+0000","last_change":"2024-04-24T08:25:28.129391+0000","last_active":"2024-04-24T08:25:29.118686+0000","last_peered":"2024-04-24T08:25:29.118686+0000","last_clean":"2024-04-24T08:25:29.118686+0000","last_became_active":"2024-04-24T08:25:28.128991+0000","last_became_peered":"2024-04-24T08:25:28.128991+0000","last_unstale":"2024-04-24T08:25:29.118686+0000","last_undegraded":"2024-04-24T08:25:29.118686+0000","last_fullsized":"2024-04-24T08:25:29.118686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:39.021977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136849+0000","last_change":"2024-04-24T08:25:28.132732+0000","last_active":"2024-04-24T08:25:28.136849+0000","last_peered":"2024-04-24T08:25:28.136849+0000","last_clean":"2024-04-24T08:25:28.136849+0000","last_became_active":"2024-04-24T08:25:28.132493+0000","last_became_peered":"2024-04-24T08:25:28.132493+0000","last_unstale":"2024-04-24T08:25:28.136849+0000","last_undegraded":"2024-04-24T08:25:28.136849+0000","last_fullsized":"2024-04-24T08:25:28.136849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:30.805709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.121315+0000","last_change":"2024-04-24T08:25:28.118797+0000","last_active":"2024-04-24T08:25:28.121315+0000","last_peered":"2024-04-24T08:25:28.121315+0000","last_clean":"2024-04-24T08:25:28.121315+0000","last_became_active":"2024-04-24T08:25:28.118073+0000","last_became_peered":"2024-04-24T08:25:28.118073+0000","last_unstale":"2024-04-24T08:25:28.121315+0000","last_undegraded":"2024-04-24T08:25:28.121315+0000","last_fullsized":"2024-04-24T08:25:28.121315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:46.419388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116765+0000","last_change":"2024-04-24T08:25:28.131235+0000","last_active":"2024-04-24T08:25:29.116765+0000","last_peered":"2024-04-24T08:25:29.116765+0000","last_clean":"2024-04-24T08:25:29.116765+0000","last_became_active":"2024-04-24T08:25:28.130932+0000","last_became_peered":"2024-04-24T08:25:28.130932+0000","last_unstale":"2024-04-24T08:25:29.116765+0000","last_undegraded":"2024-04-24T08:25:29.116765+0000","last_fullsized":"2024-04-24T08:25:29.116765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.137243+0000","last_change":"2024-04-24T08:25:28.134992+0000","last_active":"2024-04-24T08:25:28.137243+0000","last_peered":"2024-04-24T08:25:28.137243+0000","last_clean":"2024-04-24T08:25:28.137243+0000","last_became_active":"2024-04-24T08:25:28.134739+0000","last_became_peered":"2024-04-24T08:25:28.134739+0000","last_unstale":"2024-04-24T08:25:28.137243+0000","last_undegraded":"2024-04-24T08:25:28.137243+0000","last_fullsized":"2024-04-24T08:25:28.137243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:13.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136342+0000","last_change":"2024-04-24T08:25:28.131466+0000","last_active":"2024-04-24T08:25:28.136342+0000","last_peered":"2024-04-24T08:25:28.136342+0000","last_clean":"2024-04-24T08:25:28.136342+0000","last_became_active":"2024-04-24T08:25:28.131050+0000","last_became_peered":"2024-04-24T08:25:28.131050+0000","last_unstale":"2024-04-24T08:25:28.136342+0000","last_undegraded":"2024-04-24T08:25:28.136342+0000","last_fullsized":"2024-04-24T08:25:28.136342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:30.805709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118638+0000","last_change":"2024-04-24T08:25:28.136036+0000","last_active":"2024-04-24T08:25:29.118638+0000","last_peered":"2024-04-24T08:25:29.118638+0000","last_clean":"2024-04-24T08:25:29.118638+0000","last_became_active":"2024-04-24T08:25:28.135525+0000","last_became_peered":"2024-04-24T08:25:28.135525+0000","last_unstale":"2024-04-24T08:25:29.118638+0000","last_undegraded":"2024-04-24T08:25:29.118638+0000","last_fullsized":"2024-04-24T08:25:29.118638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:27:07.262422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.128342+0000","last_change":"2024-04-24T08:25:28.114519+0000","last_active":"2024-04-24T08:25:28.128342+0000","last_peered":"2024-04-24T08:25:28.128342+0000","last_clean":"2024-04-24T08:25:28.128342+0000","last_became_active":"2024-04-24T08:25:28.114247+0000","last_became_peered":"2024-04-24T08:25:28.114247+0000","last_unstale":"2024-04-24T08:25:28.128342+0000","last_undegraded":"2024-04-24T08:25:28.128342+0000","last_fullsized":"2024-04-24T08:25:28.128342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:57.325390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.132090+0000","last_change":"2024-04-24T08:25:28.123399+0000","last_active":"2024-04-24T08:25:28.132090+0000","last_peered":"2024-04-24T08:25:28.132090+0000","last_clean":"2024-04-24T08:25:28.132090+0000","last_became_active":"2024-04-24T08:25:28.123078+0000","last_became_peered":"2024-04-24T08:25:28.123078+0000","last_unstale":"2024-04-24T08:25:28.132090+0000","last_undegraded":"2024-04-24T08:25:28.132090+0000","last_fullsized":"2024-04-24T08:25:28.132090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:30.805709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119086+0000","last_change":"2024-04-24T08:25:28.106959+0000","last_active":"2024-04-24T08:25:29.119086+0000","last_peered":"2024-04-24T08:25:29.119086+0000","last_clean":"2024-04-24T08:25:29.119086+0000","last_became_active":"2024-04-24T08:25:28.106686+0000","last_became_peered":"2024-04-24T08:25:28.106686+0000","last_unstale":"2024-04-24T08:25:29.119086+0000","last_undegraded":"2024-04-24T08:25:29.119086+0000","last_fullsized":"2024-04-24T08:25:29.119086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:07.862635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.134793+0000","last_change":"2024-04-24T08:25:27.115877+0000","last_active":"2024-04-24T08:25:28.134793+0000","last_peered":"2024-04-24T08:25:28.134793+0000","last_clean":"2024-04-24T08:25:28.134793+0000","last_became_active":"2024-04-24T08:25:27.115544+0000","last_became_peered":"2024-04-24T08:25:27.115544+0000","last_unstale":"2024-04-24T08:25:28.134793+0000","last_undegraded":"2024-04-24T08:25:28.134793+0000","last_fullsized":"2024-04-24T08:25:28.134793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:24.009056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126284+0000","last_change":"2024-04-24T08:25:28.120172+0000","last_active":"2024-04-24T08:25:28.126284+0000","last_peered":"2024-04-24T08:25:28.126284+0000","last_clean":"2024-04-24T08:25:28.126284+0000","last_became_active":"2024-04-24T08:25:28.119756+0000","last_became_peered":"2024-04-24T08:25:28.119756+0000","last_unstale":"2024-04-24T08:25:28.126284+0000","last_undegraded":"2024-04-24T08:25:28.126284+0000","last_fullsized":"2024-04-24T08:25:28.126284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:54.349880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126587+0000","last_change":"2024-04-24T08:25:27.123186+0000","last_active":"2024-04-24T08:25:28.126587+0000","last_peered":"2024-04-24T08:25:28.126587+0000","last_clean":"2024-04-24T08:25:28.126587+0000","last_became_active":"2024-04-24T08:25:27.122910+0000","last_became_peered":"2024-04-24T08:25:27.122910+0000","last_unstale":"2024-04-24T08:25:28.126587+0000","last_undegraded":"2024-04-24T08:25:28.126587+0000","last_fullsized":"2024-04-24T08:25:28.126587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.122760+0000","last_change":"2024-04-24T08:25:27.120630+0000","last_active":"2024-04-24T08:25:28.122760+0000","last_peered":"2024-04-24T08:25:28.122760+0000","last_clean":"2024-04-24T08:25:28.122760+0000","last_became_active":"2024-04-24T08:25:27.119902+0000","last_became_peered":"2024-04-24T08:25:27.119902+0000","last_unstale":"2024-04-24T08:25:28.122760+0000","last_undegraded":"2024-04-24T08:25:28.122760+0000","last_fullsized":"2024-04-24T08:25:28.122760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:59:36.122581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136893+0000","last_change":"2024-04-24T08:25:28.131546+0000","last_active":"2024-04-24T08:25:28.136893+0000","last_peered":"2024-04-24T08:25:28.136893+0000","last_clean":"2024-04-24T08:25:28.136893+0000","last_became_active":"2024-04-24T08:25:28.131273+0000","last_became_peered":"2024-04-24T08:25:28.131273+0000","last_unstale":"2024-04-24T08:25:28.136893+0000","last_undegraded":"2024-04-24T08:25:28.136893+0000","last_fullsized":"2024-04-24T08:25:28.136893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:06:08.052785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118787+0000","last_change":"2024-04-24T08:25:27.107828+0000","last_active":"2024-04-24T08:25:29.118787+0000","last_peered":"2024-04-24T08:25:29.118787+0000","last_clean":"2024-04-24T08:25:29.118787+0000","last_became_active":"2024-04-24T08:25:27.107464+0000","last_became_peered":"2024-04-24T08:25:27.107464+0000","last_unstale":"2024-04-24T08:25:29.118787+0000","last_undegraded":"2024-04-24T08:25:29.118787+0000","last_fullsized":"2024-04-24T08:25:29.118787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:56.317954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116595+0000","last_change":"2024-04-24T08:25:28.129575+0000","last_active":"2024-04-24T08:25:29.116595+0000","last_peered":"2024-04-24T08:25:29.116595+0000","last_clean":"2024-04-24T08:25:29.116595+0000","last_became_active":"2024-04-24T08:25:28.129273+0000","last_became_peered":"2024-04-24T08:25:28.129273+0000","last_unstale":"2024-04-24T08:25:29.116595+0000","last_undegraded":"2024-04-24T08:25:29.116595+0000","last_fullsized":"2024-04-24T08:25:29.116595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:18.585938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.110974+0000","last_change":"2024-04-24T08:25:27.119751+0000","last_active":"2024-04-24T08:25:28.110974+0000","last_peered":"2024-04-24T08:25:28.110974+0000","last_clean":"2024-04-24T08:25:28.110974+0000","last_became_active":"2024-04-24T08:25:27.117532+0000","last_became_peered":"2024-04-24T08:25:27.117532+0000","last_unstale":"2024-04-24T08:25:28.110974+0000","last_undegraded":"2024-04-24T08:25:28.110974+0000","last_fullsized":"2024-04-24T08:25:28.110974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119157+0000","last_change":"2024-04-24T08:25:28.114763+0000","last_active":"2024-04-24T08:25:29.119157+0000","last_peered":"2024-04-24T08:25:29.119157+0000","last_clean":"2024-04-24T08:25:29.119157+0000","last_became_active":"2024-04-24T08:25:28.114494+0000","last_became_peered":"2024-04-24T08:25:28.114494+0000","last_unstale":"2024-04-24T08:25:29.119157+0000","last_undegraded":"2024-04-24T08:25:29.119157+0000","last_fullsized":"2024-04-24T08:25:29.119157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:19:25.270847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119337+0000","last_change":"2024-04-24T08:25:27.119512+0000","last_active":"2024-04-24T08:25:29.119337+0000","last_peered":"2024-04-24T08:25:29.119337+0000","last_clean":"2024-04-24T08:25:29.119337+0000","last_became_active":"2024-04-24T08:25:27.119197+0000","last_became_peered":"2024-04-24T08:25:27.119197+0000","last_unstale":"2024-04-24T08:25:29.119337+0000","last_undegraded":"2024-04-24T08:25:29.119337+0000","last_fullsized":"2024-04-24T08:25:29.119337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126724+0000","last_change":"2024-04-24T08:25:28.122927+0000","last_active":"2024-04-24T08:25:28.126724+0000","last_peered":"2024-04-24T08:25:28.126724+0000","last_clean":"2024-04-24T08:25:28.126724+0000","last_became_active":"2024-04-24T08:25:28.122632+0000","last_became_peered":"2024-04-24T08:25:28.122632+0000","last_unstale":"2024-04-24T08:25:28.126724+0000","last_undegraded":"2024-04-24T08:25:28.126724+0000","last_fullsized":"2024-04-24T08:25:28.126724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:06:08.052785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116822+0000","last_change":"2024-04-24T08:25:27.112537+0000","last_active":"2024-04-24T08:25:29.116822+0000","last_peered":"2024-04-24T08:25:29.116822+0000","last_clean":"2024-04-24T08:25:29.116822+0000","last_became_active":"2024-04-24T08:25:27.112233+0000","last_became_peered":"2024-04-24T08:25:27.112233+0000","last_unstale":"2024-04-24T08:25:29.116822+0000","last_undegraded":"2024-04-24T08:25:29.116822+0000","last_fullsized":"2024-04-24T08:25:29.116822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:45.411953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.120273+0000","last_change":"2024-04-24T08:25:28.125754+0000","last_active":"2024-04-24T08:25:29.120273+0000","last_peered":"2024-04-24T08:25:29.120273+0000","last_clean":"2024-04-24T08:25:29.120273+0000","last_became_active":"2024-04-24T08:25:28.116361+0000","last_became_peered":"2024-04-24T08:25:28.116361+0000","last_unstale":"2024-04-24T08:25:29.120273+0000","last_undegraded":"2024-04-24T08:25:29.120273+0000","last_fullsized":"2024-04-24T08:25:29.120273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:46.419388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.138694+0000","last_change":"2024-04-24T08:25:27.118005+0000","last_active":"2024-04-24T08:25:28.138694+0000","last_peered":"2024-04-24T08:25:28.138694+0000","last_clean":"2024-04-24T08:25:28.138694+0000","last_became_active":"2024-04-24T08:25:27.117674+0000","last_became_peered":"2024-04-24T08:25:27.117674+0000","last_unstale":"2024-04-24T08:25:28.138694+0000","last_undegraded":"2024-04-24T08:25:28.138694+0000","last_fullsized":"2024-04-24T08:25:28.138694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:56.317954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487306+0000","last_change":"2024-04-24T08:25:28.133556+0000","last_active":"2024-04-24T08:25:29.487306+0000","last_peered":"2024-04-24T08:25:29.487306+0000","last_clean":"2024-04-24T08:25:29.487306+0000","last_became_active":"2024-04-24T08:25:28.133321+0000","last_became_peered":"2024-04-24T08:25:28.133321+0000","last_unstale":"2024-04-24T08:25:29.487306+0000","last_undegraded":"2024-04-24T08:25:29.487306+0000","last_fullsized":"2024-04-24T08:25:29.487306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:39.021977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.131582+0000","last_change":"2024-04-24T08:25:27.112624+0000","last_active":"2024-04-24T08:25:28.131582+0000","last_peered":"2024-04-24T08:25:28.131582+0000","last_clean":"2024-04-24T08:25:28.131582+0000","last_became_active":"2024-04-24T08:25:27.112371+0000","last_became_peered":"2024-04-24T08:25:27.112371+0000","last_unstale":"2024-04-24T08:25:28.131582+0000","last_undegraded":"2024-04-24T08:25:28.131582+0000","last_fullsized":"2024-04-24T08:25:28.131582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:59:36.122581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126247+0000","last_change":"2024-04-24T08:25:28.121857+0000","last_active":"2024-04-24T08:25:28.126247+0000","last_peered":"2024-04-24T08:25:28.126247+0000","last_clean":"2024-04-24T08:25:28.126247+0000","last_became_active":"2024-04-24T08:25:28.120874+0000","last_became_peered":"2024-04-24T08:25:28.120874+0000","last_unstale":"2024-04-24T08:25:28.126247+0000","last_undegraded":"2024-04-24T08:25:28.126247+0000","last_fullsized":"2024-04-24T08:25:28.126247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:46.419388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118754+0000","last_change":"2024-04-24T08:25:27.112099+0000","last_active":"2024-04-24T08:25:29.118754+0000","last_peered":"2024-04-24T08:25:29.118754+0000","last_clean":"2024-04-24T08:25:29.118754+0000","last_became_active":"2024-04-24T08:25:27.110637+0000","last_became_peered":"2024-04-24T08:25:27.110637+0000","last_unstale":"2024-04-24T08:25:29.118754+0000","last_undegraded":"2024-04-24T08:25:29.118754+0000","last_fullsized":"2024-04-24T08:25:29.118754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487531+0000","last_change":"2024-04-24T08:25:28.132620+0000","last_active":"2024-04-24T08:25:29.487531+0000","last_peered":"2024-04-24T08:25:29.487531+0000","last_clean":"2024-04-24T08:25:29.487531+0000","last_became_active":"2024-04-24T08:25:28.129548+0000","last_became_peered":"2024-04-24T08:25:28.129548+0000","last_unstale":"2024-04-24T08:25:29.487531+0000","last_undegraded":"2024-04-24T08:25:29.487531+0000","last_fullsized":"2024-04-24T08:25:29.487531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:19:25.270847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.108368+0000","last_change":"2024-04-24T08:25:27.118817+0000","last_active":"2024-04-24T08:25:28.108368+0000","last_peered":"2024-04-24T08:25:28.108368+0000","last_clean":"2024-04-24T08:25:28.108368+0000","last_became_active":"2024-04-24T08:25:27.118507+0000","last_became_peered":"2024-04-24T08:25:27.118507+0000","last_unstale":"2024-04-24T08:25:28.108368+0000","last_undegraded":"2024-04-24T08:25:28.108368+0000","last_fullsized":"2024-04-24T08:25:28.108368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:49.812612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.132133+0000","last_change":"2024-04-24T08:25:28.123679+0000","last_active":"2024-04-24T08:25:28.132133+0000","last_peered":"2024-04-24T08:25:28.132133+0000","last_clean":"2024-04-24T08:25:28.132133+0000","last_became_active":"2024-04-24T08:25:28.123217+0000","last_became_peered":"2024-04-24T08:25:28.123217+0000","last_unstale":"2024-04-24T08:25:28.132133+0000","last_undegraded":"2024-04-24T08:25:28.132133+0000","last_fullsized":"2024-04-24T08:25:28.132133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:43:07.823084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.135258+0000","last_change":"2024-04-24T08:25:27.109716+0000","last_active":"2024-04-24T08:25:28.135258+0000","last_peered":"2024-04-24T08:25:28.135258+0000","last_clean":"2024-04-24T08:25:28.135258+0000","last_became_active":"2024-04-24T08:25:27.108346+0000","last_became_peered":"2024-04-24T08:25:27.108346+0000","last_unstale":"2024-04-24T08:25:28.135258+0000","last_undegraded":"2024-04-24T08:25:28.135258+0000","last_fullsized":"2024-04-24T08:25:28.135258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:49.812612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487078+0000","last_change":"2024-04-24T08:25:28.127900+0000","last_active":"2024-04-24T08:25:29.487078+0000","last_peered":"2024-04-24T08:25:29.487078+0000","last_clean":"2024-04-24T08:25:29.487078+0000","last_became_active":"2024-04-24T08:25:28.127563+0000","last_became_peered":"2024-04-24T08:25:28.127563+0000","last_unstale":"2024-04-24T08:25:29.487078+0000","last_undegraded":"2024-04-24T08:25:29.487078+0000","last_fullsized":"2024-04-24T08:25:29.487078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:01:48.875146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119944+0000","last_change":"2024-04-24T08:25:27.114104+0000","last_active":"2024-04-24T08:25:29.119944+0000","last_peered":"2024-04-24T08:25:29.119944+0000","last_clean":"2024-04-24T08:25:29.119944+0000","last_became_active":"2024-04-24T08:25:27.113819+0000","last_became_peered":"2024-04-24T08:25:27.113819+0000","last_unstale":"2024-04-24T08:25:29.119944+0000","last_undegraded":"2024-04-24T08:25:29.119944+0000","last_fullsized":"2024-04-24T08:25:29.119944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:18:10.642911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487665+0000","last_change":"2024-04-24T08:25:28.128545+0000","last_active":"2024-04-24T08:25:29.487665+0000","last_peered":"2024-04-24T08:25:29.487665+0000","last_clean":"2024-04-24T08:25:29.487665+0000","last_became_active":"2024-04-24T08:25:28.126907+0000","last_became_peered":"2024-04-24T08:25:28.126907+0000","last_unstale":"2024-04-24T08:25:29.487665+0000","last_undegraded":"2024-04-24T08:25:29.487665+0000","last_fullsized":"2024-04-24T08:25:29.487665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:55:06.802484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.134573+0000","last_change":"2024-04-24T08:25:27.106510+0000","last_active":"2024-04-24T08:25:28.134573+0000","last_peered":"2024-04-24T08:25:28.134573+0000","last_clean":"2024-04-24T08:25:28.134573+0000","last_became_active":"2024-04-24T08:25:27.106199+0000","last_became_peered":"2024-04-24T08:25:27.106199+0000","last_unstale":"2024-04-24T08:25:28.134573+0000","last_undegraded":"2024-04-24T08:25:28.134573+0000","last_fullsized":"2024-04-24T08:25:28.134573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487887+0000","last_change":"2024-04-24T08:25:28.133331+0000","last_active":"2024-04-24T08:25:29.487887+0000","last_peered":"2024-04-24T08:25:29.487887+0000","last_clean":"2024-04-24T08:25:29.487887+0000","last_became_active":"2024-04-24T08:25:28.133026+0000","last_became_peered":"2024-04-24T08:25:28.133026+0000","last_unstale":"2024-04-24T08:25:29.487887+0000","last_undegraded":"2024-04-24T08:25:29.487887+0000","last_fullsized":"2024-04-24T08:25:29.487887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:10:04.737380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116877+0000","last_change":"2024-04-24T08:25:27.106170+0000","last_active":"2024-04-24T08:25:29.116877+0000","last_peered":"2024-04-24T08:25:29.116877+0000","last_clean":"2024-04-24T08:25:29.116877+0000","last_became_active":"2024-04-24T08:25:27.105883+0000","last_became_peered":"2024-04-24T08:25:27.105883+0000","last_unstale":"2024-04-24T08:25:29.116877+0000","last_undegraded":"2024-04-24T08:25:29.116877+0000","last_fullsized":"2024-04-24T08:25:29.116877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:06:07.045350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119611+0000","last_change":"2024-04-24T08:25:28.130670+0000","last_active":"2024-04-24T08:25:29.119611+0000","last_peered":"2024-04-24T08:25:29.119611+0000","last_clean":"2024-04-24T08:25:29.119611+0000","last_became_active":"2024-04-24T08:25:28.130405+0000","last_became_peered":"2024-04-24T08:25:28.130405+0000","last_unstale":"2024-04-24T08:25:29.119611+0000","last_undegraded":"2024-04-24T08:25:29.119611+0000","last_fullsized":"2024-04-24T08:25:29.119611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:55:06.802484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.101489+0000","last_change":"2024-04-24T08:25:27.108774+0000","last_active":"2024-04-24T08:25:28.101489+0000","last_peered":"2024-04-24T08:25:28.101489+0000","last_clean":"2024-04-24T08:25:28.101489+0000","last_became_active":"2024-04-24T08:25:27.108368+0000","last_became_peered":"2024-04-24T08:25:27.108368+0000","last_unstale":"2024-04-24T08:25:28.101489+0000","last_undegraded":"2024-04-24T08:25:28.101489+0000","last_fullsized":"2024-04-24T08:25:28.101489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:49.837612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487247+0000","last_change":"2024-04-24T08:25:28.121303+0000","last_active":"2024-04-24T08:25:29.487247+0000","last_peered":"2024-04-24T08:25:29.487247+0000","last_clean":"2024-04-24T08:25:29.487247+0000","last_became_active":"2024-04-24T08:25:28.119922+0000","last_became_peered":"2024-04-24T08:25:28.119922+0000","last_unstale":"2024-04-24T08:25:29.487247+0000","last_undegraded":"2024-04-24T08:25:29.487247+0000","last_fullsized":"2024-04-24T08:25:29.487247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:17.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487067+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:25:29.487067+0000","last_peered":"2024-04-24T08:25:29.487067+0000","last_clean":"2024-04-24T08:25:29.487067+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:25:29.487067+0000","last_undegraded":"2024-04-24T08:25:29.487067+0000","last_fullsized":"2024-04-24T08:25:29.487067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118347+0000","last_change":"2024-04-24T08:25:27.105508+0000","last_active":"2024-04-24T08:25:29.118347+0000","last_peered":"2024-04-24T08:25:29.118347+0000","last_clean":"2024-04-24T08:25:29.118347+0000","last_became_active":"2024-04-24T08:25:27.105128+0000","last_became_peered":"2024-04-24T08:25:27.105128+0000","last_unstale":"2024-04-24T08:25:29.118347+0000","last_undegraded":"2024-04-24T08:25:29.118347+0000","last_fullsized":"2024-04-24T08:25:29.118347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:49.812612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136854+0000","last_change":"2024-04-24T08:25:28.129776+0000","last_active":"2024-04-24T08:25:28.136854+0000","last_peered":"2024-04-24T08:25:28.136854+0000","last_clean":"2024-04-24T08:25:28.136854+0000","last_became_active":"2024-04-24T08:25:28.127249+0000","last_became_peered":"2024-04-24T08:25:28.127249+0000","last_unstale":"2024-04-24T08:25:28.136854+0000","last_undegraded":"2024-04-24T08:25:28.136854+0000","last_fullsized":"2024-04-24T08:25:28.136854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:54.349880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.486974+0000","last_change":"2024-04-24T08:25:27.118013+0000","last_active":"2024-04-24T08:25:29.486974+0000","last_peered":"2024-04-24T08:25:29.486974+0000","last_clean":"2024-04-24T08:25:29.486974+0000","last_became_active":"2024-04-24T08:25:27.117768+0000","last_became_peered":"2024-04-24T08:25:27.117768+0000","last_unstale":"2024-04-24T08:25:29.486974+0000","last_undegraded":"2024-04-24T08:25:29.486974+0000","last_fullsized":"2024-04-24T08:25:29.486974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126155+0000","last_change":"2024-04-24T08:25:28.118575+0000","last_active":"2024-04-24T08:25:28.126155+0000","last_peered":"2024-04-24T08:25:28.126155+0000","last_clean":"2024-04-24T08:25:28.126155+0000","last_became_active":"2024-04-24T08:25:28.110833+0000","last_became_peered":"2024-04-24T08:25:28.110833+0000","last_unstale":"2024-04-24T08:25:28.126155+0000","last_undegraded":"2024-04-24T08:25:28.126155+0000","last_fullsized":"2024-04-24T08:25:28.126155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:07.862635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.101280+0000","last_change":"2024-04-24T08:25:27.103860+0000","last_active":"2024-04-24T08:25:28.101280+0000","last_peered":"2024-04-24T08:25:28.101280+0000","last_clean":"2024-04-24T08:25:28.101280+0000","last_became_active":"2024-04-24T08:25:27.103309+0000","last_became_peered":"2024-04-24T08:25:27.103309+0000","last_unstale":"2024-04-24T08:25:28.101280+0000","last_undegraded":"2024-04-24T08:25:28.101280+0000","last_fullsized":"2024-04-24T08:25:28.101280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:24.009056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116596+0000","last_change":"2024-04-24T08:25:28.116005+0000","last_active":"2024-04-24T08:25:29.116596+0000","last_peered":"2024-04-24T08:25:29.116596+0000","last_clean":"2024-04-24T08:25:29.116596+0000","last_became_active":"2024-04-24T08:25:28.115091+0000","last_became_peered":"2024-04-24T08:25:28.115091+0000","last_unstale":"2024-04-24T08:25:29.116596+0000","last_undegraded":"2024-04-24T08:25:29.116596+0000","last_fullsized":"2024-04-24T08:25:29.116596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:37:01.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118855+0000","last_change":"2024-04-24T08:25:27.112835+0000","last_active":"2024-04-24T08:25:29.118855+0000","last_peered":"2024-04-24T08:25:29.118855+0000","last_clean":"2024-04-24T08:25:29.118855+0000","last_became_active":"2024-04-24T08:25:27.112540+0000","last_became_peered":"2024-04-24T08:25:27.112540+0000","last_unstale":"2024-04-24T08:25:29.118855+0000","last_undegraded":"2024-04-24T08:25:29.118855+0000","last_fullsized":"2024-04-24T08:25:29.118855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119417+0000","last_change":"2024-04-24T08:25:28.110825+0000","last_active":"2024-04-24T08:25:29.119417+0000","last_peered":"2024-04-24T08:25:29.119417+0000","last_clean":"2024-04-24T08:25:29.119417+0000","last_became_active":"2024-04-24T08:25:28.110558+0000","last_became_peered":"2024-04-24T08:25:28.110558+0000","last_unstale":"2024-04-24T08:25:29.119417+0000","last_undegraded":"2024-04-24T08:25:29.119417+0000","last_fullsized":"2024-04-24T08:25:29.119417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:55.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116724+0000","last_change":"2024-04-24T08:25:27.119554+0000","last_active":"2024-04-24T08:25:29.116724+0000","last_peered":"2024-04-24T08:25:29.116724+0000","last_clean":"2024-04-24T08:25:29.116724+0000","last_became_active":"2024-04-24T08:25:27.119265+0000","last_became_peered":"2024-04-24T08:25:27.119265+0000","last_unstale":"2024-04-24T08:25:29.116724+0000","last_undegraded":"2024-04-24T08:25:29.116724+0000","last_fullsized":"2024-04-24T08:25:29.116724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:53.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119700+0000","last_change":"2024-04-24T08:25:28.129338+0000","last_active":"2024-04-24T08:25:29.119700+0000","last_peered":"2024-04-24T08:25:29.119700+0000","last_clean":"2024-04-24T08:25:29.119700+0000","last_became_active":"2024-04-24T08:25:28.129089+0000","last_became_peered":"2024-04-24T08:25:28.129089+0000","last_unstale":"2024-04-24T08:25:29.119700+0000","last_undegraded":"2024-04-24T08:25:29.119700+0000","last_fullsized":"2024-04-24T08:25:29.119700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:18.049288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487566+0000","last_change":"2024-04-24T08:25:27.122158+0000","last_active":"2024-04-24T08:25:29.487566+0000","last_peered":"2024-04-24T08:25:29.487566+0000","last_clean":"2024-04-24T08:25:29.487566+0000","last_became_active":"2024-04-24T08:25:27.121891+0000","last_became_peered":"2024-04-24T08:25:27.121891+0000","last_unstale":"2024-04-24T08:25:29.487566+0000","last_undegraded":"2024-04-24T08:25:29.487566+0000","last_fullsized":"2024-04-24T08:25:29.487566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:45.411953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116628+0000","last_change":"2024-04-24T08:25:28.105914+0000","last_active":"2024-04-24T08:25:29.116628+0000","last_peered":"2024-04-24T08:25:29.116628+0000","last_clean":"2024-04-24T08:25:29.116628+0000","last_became_active":"2024-04-24T08:25:28.105628+0000","last_became_peered":"2024-04-24T08:25:28.105628+0000","last_unstale":"2024-04-24T08:25:29.116628+0000","last_undegraded":"2024-04-24T08:25:29.116628+0000","last_fullsized":"2024-04-24T08:25:29.116628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:59.080477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116988+0000","last_change":"2024-04-24T08:25:27.120111+0000","last_active":"2024-04-24T08:25:29.116988+0000","last_peered":"2024-04-24T08:25:29.116988+0000","last_clean":"2024-04-24T08:25:29.116988+0000","last_became_active":"2024-04-24T08:25:27.119555+0000","last_became_peered":"2024-04-24T08:25:27.119555+0000","last_unstale":"2024-04-24T08:25:29.116988+0000","last_undegraded":"2024-04-24T08:25:29.116988+0000","last_fullsized":"2024-04-24T08:25:29.116988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136054+0000","last_change":"2024-04-24T08:25:28.128255+0000","last_active":"2024-04-24T08:25:28.136054+0000","last_peered":"2024-04-24T08:25:28.136054+0000","last_clean":"2024-04-24T08:25:28.136054+0000","last_became_active":"2024-04-24T08:25:28.128005+0000","last_became_peered":"2024-04-24T08:25:28.128005+0000","last_unstale":"2024-04-24T08:25:28.136054+0000","last_undegraded":"2024-04-24T08:25:28.136054+0000","last_fullsized":"2024-04-24T08:25:28.136054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:57.325390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.132940+0000","last_change":"2024-04-24T08:25:27.119402+0000","last_active":"2024-04-24T08:25:28.132940+0000","last_peered":"2024-04-24T08:25:28.132940+0000","last_clean":"2024-04-24T08:25:28.132940+0000","last_became_active":"2024-04-24T08:25:27.119087+0000","last_became_peered":"2024-04-24T08:25:27.119087+0000","last_unstale":"2024-04-24T08:25:28.132940+0000","last_undegraded":"2024-04-24T08:25:28.132940+0000","last_fullsized":"2024-04-24T08:25:28.132940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126073+0000","last_change":"2024-04-24T08:25:28.113889+0000","last_active":"2024-04-24T08:25:28.126073+0000","last_peered":"2024-04-24T08:25:28.126073+0000","last_clean":"2024-04-24T08:25:28.126073+0000","last_became_active":"2024-04-24T08:25:28.113629+0000","last_became_peered":"2024-04-24T08:25:28.113629+0000","last_unstale":"2024-04-24T08:25:28.126073+0000","last_undegraded":"2024-04-24T08:25:28.126073+0000","last_fullsized":"2024-04-24T08:25:28.126073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:57.325390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.486955+0000","last_change":"2024-04-24T08:25:27.121672+0000","last_active":"2024-04-24T08:25:29.486955+0000","last_peered":"2024-04-24T08:25:29.486955+0000","last_clean":"2024-04-24T08:25:29.486955+0000","last_became_active":"2024-04-24T08:25:27.121369+0000","last_became_peered":"2024-04-24T08:25:27.121369+0000","last_unstale":"2024-04-24T08:25:29.486955+0000","last_undegraded":"2024-04-24T08:25:29.486955+0000","last_fullsized":"2024-04-24T08:25:29.486955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:56.317954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118783+0000","last_change":"2024-04-24T08:25:28.106699+0000","last_active":"2024-04-24T08:25:29.118783+0000","last_peered":"2024-04-24T08:25:29.118783+0000","last_clean":"2024-04-24T08:25:29.118783+0000","last_became_active":"2024-04-24T08:25:28.106354+0000","last_became_peered":"2024-04-24T08:25:28.106354+0000","last_unstale":"2024-04-24T08:25:29.118783+0000","last_undegraded":"2024-04-24T08:25:29.118783+0000","last_fullsized":"2024-04-24T08:25:29.118783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:57.325390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116843+0000","last_change":"2024-04-24T08:25:27.111525+0000","last_active":"2024-04-24T08:25:29.116843+0000","last_peered":"2024-04-24T08:25:29.116843+0000","last_clean":"2024-04-24T08:25:29.116843+0000","last_became_active":"2024-04-24T08:25:27.111231+0000","last_became_peered":"2024-04-24T08:25:27.111231+0000","last_unstale":"2024-04-24T08:25:29.116843+0000","last_undegraded":"2024-04-24T08:25:29.116843+0000","last_fullsized":"2024-04-24T08:25:29.116843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136315+0000","last_change":"2024-04-24T08:25:28.129308+0000","last_active":"2024-04-24T08:25:28.136315+0000","last_peered":"2024-04-24T08:25:28.136315+0000","last_clean":"2024-04-24T08:25:28.136315+0000","last_became_active":"2024-04-24T08:25:28.128986+0000","last_became_peered":"2024-04-24T08:25:28.128986+0000","last_unstale":"2024-04-24T08:25:28.136315+0000","last_undegraded":"2024-04-24T08:25:28.136315+0000","last_fullsized":"2024-04-24T08:25:28.136315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:07.862635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116745+0000","last_change":"2024-04-24T08:25:27.109613+0000","last_active":"2024-04-24T08:25:29.116745+0000","last_peered":"2024-04-24T08:25:29.116745+0000","last_clean":"2024-04-24T08:25:29.116745+0000","last_became_active":"2024-04-24T08:25:27.107506+0000","last_became_peered":"2024-04-24T08:25:27.107506+0000","last_unstale":"2024-04-24T08:25:29.116745+0000","last_undegraded":"2024-04-24T08:25:29.116745+0000","last_fullsized":"2024-04-24T08:25:29.116745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:29.798274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136130+0000","last_change":"2024-04-24T08:25:28.128233+0000","last_active":"2024-04-24T08:25:28.136130+0000","last_peered":"2024-04-24T08:25:28.136130+0000","last_clean":"2024-04-24T08:25:28.136130+0000","last_became_active":"2024-04-24T08:25:28.127913+0000","last_became_peered":"2024-04-24T08:25:28.127913+0000","last_unstale":"2024-04-24T08:25:28.136130+0000","last_undegraded":"2024-04-24T08:25:28.136130+0000","last_fullsized":"2024-04-24T08:25:28.136130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:30.858353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487966+0000","last_change":"2024-04-24T08:25:27.121377+0000","last_active":"2024-04-24T08:25:29.487966+0000","last_peered":"2024-04-24T08:25:29.487966+0000","last_clean":"2024-04-24T08:25:29.487966+0000","last_became_active":"2024-04-24T08:25:27.121049+0000","last_became_peered":"2024-04-24T08:25:27.121049+0000","last_unstale":"2024-04-24T08:25:29.487966+0000","last_undegraded":"2024-04-24T08:25:29.487966+0000","last_fullsized":"2024-04-24T08:25:29.487966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.132181+0000","last_change":"2024-04-24T08:25:28.127139+0000","last_active":"2024-04-24T08:25:28.132181+0000","last_peered":"2024-04-24T08:25:28.132181+0000","last_clean":"2024-04-24T08:25:28.132181+0000","last_became_active":"2024-04-24T08:25:28.126833+0000","last_became_peered":"2024-04-24T08:25:28.126833+0000","last_unstale":"2024-04-24T08:25:28.132181+0000","last_undegraded":"2024-04-24T08:25:28.132181+0000","last_fullsized":"2024-04-24T08:25:28.132181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:13.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119528+0000","last_change":"2024-04-24T08:25:28.113682+0000","last_active":"2024-04-24T08:25:29.119528+0000","last_peered":"2024-04-24T08:25:29.119528+0000","last_clean":"2024-04-24T08:25:29.119528+0000","last_became_active":"2024-04-24T08:25:28.113390+0000","last_became_peered":"2024-04-24T08:25:28.113390+0000","last_unstale":"2024-04-24T08:25:29.119528+0000","last_undegraded":"2024-04-24T08:25:29.119528+0000","last_fullsized":"2024-04-24T08:25:29.119528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:05:08.000888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487266+0000","last_change":"2024-04-24T08:25:27.121448+0000","last_active":"2024-04-24T08:25:29.487266+0000","last_peered":"2024-04-24T08:25:29.487266+0000","last_clean":"2024-04-24T08:25:29.487266+0000","last_became_active":"2024-04-24T08:25:27.121179+0000","last_became_peered":"2024-04-24T08:25:27.121179+0000","last_unstale":"2024-04-24T08:25:29.487266+0000","last_undegraded":"2024-04-24T08:25:29.487266+0000","last_fullsized":"2024-04-24T08:25:29.487266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119084+0000","last_change":"2024-04-24T08:25:28.113033+0000","last_active":"2024-04-24T08:25:29.119084+0000","last_peered":"2024-04-24T08:25:29.119084+0000","last_clean":"2024-04-24T08:25:29.119084+0000","last_became_active":"2024-04-24T08:25:28.112690+0000","last_became_peered":"2024-04-24T08:25:28.112690+0000","last_unstale":"2024-04-24T08:25:29.119084+0000","last_undegraded":"2024-04-24T08:25:29.119084+0000","last_fullsized":"2024-04-24T08:25:29.119084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:08:53.886358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487430+0000","last_change":"2024-04-24T08:25:27.123655+0000","last_active":"2024-04-24T08:25:29.487430+0000","last_peered":"2024-04-24T08:25:29.487430+0000","last_clean":"2024-04-24T08:25:29.487430+0000","last_became_active":"2024-04-24T08:25:27.123349+0000","last_became_peered":"2024-04-24T08:25:27.123349+0000","last_unstale":"2024-04-24T08:25:29.487430+0000","last_undegraded":"2024-04-24T08:25:29.487430+0000","last_fullsized":"2024-04-24T08:25:29.487430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:53.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.121637+0000","last_change":"2024-04-24T08:25:28.108443+0000","last_active":"2024-04-24T08:25:28.121637+0000","last_peered":"2024-04-24T08:25:28.121637+0000","last_clean":"2024-04-24T08:25:28.121637+0000","last_became_active":"2024-04-24T08:25:28.108128+0000","last_became_peered":"2024-04-24T08:25:28.108128+0000","last_unstale":"2024-04-24T08:25:28.121637+0000","last_undegraded":"2024-04-24T08:25:28.121637+0000","last_fullsized":"2024-04-24T08:25:28.121637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:50.845047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.135728+0000","last_change":"2024-04-24T08:25:27.114010+0000","last_active":"2024-04-24T08:25:28.135728+0000","last_peered":"2024-04-24T08:25:28.135728+0000","last_clean":"2024-04-24T08:25:28.135728+0000","last_became_active":"2024-04-24T08:25:27.113724+0000","last_became_peered":"2024-04-24T08:25:27.113724+0000","last_unstale":"2024-04-24T08:25:28.135728+0000","last_undegraded":"2024-04-24T08:25:28.135728+0000","last_fullsized":"2024-04-24T08:25:28.135728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:49.837612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136773+0000","last_change":"2024-04-24T08:25:28.130070+0000","last_active":"2024-04-24T08:25:28.136773+0000","last_peered":"2024-04-24T08:25:28.136773+0000","last_clean":"2024-04-24T08:25:28.136773+0000","last_became_active":"2024-04-24T08:25:28.129768+0000","last_became_peered":"2024-04-24T08:25:28.129768+0000","last_unstale":"2024-04-24T08:25:28.136773+0000","last_undegraded":"2024-04-24T08:25:28.136773+0000","last_fullsized":"2024-04-24T08:25:28.136773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:46.419388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.132328+0000","last_change":"2024-04-24T08:25:27.112094+0000","last_active":"2024-04-24T08:25:28.132328+0000","last_peered":"2024-04-24T08:25:28.132328+0000","last_clean":"2024-04-24T08:25:28.132328+0000","last_became_active":"2024-04-24T08:25:27.111795+0000","last_became_peered":"2024-04-24T08:25:27.111795+0000","last_unstale":"2024-04-24T08:25:28.132328+0000","last_undegraded":"2024-04-24T08:25:28.132328+0000","last_fullsized":"2024-04-24T08:25:28.132328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:24.009056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:25:32.189 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:25:32.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4b5c00640 1 Processor -- start 2024-04-24T08:25:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4b5c00640 1 -- start start 2024-04-24T08:25:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4b5c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b013fc10 0x7fe4b0145c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4b5c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe4b0140090 0x7fe4b01461d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4b5c00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4b00bc220 con 0x7fe4b00bbe40 2024-04-24T08:25:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4b5c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe4b00ae930 con 0x7fe4b0140090 2024-04-24T08:25:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4b5c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b00aec10 con 0x7fe4b013fc10 2024-04-24T08:25:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4aea00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe4b00bbe40 0x7fe4b00b7810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59532/0 (socket says 172.21.15.88:59532) 2024-04-24T08:25:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4aea00640 1 -- 172.21.15.88:0/3866192330 learned_addr learned my addr 172.21.15.88:0/3866192330 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4a6000640 1 --2- 172.21.15.88:0/3866192330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b013fc10 0x7fe4b0145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4af400640 1 --2- 172.21.15.88:0/3866192330 >> v2:172.21.15.142:3300/0 conn(0x7fe4b0140090 0x7fe4b01461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4ae000640 1 -- 172.21.15.88:0/3866192330 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710751983 0 0) 0x7fe4b00bc220 con 0x7fe4b00bbe40 2024-04-24T08:25:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4ae000640 1 -- 172.21.15.88:0/3866192330 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe494003530 con 0x7fe4b00bbe40 2024-04-24T08:25:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4af400640 1 -- 172.21.15.88:0/3866192330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b013fc10 msgr2=0x7fe4b0145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4af400640 1 --2- 172.21.15.88:0/3866192330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b013fc10 0x7fe4b0145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4af400640 1 -- 172.21.15.88:0/3866192330 >> v1:172.21.15.88:6789/0 conn(0x7fe4b00bbe40 legacy=0x7fe4b00b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4af400640 1 -- 172.21.15.88:0/3866192330 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b00b5dd0 con 0x7fe4b0140090 2024-04-24T08:25:32.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4af400640 1 --2- 172.21.15.88:0/3866192330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b0140090 0x7fe4b01461d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80097c0 tx=0x7fe4a801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e6d455136102584 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:32.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4ae000640 1 -- 172.21.15.88:0/3866192330 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a80b0070 con 0x7fe4b0140090 2024-04-24T08:25:32.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4ae000640 1 -- 172.21.15.88:0/3866192330 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a80ab600 con 0x7fe4b0140090 2024-04-24T08:25:32.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.362+0000 7fe4ae000640 1 -- 172.21.15.88:0/3866192330 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a80ab9b0 con 0x7fe4b0140090 2024-04-24T08:25:32.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 -- 172.21.15.88:0/3866192330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b0140090 msgr2=0x7fe4b01461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 --2- 172.21.15.88:0/3866192330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b0140090 0x7fe4b01461d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80097c0 tx=0x7fe4a801c380 comp rx=0 tx=0).stop 2024-04-24T08:25:32.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 -- 172.21.15.88:0/3866192330 shutdown_connections 2024-04-24T08:25:32.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 --2- 172.21.15.88:0/3866192330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b0140090 0x7fe4b01461d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 --2- 172.21.15.88:0/3866192330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b013fc10 0x7fe4b0145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 -- 172.21.15.88:0/3866192330 >> 172.21.15.88:0/3866192330 conn(0x7fe4b0067e10 msgr2=0x7fe4b00bb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 -- 172.21.15.88:0/3866192330 shutdown_connections 2024-04-24T08:25:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 -- 172.21.15.88:0/3866192330 wait complete. 2024-04-24T08:25:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 Processor -- start 2024-04-24T08:25:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 -- start start 2024-04-24T08:25:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4b00bbe40 0x7fe4b00adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b013fc10 0x7fe4b006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b0140090 0x7fe4b0142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b0152fd0 con 0x7fe4b00bbe40 2024-04-24T08:25:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b0152e50 con 0x7fe4b0140090 2024-04-24T08:25:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b0153150 con 0x7fe4b013fc10 2024-04-24T08:25:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4aea00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4b00bbe40 0x7fe4b00adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4aea00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4b00bbe40 0x7fe4b00adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34526/0 (socket says 172.21.15.88:34526) 2024-04-24T08:25:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4aea00640 1 -- 172.21.15.88:0/236979896 learned_addr learned my addr 172.21.15.88:0/236979896 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4a6000640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b013fc10 0x7fe4b006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4af400640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b0140090 0x7fe4b0142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4aea00640 1 -- 172.21.15.88:0/236979896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b013fc10 msgr2=0x7fe4b006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4aea00640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b013fc10 0x7fe4b006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4aea00640 1 -- 172.21.15.88:0/236979896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b0140090 msgr2=0x7fe4b0142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4aea00640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b0140090 0x7fe4b0142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4aea00640 1 -- 172.21.15.88:0/236979896 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b006cbe0 con 0x7fe4b00bbe40 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4a6000640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b013fc10 0x7fe4b006d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4af400640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b0140090 0x7fe4b0142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4aea00640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4b00bbe40 0x7fe4b00adb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c3c0 tx=0x7fe4a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4a7400640 1 -- 172.21.15.88:0/236979896 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0017070 con 0x7fe4b00bbe40 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4a7400640 1 -- 172.21.15.88:0/236979896 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a0005cf0 con 0x7fe4b00bbe40 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.366+0000 7fe4b5c00640 1 -- 172.21.15.88:0/236979896 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b006cec0 con 0x7fe4b00bbe40 2024-04-24T08:25:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.370+0000 7fe4a7400640 1 -- 172.21.15.88:0/236979896 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00072f0 con 0x7fe4b00bbe40 2024-04-24T08:25:32.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.370+0000 7fe4b5c00640 1 -- 172.21.15.88:0/236979896 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b013a7c0 con 0x7fe4b00bbe40 2024-04-24T08:25:32.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.370+0000 7fe4b5c00640 1 -- 172.21.15.88:0/236979896 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b013aab0 con 0x7fe4b00bbe40 2024-04-24T08:25:32.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.370+0000 7fe4a7400640 1 -- 172.21.15.88:0/236979896 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4a001a070 con 0x7fe4b00bbe40 2024-04-24T08:25:32.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.370+0000 7fe4a7400640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe48c068380 0x7fe48c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:32.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.370+0000 7fe4a7400640 1 -- 172.21.15.88:0/236979896 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe4a0085de0 con 0x7fe4b00bbe40 2024-04-24T08:25:32.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.370+0000 7fe4a6000640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe48c068380 0x7fe48c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:32.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.370+0000 7fe4a6000640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe48c068380 0x7fe48c06a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4b013d160 tx=0x7fe49800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:32.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.374+0000 7fe4a7400640 1 -- 172.21.15.88:0/236979896 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4a0056390 con 0x7fe4b00bbe40 2024-04-24T08:25:32.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.534+0000 7fe4b5c00640 1 -- 172.21.15.88:0/236979896 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4b0068b90 con 0x7fe48c068380 2024-04-24T08:25:32.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.538+0000 7fe4a7400640 1 -- 172.21.15.88:0/236979896 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251910 (secure 0 0 0) 0x7fe4b0068b90 con 0x7fe48c068380 2024-04-24T08:25:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:32.544 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:25:32.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.542+0000 7fe4b5c00640 1 -- 172.21.15.88:0/236979896 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe48c068380 msgr2=0x7fe48c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.542+0000 7fe4b5c00640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe48c068380 0x7fe48c06a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4b013d160 tx=0x7fe49800b040 comp rx=0 tx=0).stop 2024-04-24T08:25:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.542+0000 7fe4b5c00640 1 -- 172.21.15.88:0/236979896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4b00bbe40 msgr2=0x7fe4b00adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.542+0000 7fe4b5c00640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4b00bbe40 0x7fe4b00adb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c3c0 tx=0x7fe4a000c880 comp rx=0 tx=0).stop 2024-04-24T08:25:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.542+0000 7fe4b5c00640 1 -- 172.21.15.88:0/236979896 shutdown_connections 2024-04-24T08:25:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.542+0000 7fe4b5c00640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe48c068380 0x7fe48c06a840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.542+0000 7fe4b5c00640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b0140090 0x7fe4b0142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.542+0000 7fe4b5c00640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b013fc10 0x7fe4b006d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.542+0000 7fe4b5c00640 1 --2- 172.21.15.88:0/236979896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4b00bbe40 0x7fe4b00adb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.542+0000 7fe4b5c00640 1 -- 172.21.15.88:0/236979896 >> 172.21.15.88:0/236979896 conn(0x7fe4b0067e10 msgr2=0x7fe4b01463c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.542+0000 7fe4b5c00640 1 -- 172.21.15.88:0/236979896 shutdown_connections 2024-04-24T08:25:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.546+0000 7fe4b5c00640 1 -- 172.21.15.88:0/236979896 wait complete. 2024-04-24T08:25:32.567 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-24T08:25:30.988404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218936,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755784,"statfs":{"total":773094113280,"available":772869922816,"internally_reserved":0,"allocated":2830336,"data_stored":1721528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.906581"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487790+0000","last_change":"2024-04-24T08:25:28.122966+0000","last_active":"2024-04-24T08:25:29.487790+0000","last_peered":"2024-04-24T08:25:29.487790+0000","last_clean":"2024-04-24T08:25:29.487790+0000","last_became_active":"2024-04-24T08:25:28.122377+0000","last_became_peered":"2024-04-24T08:25:28.122377+0000","last_unstale":"2024-04-24T08:25:29.487790+0000","last_undegraded":"2024-04-24T08:25:29.487790+0000","last_fullsized":"2024-04-24T08:25:29.487790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:18.049288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116977+0000","last_change":"2024-04-24T08:25:28.107616+0000","last_active":"2024-04-24T08:25:29.116977+0000","last_peered":"2024-04-24T08:25:29.116977+0000","last_clean":"2024-04-24T08:25:29.116977+0000","last_became_active":"2024-04-24T08:25:28.107282+0000","last_became_peered":"2024-04-24T08:25:28.107282+0000","last_unstale":"2024-04-24T08:25:29.116977+0000","last_undegraded":"2024-04-24T08:25:29.116977+0000","last_fullsized":"2024-04-24T08:25:29.116977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.125657+0000","last_change":"2024-04-24T08:25:28.107850+0000","last_active":"2024-04-24T08:25:28.125657+0000","last_peered":"2024-04-24T08:25:28.125657+0000","last_clean":"2024-04-24T08:25:28.125657+0000","last_became_active":"2024-04-24T08:25:28.105595+0000","last_became_peered":"2024-04-24T08:25:28.105595+0000","last_unstale":"2024-04-24T08:25:28.125657+0000","last_undegraded":"2024-04-24T08:25:28.125657+0000","last_fullsized":"2024-04-24T08:25:28.125657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:30.858353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118650+0000","last_change":"2024-04-24T08:25:28.131587+0000","last_active":"2024-04-24T08:25:29.118650+0000","last_peered":"2024-04-24T08:25:29.118650+0000","last_clean":"2024-04-24T08:25:29.118650+0000","last_became_active":"2024-04-24T08:25:28.131271+0000","last_became_peered":"2024-04-24T08:25:28.131271+0000","last_unstale":"2024-04-24T08:25:29.118650+0000","last_undegraded":"2024-04-24T08:25:29.118650+0000","last_fullsized":"2024-04-24T08:25:29.118650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:17.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487906+0000","last_change":"2024-04-24T08:25:28.119186+0000","last_active":"2024-04-24T08:25:29.487906+0000","last_peered":"2024-04-24T08:25:29.487906+0000","last_clean":"2024-04-24T08:25:29.487906+0000","last_became_active":"2024-04-24T08:25:28.118470+0000","last_became_peered":"2024-04-24T08:25:28.118470+0000","last_unstale":"2024-04-24T08:25:29.487906+0000","last_undegraded":"2024-04-24T08:25:29.487906+0000","last_fullsized":"2024-04-24T08:25:29.487906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:08:53.886358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118414+0000","last_change":"2024-04-24T08:25:28.110827+0000","last_active":"2024-04-24T08:25:29.118414+0000","last_peered":"2024-04-24T08:25:29.118414+0000","last_clean":"2024-04-24T08:25:29.118414+0000","last_became_active":"2024-04-24T08:25:28.110542+0000","last_became_peered":"2024-04-24T08:25:28.110542+0000","last_unstale":"2024-04-24T08:25:29.118414+0000","last_undegraded":"2024-04-24T08:25:29.118414+0000","last_fullsized":"2024-04-24T08:25:29.118414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487112+0000","last_change":"2024-04-24T08:25:28.122530+0000","last_active":"2024-04-24T08:25:29.487112+0000","last_peered":"2024-04-24T08:25:29.487112+0000","last_clean":"2024-04-24T08:25:29.487112+0000","last_became_active":"2024-04-24T08:25:28.121676+0000","last_became_peered":"2024-04-24T08:25:28.121676+0000","last_unstale":"2024-04-24T08:25:29.487112+0000","last_undegraded":"2024-04-24T08:25:29.487112+0000","last_fullsized":"2024-04-24T08:25:29.487112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:27:07.262422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.137264+0000","last_change":"2024-04-24T08:25:28.133406+0000","last_active":"2024-04-24T08:25:28.137264+0000","last_peered":"2024-04-24T08:25:28.137264+0000","last_clean":"2024-04-24T08:25:28.137264+0000","last_became_active":"2024-04-24T08:25:28.132708+0000","last_became_peered":"2024-04-24T08:25:28.132708+0000","last_unstale":"2024-04-24T08:25:28.137264+0000","last_undegraded":"2024-04-24T08:25:28.137264+0000","last_fullsized":"2024-04-24T08:25:28.137264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:43:07.823084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487778+0000","last_change":"2024-04-24T08:25:28.126548+0000","last_active":"2024-04-24T08:25:29.487778+0000","last_peered":"2024-04-24T08:25:29.487778+0000","last_clean":"2024-04-24T08:25:29.487778+0000","last_became_active":"2024-04-24T08:25:28.126116+0000","last_became_peered":"2024-04-24T08:25:28.126116+0000","last_unstale":"2024-04-24T08:25:29.487778+0000","last_undegraded":"2024-04-24T08:25:29.487778+0000","last_fullsized":"2024-04-24T08:25:29.487778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:09.839576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.121293+0000","last_change":"2024-04-24T08:25:28.117731+0000","last_active":"2024-04-24T08:25:28.121293+0000","last_peered":"2024-04-24T08:25:28.121293+0000","last_clean":"2024-04-24T08:25:28.121293+0000","last_became_active":"2024-04-24T08:25:28.116901+0000","last_became_peered":"2024-04-24T08:25:28.116901+0000","last_unstale":"2024-04-24T08:25:28.121293+0000","last_undegraded":"2024-04-24T08:25:28.121293+0000","last_fullsized":"2024-04-24T08:25:28.121293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:54.349880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.128955+0000","last_change":"2024-04-24T08:25:28.120314+0000","last_active":"2024-04-24T08:25:28.128955+0000","last_peered":"2024-04-24T08:25:28.128955+0000","last_clean":"2024-04-24T08:25:28.128955+0000","last_became_active":"2024-04-24T08:25:28.118691+0000","last_became_peered":"2024-04-24T08:25:28.118691+0000","last_unstale":"2024-04-24T08:25:28.128955+0000","last_undegraded":"2024-04-24T08:25:28.128955+0000","last_fullsized":"2024-04-24T08:25:28.128955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:06:08.052785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.120168+0000","last_change":"2024-04-24T08:25:28.126862+0000","last_active":"2024-04-24T08:25:29.120168+0000","last_peered":"2024-04-24T08:25:29.120168+0000","last_clean":"2024-04-24T08:25:29.120168+0000","last_became_active":"2024-04-24T08:25:28.126543+0000","last_became_peered":"2024-04-24T08:25:28.126543+0000","last_unstale":"2024-04-24T08:25:29.120168+0000","last_undegraded":"2024-04-24T08:25:29.120168+0000","last_fullsized":"2024-04-24T08:25:29.120168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:54.349880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.135487+0000","last_change":"2024-04-24T08:25:28.127815+0000","last_active":"2024-04-24T08:25:28.135487+0000","last_peered":"2024-04-24T08:25:28.135487+0000","last_clean":"2024-04-24T08:25:28.135487+0000","last_became_active":"2024-04-24T08:25:28.127026+0000","last_became_peered":"2024-04-24T08:25:28.127026+0000","last_unstale":"2024-04-24T08:25:28.135487+0000","last_undegraded":"2024-04-24T08:25:28.135487+0000","last_fullsized":"2024-04-24T08:25:28.135487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:50.820048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.122022+0000","last_change":"2024-04-24T08:25:28.110471+0000","last_active":"2024-04-24T08:25:28.122022+0000","last_peered":"2024-04-24T08:25:28.122022+0000","last_clean":"2024-04-24T08:25:28.122022+0000","last_became_active":"2024-04-24T08:25:28.109175+0000","last_became_peered":"2024-04-24T08:25:28.109175+0000","last_unstale":"2024-04-24T08:25:28.122022+0000","last_undegraded":"2024-04-24T08:25:28.122022+0000","last_fullsized":"2024-04-24T08:25:28.122022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:50.820048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116748+0000","last_change":"2024-04-24T08:25:28.115093+0000","last_active":"2024-04-24T08:25:29.116748+0000","last_peered":"2024-04-24T08:25:29.116748+0000","last_clean":"2024-04-24T08:25:29.116748+0000","last_became_active":"2024-04-24T08:25:28.114782+0000","last_became_peered":"2024-04-24T08:25:28.114782+0000","last_unstale":"2024-04-24T08:25:29.116748+0000","last_undegraded":"2024-04-24T08:25:29.116748+0000","last_fullsized":"2024-04-24T08:25:29.116748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:03:04.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118502+0000","last_change":"2024-04-24T08:25:28.108967+0000","last_active":"2024-04-24T08:25:29.118502+0000","last_peered":"2024-04-24T08:25:29.118502+0000","last_clean":"2024-04-24T08:25:29.118502+0000","last_became_active":"2024-04-24T08:25:28.108627+0000","last_became_peered":"2024-04-24T08:25:28.108627+0000","last_unstale":"2024-04-24T08:25:29.118502+0000","last_undegraded":"2024-04-24T08:25:29.118502+0000","last_fullsized":"2024-04-24T08:25:29.118502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:01:48.875146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119667+0000","last_change":"2024-04-24T08:25:28.120983+0000","last_active":"2024-04-24T08:25:29.119667+0000","last_peered":"2024-04-24T08:25:29.119667+0000","last_clean":"2024-04-24T08:25:29.119667+0000","last_became_active":"2024-04-24T08:25:28.120054+0000","last_became_peered":"2024-04-24T08:25:28.120054+0000","last_unstale":"2024-04-24T08:25:29.119667+0000","last_undegraded":"2024-04-24T08:25:29.119667+0000","last_fullsized":"2024-04-24T08:25:29.119667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:09.839576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.134619+0000","last_change":"2024-04-24T08:25:28.119368+0000","last_active":"2024-04-24T08:25:28.134619+0000","last_peered":"2024-04-24T08:25:28.134619+0000","last_clean":"2024-04-24T08:25:28.134619+0000","last_became_active":"2024-04-24T08:25:28.118968+0000","last_became_peered":"2024-04-24T08:25:28.118968+0000","last_unstale":"2024-04-24T08:25:28.134619+0000","last_undegraded":"2024-04-24T08:25:28.134619+0000","last_fullsized":"2024-04-24T08:25:28.134619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:07.862635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487555+0000","last_change":"2024-04-24T08:25:28.136211+0000","last_active":"2024-04-24T08:25:29.487555+0000","last_peered":"2024-04-24T08:25:29.487555+0000","last_clean":"2024-04-24T08:25:29.487555+0000","last_became_active":"2024-04-24T08:25:28.135915+0000","last_became_peered":"2024-04-24T08:25:28.135915+0000","last_unstale":"2024-04-24T08:25:29.487555+0000","last_undegraded":"2024-04-24T08:25:29.487555+0000","last_fullsized":"2024-04-24T08:25:29.487555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:05:08.000888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.133156+0000","last_change":"2024-04-24T08:25:28.128288+0000","last_active":"2024-04-24T08:25:28.133156+0000","last_peered":"2024-04-24T08:25:28.133156+0000","last_clean":"2024-04-24T08:25:28.133156+0000","last_became_active":"2024-04-24T08:25:28.127975+0000","last_became_peered":"2024-04-24T08:25:28.127975+0000","last_unstale":"2024-04-24T08:25:28.133156+0000","last_undegraded":"2024-04-24T08:25:28.133156+0000","last_fullsized":"2024-04-24T08:25:28.133156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:20:03.401225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126265+0000","last_change":"2024-04-24T08:25:28.119997+0000","last_active":"2024-04-24T08:25:28.126265+0000","last_peered":"2024-04-24T08:25:28.126265+0000","last_clean":"2024-04-24T08:25:28.126265+0000","last_became_active":"2024-04-24T08:25:28.119394+0000","last_became_peered":"2024-04-24T08:25:28.119394+0000","last_unstale":"2024-04-24T08:25:28.126265+0000","last_undegraded":"2024-04-24T08:25:28.126265+0000","last_fullsized":"2024-04-24T08:25:28.126265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:55.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118478+0000","last_change":"2024-04-24T08:25:28.115607+0000","last_active":"2024-04-24T08:25:29.118478+0000","last_peered":"2024-04-24T08:25:29.118478+0000","last_clean":"2024-04-24T08:25:29.118478+0000","last_became_active":"2024-04-24T08:25:28.115310+0000","last_became_peered":"2024-04-24T08:25:28.115310+0000","last_unstale":"2024-04-24T08:25:29.118478+0000","last_undegraded":"2024-04-24T08:25:29.118478+0000","last_fullsized":"2024-04-24T08:25:29.118478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136473+0000","last_change":"2024-04-24T08:25:28.129517+0000","last_active":"2024-04-24T08:25:28.136473+0000","last_peered":"2024-04-24T08:25:28.136473+0000","last_clean":"2024-04-24T08:25:28.136473+0000","last_became_active":"2024-04-24T08:25:28.129258+0000","last_became_peered":"2024-04-24T08:25:28.129258+0000","last_unstale":"2024-04-24T08:25:28.136473+0000","last_undegraded":"2024-04-24T08:25:28.136473+0000","last_fullsized":"2024-04-24T08:25:28.136473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:55.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118686+0000","last_change":"2024-04-24T08:25:28.129391+0000","last_active":"2024-04-24T08:25:29.118686+0000","last_peered":"2024-04-24T08:25:29.118686+0000","last_clean":"2024-04-24T08:25:29.118686+0000","last_became_active":"2024-04-24T08:25:28.128991+0000","last_became_peered":"2024-04-24T08:25:28.128991+0000","last_unstale":"2024-04-24T08:25:29.118686+0000","last_undegraded":"2024-04-24T08:25:29.118686+0000","last_fullsized":"2024-04-24T08:25:29.118686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:39.021977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136849+0000","last_change":"2024-04-24T08:25:28.132732+0000","last_active":"2024-04-24T08:25:28.136849+0000","last_peered":"2024-04-24T08:25:28.136849+0000","last_clean":"2024-04-24T08:25:28.136849+0000","last_became_active":"2024-04-24T08:25:28.132493+0000","last_became_peered":"2024-04-24T08:25:28.132493+0000","last_unstale":"2024-04-24T08:25:28.136849+0000","last_undegraded":"2024-04-24T08:25:28.136849+0000","last_fullsized":"2024-04-24T08:25:28.136849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:30.805709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.121315+0000","last_change":"2024-04-24T08:25:28.118797+0000","last_active":"2024-04-24T08:25:28.121315+0000","last_peered":"2024-04-24T08:25:28.121315+0000","last_clean":"2024-04-24T08:25:28.121315+0000","last_became_active":"2024-04-24T08:25:28.118073+0000","last_became_peered":"2024-04-24T08:25:28.118073+0000","last_unstale":"2024-04-24T08:25:28.121315+0000","last_undegraded":"2024-04-24T08:25:28.121315+0000","last_fullsized":"2024-04-24T08:25:28.121315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:46.419388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116765+0000","last_change":"2024-04-24T08:25:28.131235+0000","last_active":"2024-04-24T08:25:29.116765+0000","last_peered":"2024-04-24T08:25:29.116765+0000","last_clean":"2024-04-24T08:25:29.116765+0000","last_became_active":"2024-04-24T08:25:28.130932+0000","last_became_peered":"2024-04-24T08:25:28.130932+0000","last_unstale":"2024-04-24T08:25:29.116765+0000","last_undegraded":"2024-04-24T08:25:29.116765+0000","last_fullsized":"2024-04-24T08:25:29.116765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.137243+0000","last_change":"2024-04-24T08:25:28.134992+0000","last_active":"2024-04-24T08:25:28.137243+0000","last_peered":"2024-04-24T08:25:28.137243+0000","last_clean":"2024-04-24T08:25:28.137243+0000","last_became_active":"2024-04-24T08:25:28.134739+0000","last_became_peered":"2024-04-24T08:25:28.134739+0000","last_unstale":"2024-04-24T08:25:28.137243+0000","last_undegraded":"2024-04-24T08:25:28.137243+0000","last_fullsized":"2024-04-24T08:25:28.137243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:13.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136342+0000","last_change":"2024-04-24T08:25:28.131466+0000","last_active":"2024-04-24T08:25:28.136342+0000","last_peered":"2024-04-24T08:25:28.136342+0000","last_clean":"2024-04-24T08:25:28.136342+0000","last_became_active":"2024-04-24T08:25:28.131050+0000","last_became_peered":"2024-04-24T08:25:28.131050+0000","last_unstale":"2024-04-24T08:25:28.136342+0000","last_undegraded":"2024-04-24T08:25:28.136342+0000","last_fullsized":"2024-04-24T08:25:28.136342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:30.805709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118638+0000","last_change":"2024-04-24T08:25:28.136036+0000","last_active":"2024-04-24T08:25:29.118638+0000","last_peered":"2024-04-24T08:25:29.118638+0000","last_clean":"2024-04-24T08:25:29.118638+0000","last_became_active":"2024-04-24T08:25:28.135525+0000","last_became_peered":"2024-04-24T08:25:28.135525+0000","last_unstale":"2024-04-24T08:25:29.118638+0000","last_undegraded":"2024-04-24T08:25:29.118638+0000","last_fullsized":"2024-04-24T08:25:29.118638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:27:07.262422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.128342+0000","last_change":"2024-04-24T08:25:28.114519+0000","last_active":"2024-04-24T08:25:28.128342+0000","last_peered":"2024-04-24T08:25:28.128342+0000","last_clean":"2024-04-24T08:25:28.128342+0000","last_became_active":"2024-04-24T08:25:28.114247+0000","last_became_peered":"2024-04-24T08:25:28.114247+0000","last_unstale":"2024-04-24T08:25:28.128342+0000","last_undegraded":"2024-04-24T08:25:28.128342+0000","last_fullsized":"2024-04-24T08:25:28.128342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:57.325390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.132090+0000","last_change":"2024-04-24T08:25:28.123399+0000","last_active":"2024-04-24T08:25:28.132090+0000","last_peered":"2024-04-24T08:25:28.132090+0000","last_clean":"2024-04-24T08:25:28.132090+0000","last_became_active":"2024-04-24T08:25:28.123078+0000","last_became_peered":"2024-04-24T08:25:28.123078+0000","last_unstale":"2024-04-24T08:25:28.132090+0000","last_undegraded":"2024-04-24T08:25:28.132090+0000","last_fullsized":"2024-04-24T08:25:28.132090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:30.805709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119086+0000","last_change":"2024-04-24T08:25:28.106959+0000","last_active":"2024-04-24T08:25:29.119086+0000","last_peered":"2024-04-24T08:25:29.119086+0000","last_clean":"2024-04-24T08:25:29.119086+0000","last_became_active":"2024-04-24T08:25:28.106686+0000","last_became_peered":"2024-04-24T08:25:28.106686+0000","last_unstale":"2024-04-24T08:25:29.119086+0000","last_undegraded":"2024-04-24T08:25:29.119086+0000","last_fullsized":"2024-04-24T08:25:29.119086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:07.862635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.134793+0000","last_change":"2024-04-24T08:25:27.115877+0000","last_active":"2024-04-24T08:25:28.134793+0000","last_peered":"2024-04-24T08:25:28.134793+0000","last_clean":"2024-04-24T08:25:28.134793+0000","last_became_active":"2024-04-24T08:25:27.115544+0000","last_became_peered":"2024-04-24T08:25:27.115544+0000","last_unstale":"2024-04-24T08:25:28.134793+0000","last_undegraded":"2024-04-24T08:25:28.134793+0000","last_fullsized":"2024-04-24T08:25:28.134793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:24.009056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126284+0000","last_change":"2024-04-24T08:25:28.120172+0000","last_active":"2024-04-24T08:25:28.126284+0000","last_peered":"2024-04-24T08:25:28.126284+0000","last_clean":"2024-04-24T08:25:28.126284+0000","last_became_active":"2024-04-24T08:25:28.119756+0000","last_became_peered":"2024-04-24T08:25:28.119756+0000","last_unstale":"2024-04-24T08:25:28.126284+0000","last_undegraded":"2024-04-24T08:25:28.126284+0000","last_fullsized":"2024-04-24T08:25:28.126284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:54.349880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126587+0000","last_change":"2024-04-24T08:25:27.123186+0000","last_active":"2024-04-24T08:25:28.126587+0000","last_peered":"2024-04-24T08:25:28.126587+0000","last_clean":"2024-04-24T08:25:28.126587+0000","last_became_active":"2024-04-24T08:25:27.122910+0000","last_became_peered":"2024-04-24T08:25:27.122910+0000","last_unstale":"2024-04-24T08:25:28.126587+0000","last_undegraded":"2024-04-24T08:25:28.126587+0000","last_fullsized":"2024-04-24T08:25:28.126587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.122760+0000","last_change":"2024-04-24T08:25:27.120630+0000","last_active":"2024-04-24T08:25:28.122760+0000","last_peered":"2024-04-24T08:25:28.122760+0000","last_clean":"2024-04-24T08:25:28.122760+0000","last_became_active":"2024-04-24T08:25:27.119902+0000","last_became_peered":"2024-04-24T08:25:27.119902+0000","last_unstale":"2024-04-24T08:25:28.122760+0000","last_undegraded":"2024-04-24T08:25:28.122760+0000","last_fullsized":"2024-04-24T08:25:28.122760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:59:36.122581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136893+0000","last_change":"2024-04-24T08:25:28.131546+0000","last_active":"2024-04-24T08:25:28.136893+0000","last_peered":"2024-04-24T08:25:28.136893+0000","last_clean":"2024-04-24T08:25:28.136893+0000","last_became_active":"2024-04-24T08:25:28.131273+0000","last_became_peered":"2024-04-24T08:25:28.131273+0000","last_unstale":"2024-04-24T08:25:28.136893+0000","last_undegraded":"2024-04-24T08:25:28.136893+0000","last_fullsized":"2024-04-24T08:25:28.136893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:06:08.052785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118787+0000","last_change":"2024-04-24T08:25:27.107828+0000","last_active":"2024-04-24T08:25:29.118787+0000","last_peered":"2024-04-24T08:25:29.118787+0000","last_clean":"2024-04-24T08:25:29.118787+0000","last_became_active":"2024-04-24T08:25:27.107464+0000","last_became_peered":"2024-04-24T08:25:27.107464+0000","last_unstale":"2024-04-24T08:25:29.118787+0000","last_undegraded":"2024-04-24T08:25:29.118787+0000","last_fullsized":"2024-04-24T08:25:29.118787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:56.317954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116595+0000","last_change":"2024-04-24T08:25:28.129575+0000","last_active":"2024-04-24T08:25:29.116595+0000","last_peered":"2024-04-24T08:25:29.116595+0000","last_clean":"2024-04-24T08:25:29.116595+0000","last_became_active":"2024-04-24T08:25:28.129273+0000","last_became_peered":"2024-04-24T08:25:28.129273+0000","last_unstale":"2024-04-24T08:25:29.116595+0000","last_undegraded":"2024-04-24T08:25:29.116595+0000","last_fullsized":"2024-04-24T08:25:29.116595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:18.585938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.110974+0000","last_change":"2024-04-24T08:25:27.119751+0000","last_active":"2024-04-24T08:25:28.110974+0000","last_peered":"2024-04-24T08:25:28.110974+0000","last_clean":"2024-04-24T08:25:28.110974+0000","last_became_active":"2024-04-24T08:25:27.117532+0000","last_became_peered":"2024-04-24T08:25:27.117532+0000","last_unstale":"2024-04-24T08:25:28.110974+0000","last_undegraded":"2024-04-24T08:25:28.110974+0000","last_fullsized":"2024-04-24T08:25:28.110974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119157+0000","last_change":"2024-04-24T08:25:28.114763+0000","last_active":"2024-04-24T08:25:29.119157+0000","last_peered":"2024-04-24T08:25:29.119157+0000","last_clean":"2024-04-24T08:25:29.119157+0000","last_became_active":"2024-04-24T08:25:28.114494+0000","last_became_peered":"2024-04-24T08:25:28.114494+0000","last_unstale":"2024-04-24T08:25:29.119157+0000","last_undegraded":"2024-04-24T08:25:29.119157+0000","last_fullsized":"2024-04-24T08:25:29.119157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:19:25.270847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119337+0000","last_change":"2024-04-24T08:25:27.119512+0000","last_active":"2024-04-24T08:25:29.119337+0000","last_peered":"2024-04-24T08:25:29.119337+0000","last_clean":"2024-04-24T08:25:29.119337+0000","last_became_active":"2024-04-24T08:25:27.119197+0000","last_became_peered":"2024-04-24T08:25:27.119197+0000","last_unstale":"2024-04-24T08:25:29.119337+0000","last_undegraded":"2024-04-24T08:25:29.119337+0000","last_fullsized":"2024-04-24T08:25:29.119337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126724+0000","last_change":"2024-04-24T08:25:28.122927+0000","last_active":"2024-04-24T08:25:28.126724+0000","last_peered":"2024-04-24T08:25:28.126724+0000","last_clean":"2024-04-24T08:25:28.126724+0000","last_became_active":"2024-04-24T08:25:28.122632+0000","last_became_peered":"2024-04-24T08:25:28.122632+0000","last_unstale":"2024-04-24T08:25:28.126724+0000","last_undegraded":"2024-04-24T08:25:28.126724+0000","last_fullsized":"2024-04-24T08:25:28.126724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:06:08.052785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116822+0000","last_change":"2024-04-24T08:25:27.112537+0000","last_active":"2024-04-24T08:25:29.116822+0000","last_peered":"2024-04-24T08:25:29.116822+0000","last_clean":"2024-04-24T08:25:29.116822+0000","last_became_active":"2024-04-24T08:25:27.112233+0000","last_became_peered":"2024-04-24T08:25:27.112233+0000","last_unstale":"2024-04-24T08:25:29.116822+0000","last_undegraded":"2024-04-24T08:25:29.116822+0000","last_fullsized":"2024-04-24T08:25:29.116822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:45.411953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.120273+0000","last_change":"2024-04-24T08:25:28.125754+0000","last_active":"2024-04-24T08:25:29.120273+0000","last_peered":"2024-04-24T08:25:29.120273+0000","last_clean":"2024-04-24T08:25:29.120273+0000","last_became_active":"2024-04-24T08:25:28.116361+0000","last_became_peered":"2024-04-24T08:25:28.116361+0000","last_unstale":"2024-04-24T08:25:29.120273+0000","last_undegraded":"2024-04-24T08:25:29.120273+0000","last_fullsized":"2024-04-24T08:25:29.120273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:46.419388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.138694+0000","last_change":"2024-04-24T08:25:27.118005+0000","last_active":"2024-04-24T08:25:28.138694+0000","last_peered":"2024-04-24T08:25:28.138694+0000","last_clean":"2024-04-24T08:25:28.138694+0000","last_became_active":"2024-04-24T08:25:27.117674+0000","last_became_peered":"2024-04-24T08:25:27.117674+0000","last_unstale":"2024-04-24T08:25:28.138694+0000","last_undegraded":"2024-04-24T08:25:28.138694+0000","last_fullsized":"2024-04-24T08:25:28.138694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:56.317954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487306+0000","last_change":"2024-04-24T08:25:28.133556+0000","last_active":"2024-04-24T08:25:29.487306+0000","last_peered":"2024-04-24T08:25:29.487306+0000","last_clean":"2024-04-24T08:25:29.487306+0000","last_became_active":"2024-04-24T08:25:28.133321+0000","last_became_peered":"2024-04-24T08:25:28.133321+0000","last_unstale":"2024-04-24T08:25:29.487306+0000","last_undegraded":"2024-04-24T08:25:29.487306+0000","last_fullsized":"2024-04-24T08:25:29.487306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:39.021977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.131582+0000","last_change":"2024-04-24T08:25:27.112624+0000","last_active":"2024-04-24T08:25:28.131582+0000","last_peered":"2024-04-24T08:25:28.131582+0000","last_clean":"2024-04-24T08:25:28.131582+0000","last_became_active":"2024-04-24T08:25:27.112371+0000","last_became_peered":"2024-04-24T08:25:27.112371+0000","last_unstale":"2024-04-24T08:25:28.131582+0000","last_undegraded":"2024-04-24T08:25:28.131582+0000","last_fullsized":"2024-04-24T08:25:28.131582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:59:36.122581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126247+0000","last_change":"2024-04-24T08:25:28.121857+0000","last_active":"2024-04-24T08:25:28.126247+0000","last_peered":"2024-04-24T08:25:28.126247+0000","last_clean":"2024-04-24T08:25:28.126247+0000","last_became_active":"2024-04-24T08:25:28.120874+0000","last_became_peered":"2024-04-24T08:25:28.120874+0000","last_unstale":"2024-04-24T08:25:28.126247+0000","last_undegraded":"2024-04-24T08:25:28.126247+0000","last_fullsized":"2024-04-24T08:25:28.126247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:46.419388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118754+0000","last_change":"2024-04-24T08:25:27.112099+0000","last_active":"2024-04-24T08:25:29.118754+0000","last_peered":"2024-04-24T08:25:29.118754+0000","last_clean":"2024-04-24T08:25:29.118754+0000","last_became_active":"2024-04-24T08:25:27.110637+0000","last_became_peered":"2024-04-24T08:25:27.110637+0000","last_unstale":"2024-04-24T08:25:29.118754+0000","last_undegraded":"2024-04-24T08:25:29.118754+0000","last_fullsized":"2024-04-24T08:25:29.118754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487531+0000","last_change":"2024-04-24T08:25:28.132620+0000","last_active":"2024-04-24T08:25:29.487531+0000","last_peered":"2024-04-24T08:25:29.487531+0000","last_clean":"2024-04-24T08:25:29.487531+0000","last_became_active":"2024-04-24T08:25:28.129548+0000","last_became_peered":"2024-04-24T08:25:28.129548+0000","last_unstale":"2024-04-24T08:25:29.487531+0000","last_undegraded":"2024-04-24T08:25:29.487531+0000","last_fullsized":"2024-04-24T08:25:29.487531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:19:25.270847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.108368+0000","last_change":"2024-04-24T08:25:27.118817+0000","last_active":"2024-04-24T08:25:28.108368+0000","last_peered":"2024-04-24T08:25:28.108368+0000","last_clean":"2024-04-24T08:25:28.108368+0000","last_became_active":"2024-04-24T08:25:27.118507+0000","last_became_peered":"2024-04-24T08:25:27.118507+0000","last_unstale":"2024-04-24T08:25:28.108368+0000","last_undegraded":"2024-04-24T08:25:28.108368+0000","last_fullsized":"2024-04-24T08:25:28.108368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:49.812612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.132133+0000","last_change":"2024-04-24T08:25:28.123679+0000","last_active":"2024-04-24T08:25:28.132133+0000","last_peered":"2024-04-24T08:25:28.132133+0000","last_clean":"2024-04-24T08:25:28.132133+0000","last_became_active":"2024-04-24T08:25:28.123217+0000","last_became_peered":"2024-04-24T08:25:28.123217+0000","last_unstale":"2024-04-24T08:25:28.132133+0000","last_undegraded":"2024-04-24T08:25:28.132133+0000","last_fullsized":"2024-04-24T08:25:28.132133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:43:07.823084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.135258+0000","last_change":"2024-04-24T08:25:27.109716+0000","last_active":"2024-04-24T08:25:28.135258+0000","last_peered":"2024-04-24T08:25:28.135258+0000","last_clean":"2024-04-24T08:25:28.135258+0000","last_became_active":"2024-04-24T08:25:27.108346+0000","last_became_peered":"2024-04-24T08:25:27.108346+0000","last_unstale":"2024-04-24T08:25:28.135258+0000","last_undegraded":"2024-04-24T08:25:28.135258+0000","last_fullsized":"2024-04-24T08:25:28.135258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:49.812612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487078+0000","last_change":"2024-04-24T08:25:28.127900+0000","last_active":"2024-04-24T08:25:29.487078+0000","last_peered":"2024-04-24T08:25:29.487078+0000","last_clean":"2024-04-24T08:25:29.487078+0000","last_became_active":"2024-04-24T08:25:28.127563+0000","last_became_peered":"2024-04-24T08:25:28.127563+0000","last_unstale":"2024-04-24T08:25:29.487078+0000","last_undegraded":"2024-04-24T08:25:29.487078+0000","last_fullsized":"2024-04-24T08:25:29.487078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:01:48.875146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119944+0000","last_change":"2024-04-24T08:25:27.114104+0000","last_active":"2024-04-24T08:25:29.119944+0000","last_peered":"2024-04-24T08:25:29.119944+0000","last_clean":"2024-04-24T08:25:29.119944+0000","last_became_active":"2024-04-24T08:25:27.113819+0000","last_became_peered":"2024-04-24T08:25:27.113819+0000","last_unstale":"2024-04-24T08:25:29.119944+0000","last_undegraded":"2024-04-24T08:25:29.119944+0000","last_fullsized":"2024-04-24T08:25:29.119944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:18:10.642911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487665+0000","last_change":"2024-04-24T08:25:28.128545+0000","last_active":"2024-04-24T08:25:29.487665+0000","last_peered":"2024-04-24T08:25:29.487665+0000","last_clean":"2024-04-24T08:25:29.487665+0000","last_became_active":"2024-04-24T08:25:28.126907+0000","last_became_peered":"2024-04-24T08:25:28.126907+0000","last_unstale":"2024-04-24T08:25:29.487665+0000","last_undegraded":"2024-04-24T08:25:29.487665+0000","last_fullsized":"2024-04-24T08:25:29.487665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:55:06.802484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.134573+0000","last_change":"2024-04-24T08:25:27.106510+0000","last_active":"2024-04-24T08:25:28.134573+0000","last_peered":"2024-04-24T08:25:28.134573+0000","last_clean":"2024-04-24T08:25:28.134573+0000","last_became_active":"2024-04-24T08:25:27.106199+0000","last_became_peered":"2024-04-24T08:25:27.106199+0000","last_unstale":"2024-04-24T08:25:28.134573+0000","last_undegraded":"2024-04-24T08:25:28.134573+0000","last_fullsized":"2024-04-24T08:25:28.134573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487887+0000","last_change":"2024-04-24T08:25:28.133331+0000","last_active":"2024-04-24T08:25:29.487887+0000","last_peered":"2024-04-24T08:25:29.487887+0000","last_clean":"2024-04-24T08:25:29.487887+0000","last_became_active":"2024-04-24T08:25:28.133026+0000","last_became_peered":"2024-04-24T08:25:28.133026+0000","last_unstale":"2024-04-24T08:25:29.487887+0000","last_undegraded":"2024-04-24T08:25:29.487887+0000","last_fullsized":"2024-04-24T08:25:29.487887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:10:04.737380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116877+0000","last_change":"2024-04-24T08:25:27.106170+0000","last_active":"2024-04-24T08:25:29.116877+0000","last_peered":"2024-04-24T08:25:29.116877+0000","last_clean":"2024-04-24T08:25:29.116877+0000","last_became_active":"2024-04-24T08:25:27.105883+0000","last_became_peered":"2024-04-24T08:25:27.105883+0000","last_unstale":"2024-04-24T08:25:29.116877+0000","last_undegraded":"2024-04-24T08:25:29.116877+0000","last_fullsized":"2024-04-24T08:25:29.116877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:06:07.045350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119611+0000","last_change":"2024-04-24T08:25:28.130670+0000","last_active":"2024-04-24T08:25:29.119611+0000","last_peered":"2024-04-24T08:25:29.119611+0000","last_clean":"2024-04-24T08:25:29.119611+0000","last_became_active":"2024-04-24T08:25:28.130405+0000","last_became_peered":"2024-04-24T08:25:28.130405+0000","last_unstale":"2024-04-24T08:25:29.119611+0000","last_undegraded":"2024-04-24T08:25:29.119611+0000","last_fullsized":"2024-04-24T08:25:29.119611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:55:06.802484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.101489+0000","last_change":"2024-04-24T08:25:27.108774+0000","last_active":"2024-04-24T08:25:28.101489+0000","last_peered":"2024-04-24T08:25:28.101489+0000","last_clean":"2024-04-24T08:25:28.101489+0000","last_became_active":"2024-04-24T08:25:27.108368+0000","last_became_peered":"2024-04-24T08:25:27.108368+0000","last_unstale":"2024-04-24T08:25:28.101489+0000","last_undegraded":"2024-04-24T08:25:28.101489+0000","last_fullsized":"2024-04-24T08:25:28.101489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:49.837612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487247+0000","last_change":"2024-04-24T08:25:28.121303+0000","last_active":"2024-04-24T08:25:29.487247+0000","last_peered":"2024-04-24T08:25:29.487247+0000","last_clean":"2024-04-24T08:25:29.487247+0000","last_became_active":"2024-04-24T08:25:28.119922+0000","last_became_peered":"2024-04-24T08:25:28.119922+0000","last_unstale":"2024-04-24T08:25:29.487247+0000","last_undegraded":"2024-04-24T08:25:29.487247+0000","last_fullsized":"2024-04-24T08:25:29.487247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:17.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487067+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:25:29.487067+0000","last_peered":"2024-04-24T08:25:29.487067+0000","last_clean":"2024-04-24T08:25:29.487067+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:25:29.487067+0000","last_undegraded":"2024-04-24T08:25:29.487067+0000","last_fullsized":"2024-04-24T08:25:29.487067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118347+0000","last_change":"2024-04-24T08:25:27.105508+0000","last_active":"2024-04-24T08:25:29.118347+0000","last_peered":"2024-04-24T08:25:29.118347+0000","last_clean":"2024-04-24T08:25:29.118347+0000","last_became_active":"2024-04-24T08:25:27.105128+0000","last_became_peered":"2024-04-24T08:25:27.105128+0000","last_unstale":"2024-04-24T08:25:29.118347+0000","last_undegraded":"2024-04-24T08:25:29.118347+0000","last_fullsized":"2024-04-24T08:25:29.118347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:49.812612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136854+0000","last_change":"2024-04-24T08:25:28.129776+0000","last_active":"2024-04-24T08:25:28.136854+0000","last_peered":"2024-04-24T08:25:28.136854+0000","last_clean":"2024-04-24T08:25:28.136854+0000","last_became_active":"2024-04-24T08:25:28.127249+0000","last_became_peered":"2024-04-24T08:25:28.127249+0000","last_unstale":"2024-04-24T08:25:28.136854+0000","last_undegraded":"2024-04-24T08:25:28.136854+0000","last_fullsized":"2024-04-24T08:25:28.136854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:54.349880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.486974+0000","last_change":"2024-04-24T08:25:27.118013+0000","last_active":"2024-04-24T08:25:29.486974+0000","last_peered":"2024-04-24T08:25:29.486974+0000","last_clean":"2024-04-24T08:25:29.486974+0000","last_became_active":"2024-04-24T08:25:27.117768+0000","last_became_peered":"2024-04-24T08:25:27.117768+0000","last_unstale":"2024-04-24T08:25:29.486974+0000","last_undegraded":"2024-04-24T08:25:29.486974+0000","last_fullsized":"2024-04-24T08:25:29.486974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126155+0000","last_change":"2024-04-24T08:25:28.118575+0000","last_active":"2024-04-24T08:25:28.126155+0000","last_peered":"2024-04-24T08:25:28.126155+0000","last_clean":"2024-04-24T08:25:28.126155+0000","last_became_active":"2024-04-24T08:25:28.110833+0000","last_became_peered":"2024-04-24T08:25:28.110833+0000","last_unstale":"2024-04-24T08:25:28.126155+0000","last_undegraded":"2024-04-24T08:25:28.126155+0000","last_fullsized":"2024-04-24T08:25:28.126155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:07.862635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.101280+0000","last_change":"2024-04-24T08:25:27.103860+0000","last_active":"2024-04-24T08:25:28.101280+0000","last_peered":"2024-04-24T08:25:28.101280+0000","last_clean":"2024-04-24T08:25:28.101280+0000","last_became_active":"2024-04-24T08:25:27.103309+0000","last_became_peered":"2024-04-24T08:25:27.103309+0000","last_unstale":"2024-04-24T08:25:28.101280+0000","last_undegraded":"2024-04-24T08:25:28.101280+0000","last_fullsized":"2024-04-24T08:25:28.101280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:24.009056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116596+0000","last_change":"2024-04-24T08:25:28.116005+0000","last_active":"2024-04-24T08:25:29.116596+0000","last_peered":"2024-04-24T08:25:29.116596+0000","last_clean":"2024-04-24T08:25:29.116596+0000","last_became_active":"2024-04-24T08:25:28.115091+0000","last_became_peered":"2024-04-24T08:25:28.115091+0000","last_unstale":"2024-04-24T08:25:29.116596+0000","last_undegraded":"2024-04-24T08:25:29.116596+0000","last_fullsized":"2024-04-24T08:25:29.116596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:37:01.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118855+0000","last_change":"2024-04-24T08:25:27.112835+0000","last_active":"2024-04-24T08:25:29.118855+0000","last_peered":"2024-04-24T08:25:29.118855+0000","last_clean":"2024-04-24T08:25:29.118855+0000","last_became_active":"2024-04-24T08:25:27.112540+0000","last_became_peered":"2024-04-24T08:25:27.112540+0000","last_unstale":"2024-04-24T08:25:29.118855+0000","last_undegraded":"2024-04-24T08:25:29.118855+0000","last_fullsized":"2024-04-24T08:25:29.118855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119417+0000","last_change":"2024-04-24T08:25:28.110825+0000","last_active":"2024-04-24T08:25:29.119417+0000","last_peered":"2024-04-24T08:25:29.119417+0000","last_clean":"2024-04-24T08:25:29.119417+0000","last_became_active":"2024-04-24T08:25:28.110558+0000","last_became_peered":"2024-04-24T08:25:28.110558+0000","last_unstale":"2024-04-24T08:25:29.119417+0000","last_undegraded":"2024-04-24T08:25:29.119417+0000","last_fullsized":"2024-04-24T08:25:29.119417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:55.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116724+0000","last_change":"2024-04-24T08:25:27.119554+0000","last_active":"2024-04-24T08:25:29.116724+0000","last_peered":"2024-04-24T08:25:29.116724+0000","last_clean":"2024-04-24T08:25:29.116724+0000","last_became_active":"2024-04-24T08:25:27.119265+0000","last_became_peered":"2024-04-24T08:25:27.119265+0000","last_unstale":"2024-04-24T08:25:29.116724+0000","last_undegraded":"2024-04-24T08:25:29.116724+0000","last_fullsized":"2024-04-24T08:25:29.116724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:53.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119700+0000","last_change":"2024-04-24T08:25:28.129338+0000","last_active":"2024-04-24T08:25:29.119700+0000","last_peered":"2024-04-24T08:25:29.119700+0000","last_clean":"2024-04-24T08:25:29.119700+0000","last_became_active":"2024-04-24T08:25:28.129089+0000","last_became_peered":"2024-04-24T08:25:28.129089+0000","last_unstale":"2024-04-24T08:25:29.119700+0000","last_undegraded":"2024-04-24T08:25:29.119700+0000","last_fullsized":"2024-04-24T08:25:29.119700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:18.049288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487566+0000","last_change":"2024-04-24T08:25:27.122158+0000","last_active":"2024-04-24T08:25:29.487566+0000","last_peered":"2024-04-24T08:25:29.487566+0000","last_clean":"2024-04-24T08:25:29.487566+0000","last_became_active":"2024-04-24T08:25:27.121891+0000","last_became_peered":"2024-04-24T08:25:27.121891+0000","last_unstale":"2024-04-24T08:25:29.487566+0000","last_undegraded":"2024-04-24T08:25:29.487566+0000","last_fullsized":"2024-04-24T08:25:29.487566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:45.411953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116628+0000","last_change":"2024-04-24T08:25:28.105914+0000","last_active":"2024-04-24T08:25:29.116628+0000","last_peered":"2024-04-24T08:25:29.116628+0000","last_clean":"2024-04-24T08:25:29.116628+0000","last_became_active":"2024-04-24T08:25:28.105628+0000","last_became_peered":"2024-04-24T08:25:28.105628+0000","last_unstale":"2024-04-24T08:25:29.116628+0000","last_undegraded":"2024-04-24T08:25:29.116628+0000","last_fullsized":"2024-04-24T08:25:29.116628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:59.080477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116988+0000","last_change":"2024-04-24T08:25:27.120111+0000","last_active":"2024-04-24T08:25:29.116988+0000","last_peered":"2024-04-24T08:25:29.116988+0000","last_clean":"2024-04-24T08:25:29.116988+0000","last_became_active":"2024-04-24T08:25:27.119555+0000","last_became_peered":"2024-04-24T08:25:27.119555+0000","last_unstale":"2024-04-24T08:25:29.116988+0000","last_undegraded":"2024-04-24T08:25:29.116988+0000","last_fullsized":"2024-04-24T08:25:29.116988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136054+0000","last_change":"2024-04-24T08:25:28.128255+0000","last_active":"2024-04-24T08:25:28.136054+0000","last_peered":"2024-04-24T08:25:28.136054+0000","last_clean":"2024-04-24T08:25:28.136054+0000","last_became_active":"2024-04-24T08:25:28.128005+0000","last_became_peered":"2024-04-24T08:25:28.128005+0000","last_unstale":"2024-04-24T08:25:28.136054+0000","last_undegraded":"2024-04-24T08:25:28.136054+0000","last_fullsized":"2024-04-24T08:25:28.136054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:57.325390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.132940+0000","last_change":"2024-04-24T08:25:27.119402+0000","last_active":"2024-04-24T08:25:28.132940+0000","last_peered":"2024-04-24T08:25:28.132940+0000","last_clean":"2024-04-24T08:25:28.132940+0000","last_became_active":"2024-04-24T08:25:27.119087+0000","last_became_peered":"2024-04-24T08:25:27.119087+0000","last_unstale":"2024-04-24T08:25:28.132940+0000","last_undegraded":"2024-04-24T08:25:28.132940+0000","last_fullsized":"2024-04-24T08:25:28.132940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.126073+0000","last_change":"2024-04-24T08:25:28.113889+0000","last_active":"2024-04-24T08:25:28.126073+0000","last_peered":"2024-04-24T08:25:28.126073+0000","last_clean":"2024-04-24T08:25:28.126073+0000","last_became_active":"2024-04-24T08:25:28.113629+0000","last_became_peered":"2024-04-24T08:25:28.113629+0000","last_unstale":"2024-04-24T08:25:28.126073+0000","last_undegraded":"2024-04-24T08:25:28.126073+0000","last_fullsized":"2024-04-24T08:25:28.126073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:57.325390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.486955+0000","last_change":"2024-04-24T08:25:27.121672+0000","last_active":"2024-04-24T08:25:29.486955+0000","last_peered":"2024-04-24T08:25:29.486955+0000","last_clean":"2024-04-24T08:25:29.486955+0000","last_became_active":"2024-04-24T08:25:27.121369+0000","last_became_peered":"2024-04-24T08:25:27.121369+0000","last_unstale":"2024-04-24T08:25:29.486955+0000","last_undegraded":"2024-04-24T08:25:29.486955+0000","last_fullsized":"2024-04-24T08:25:29.486955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:56.317954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118783+0000","last_change":"2024-04-24T08:25:28.106699+0000","last_active":"2024-04-24T08:25:29.118783+0000","last_peered":"2024-04-24T08:25:29.118783+0000","last_clean":"2024-04-24T08:25:29.118783+0000","last_became_active":"2024-04-24T08:25:28.106354+0000","last_became_peered":"2024-04-24T08:25:28.106354+0000","last_unstale":"2024-04-24T08:25:29.118783+0000","last_undegraded":"2024-04-24T08:25:29.118783+0000","last_fullsized":"2024-04-24T08:25:29.118783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:57.325390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116843+0000","last_change":"2024-04-24T08:25:27.111525+0000","last_active":"2024-04-24T08:25:29.116843+0000","last_peered":"2024-04-24T08:25:29.116843+0000","last_clean":"2024-04-24T08:25:29.116843+0000","last_became_active":"2024-04-24T08:25:27.111231+0000","last_became_peered":"2024-04-24T08:25:27.111231+0000","last_unstale":"2024-04-24T08:25:29.116843+0000","last_undegraded":"2024-04-24T08:25:29.116843+0000","last_fullsized":"2024-04-24T08:25:29.116843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136315+0000","last_change":"2024-04-24T08:25:28.129308+0000","last_active":"2024-04-24T08:25:28.136315+0000","last_peered":"2024-04-24T08:25:28.136315+0000","last_clean":"2024-04-24T08:25:28.136315+0000","last_became_active":"2024-04-24T08:25:28.128986+0000","last_became_peered":"2024-04-24T08:25:28.128986+0000","last_unstale":"2024-04-24T08:25:28.136315+0000","last_undegraded":"2024-04-24T08:25:28.136315+0000","last_fullsized":"2024-04-24T08:25:28.136315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:07.862635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116745+0000","last_change":"2024-04-24T08:25:27.109613+0000","last_active":"2024-04-24T08:25:29.116745+0000","last_peered":"2024-04-24T08:25:29.116745+0000","last_clean":"2024-04-24T08:25:29.116745+0000","last_became_active":"2024-04-24T08:25:27.107506+0000","last_became_peered":"2024-04-24T08:25:27.107506+0000","last_unstale":"2024-04-24T08:25:29.116745+0000","last_undegraded":"2024-04-24T08:25:29.116745+0000","last_fullsized":"2024-04-24T08:25:29.116745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:29.798274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136130+0000","last_change":"2024-04-24T08:25:28.128233+0000","last_active":"2024-04-24T08:25:28.136130+0000","last_peered":"2024-04-24T08:25:28.136130+0000","last_clean":"2024-04-24T08:25:28.136130+0000","last_became_active":"2024-04-24T08:25:28.127913+0000","last_became_peered":"2024-04-24T08:25:28.127913+0000","last_unstale":"2024-04-24T08:25:28.136130+0000","last_undegraded":"2024-04-24T08:25:28.136130+0000","last_fullsized":"2024-04-24T08:25:28.136130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:30.858353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487966+0000","last_change":"2024-04-24T08:25:27.121377+0000","last_active":"2024-04-24T08:25:29.487966+0000","last_peered":"2024-04-24T08:25:29.487966+0000","last_clean":"2024-04-24T08:25:29.487966+0000","last_became_active":"2024-04-24T08:25:27.121049+0000","last_became_peered":"2024-04-24T08:25:27.121049+0000","last_unstale":"2024-04-24T08:25:29.487966+0000","last_undegraded":"2024-04-24T08:25:29.487966+0000","last_fullsized":"2024-04-24T08:25:29.487966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.132181+0000","last_change":"2024-04-24T08:25:28.127139+0000","last_active":"2024-04-24T08:25:28.132181+0000","last_peered":"2024-04-24T08:25:28.132181+0000","last_clean":"2024-04-24T08:25:28.132181+0000","last_became_active":"2024-04-24T08:25:28.126833+0000","last_became_peered":"2024-04-24T08:25:28.126833+0000","last_unstale":"2024-04-24T08:25:28.132181+0000","last_undegraded":"2024-04-24T08:25:28.132181+0000","last_fullsized":"2024-04-24T08:25:28.132181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:13.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119528+0000","last_change":"2024-04-24T08:25:28.113682+0000","last_active":"2024-04-24T08:25:29.119528+0000","last_peered":"2024-04-24T08:25:29.119528+0000","last_clean":"2024-04-24T08:25:29.119528+0000","last_became_active":"2024-04-24T08:25:28.113390+0000","last_became_peered":"2024-04-24T08:25:28.113390+0000","last_unstale":"2024-04-24T08:25:29.119528+0000","last_undegraded":"2024-04-24T08:25:29.119528+0000","last_fullsized":"2024-04-24T08:25:29.119528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:05:08.000888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487266+0000","last_change":"2024-04-24T08:25:27.121448+0000","last_active":"2024-04-24T08:25:29.487266+0000","last_peered":"2024-04-24T08:25:29.487266+0000","last_clean":"2024-04-24T08:25:29.487266+0000","last_became_active":"2024-04-24T08:25:27.121179+0000","last_became_peered":"2024-04-24T08:25:27.121179+0000","last_unstale":"2024-04-24T08:25:29.487266+0000","last_undegraded":"2024-04-24T08:25:29.487266+0000","last_fullsized":"2024-04-24T08:25:29.487266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119084+0000","last_change":"2024-04-24T08:25:28.113033+0000","last_active":"2024-04-24T08:25:29.119084+0000","last_peered":"2024-04-24T08:25:29.119084+0000","last_clean":"2024-04-24T08:25:29.119084+0000","last_became_active":"2024-04-24T08:25:28.112690+0000","last_became_peered":"2024-04-24T08:25:28.112690+0000","last_unstale":"2024-04-24T08:25:29.119084+0000","last_undegraded":"2024-04-24T08:25:29.119084+0000","last_fullsized":"2024-04-24T08:25:29.119084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:08:53.886358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487430+0000","last_change":"2024-04-24T08:25:27.123655+0000","last_active":"2024-04-24T08:25:29.487430+0000","last_peered":"2024-04-24T08:25:29.487430+0000","last_clean":"2024-04-24T08:25:29.487430+0000","last_became_active":"2024-04-24T08:25:27.123349+0000","last_became_peered":"2024-04-24T08:25:27.123349+0000","last_unstale":"2024-04-24T08:25:29.487430+0000","last_undegraded":"2024-04-24T08:25:29.487430+0000","last_fullsized":"2024-04-24T08:25:29.487430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:53.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.121637+0000","last_change":"2024-04-24T08:25:28.108443+0000","last_active":"2024-04-24T08:25:28.121637+0000","last_peered":"2024-04-24T08:25:28.121637+0000","last_clean":"2024-04-24T08:25:28.121637+0000","last_became_active":"2024-04-24T08:25:28.108128+0000","last_became_peered":"2024-04-24T08:25:28.108128+0000","last_unstale":"2024-04-24T08:25:28.121637+0000","last_undegraded":"2024-04-24T08:25:28.121637+0000","last_fullsized":"2024-04-24T08:25:28.121637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:50.845047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.135728+0000","last_change":"2024-04-24T08:25:27.114010+0000","last_active":"2024-04-24T08:25:28.135728+0000","last_peered":"2024-04-24T08:25:28.135728+0000","last_clean":"2024-04-24T08:25:28.135728+0000","last_became_active":"2024-04-24T08:25:27.113724+0000","last_became_peered":"2024-04-24T08:25:27.113724+0000","last_unstale":"2024-04-24T08:25:28.135728+0000","last_undegraded":"2024-04-24T08:25:28.135728+0000","last_fullsized":"2024-04-24T08:25:28.135728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:49.837612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.136773+0000","last_change":"2024-04-24T08:25:28.130070+0000","last_active":"2024-04-24T08:25:28.136773+0000","last_peered":"2024-04-24T08:25:28.136773+0000","last_clean":"2024-04-24T08:25:28.136773+0000","last_became_active":"2024-04-24T08:25:28.129768+0000","last_became_peered":"2024-04-24T08:25:28.129768+0000","last_unstale":"2024-04-24T08:25:28.136773+0000","last_undegraded":"2024-04-24T08:25:28.136773+0000","last_fullsized":"2024-04-24T08:25:28.136773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:46.419388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T08:25:28.132328+0000","last_change":"2024-04-24T08:25:27.112094+0000","last_active":"2024-04-24T08:25:28.132328+0000","last_peered":"2024-04-24T08:25:28.132328+0000","last_clean":"2024-04-24T08:25:28.132328+0000","last_became_active":"2024-04-24T08:25:27.111795+0000","last_became_peered":"2024-04-24T08:25:27.111795+0000","last_unstale":"2024-04-24T08:25:28.132328+0000","last_undegraded":"2024-04-24T08:25:28.132328+0000","last_fullsized":"2024-04-24T08:25:28.132328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:24.009056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:25:32.571 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-24T08:25:32.571 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-24T08:25:32.572 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-24T08:25:32.572 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-24T08:25:32.572 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-24T08:25:32.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f589dc00640 1 Processor -- start 2024-04-24T08:25:32.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f589dc00640 1 -- start start 2024-04-24T08:25:32.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f589dc00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f589806cbe0 0x7f58980b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f589dc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f589814c2c0 0x7f5898152a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f589dc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589806eb00 con 0x7f589806e720 2024-04-24T08:25:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f589dc00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f589814be30 con 0x7f589806cbe0 2024-04-24T08:25:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f589dc00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f589814b7e0 con 0x7f589814c2c0 2024-04-24T08:25:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f588e000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f589806cbe0 0x7f58980b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f588e000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f589806cbe0 0x7f58980b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34536/0 (socket says 172.21.15.88:34536) 2024-04-24T08:25:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f588e000640 1 -- 172.21.15.88:0/3403433752 learned_addr learned my addr 172.21.15.88:0/3403433752 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f5897400640 1 --2- 172.21.15.88:0/3403433752 >> v2:172.21.15.142:3300/0 conn(0x7f589814c2c0 0x7f5898152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f588e000640 1 -- 172.21.15.88:0/3403433752 >> v2:172.21.15.142:3300/0 conn(0x7f589814c2c0 msgr2=0x7f5898152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f588e000640 1 --2- 172.21.15.88:0/3403433752 >> v2:172.21.15.142:3300/0 conn(0x7f589814c2c0 0x7f5898152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f588e000640 1 -- 172.21.15.88:0/3403433752 >> v1:172.21.15.142:6789/0 conn(0x7f589806e720 legacy=0x7f58980b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.742+0000 7f588e000640 1 -- 172.21.15.88:0/3403433752 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589814bac0 con 0x7f589806cbe0 2024-04-24T08:25:32.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.746+0000 7f588e000640 1 --2- 172.21.15.88:0/3403433752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f589806cbe0 0x7f58980b7720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f58980725b0 tx=0x7f588001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd52d6ac1df9f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:32.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.746+0000 7f5896000640 1 -- 172.21.15.88:0/3403433752 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58800b1070 con 0x7f589806cbe0 2024-04-24T08:25:32.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.746+0000 7f5896000640 1 -- 172.21.15.88:0/3403433752 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58800ac640 con 0x7f589806cbe0 2024-04-24T08:25:32.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.746+0000 7f5896000640 1 -- 172.21.15.88:0/3403433752 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58800aca10 con 0x7f589806cbe0 2024-04-24T08:25:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.746+0000 7f589dc00640 1 -- 172.21.15.88:0/3403433752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f589806cbe0 msgr2=0x7f58980b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.746+0000 7f589dc00640 1 --2- 172.21.15.88:0/3403433752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f589806cbe0 0x7f58980b7720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f58980725b0 tx=0x7f588001c400 comp rx=0 tx=0).stop 2024-04-24T08:25:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.746+0000 7f589dc00640 1 -- 172.21.15.88:0/3403433752 shutdown_connections 2024-04-24T08:25:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.746+0000 7f589dc00640 1 --2- 172.21.15.88:0/3403433752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f589806cbe0 0x7f58980b7720 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.746+0000 7f589dc00640 1 --2- 172.21.15.88:0/3403433752 >> v2:172.21.15.142:3300/0 conn(0x7f589814c2c0 0x7f5898152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.746+0000 7f589dc00640 1 -- 172.21.15.88:0/3403433752 >> 172.21.15.88:0/3403433752 conn(0x7f5898067810 msgr2=0x7f5898067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.746+0000 7f589dc00640 1 -- 172.21.15.88:0/3403433752 shutdown_connections 2024-04-24T08:25:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.746+0000 7f589dc00640 1 -- 172.21.15.88:0/3403433752 wait complete. 2024-04-24T08:25:32.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f589dc00640 1 Processor -- start 2024-04-24T08:25:32.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f589dc00640 1 -- start start 2024-04-24T08:25:32.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f589dc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f589806cbe0 0x7f5898142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:32.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f589dc00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f589806e720 0x7f58981e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:32.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f589dc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f589814c2c0 0x7f58981e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:32.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f589dc00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5898155970 con 0x7f589806e720 2024-04-24T08:25:32.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f589dc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f58980b7e70 con 0x7f589806cbe0 2024-04-24T08:25:32.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f589dc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5898155af0 con 0x7f589814c2c0 2024-04-24T08:25:32.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f588e000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f589806e720 0x7f58981e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:32.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f588e000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f589806e720 0x7f58981e0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34552/0 (socket says 172.21.15.88:34552) 2024-04-24T08:25:32.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f588e000640 1 -- 172.21.15.88:0/3183848200 learned_addr learned my addr 172.21.15.88:0/3183848200 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:32.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f5897400640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f589814c2c0 0x7f58981e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:32.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f5896a00640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f589806cbe0 0x7f5898142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:32.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f588e000640 1 -- 172.21.15.88:0/3183848200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f589814c2c0 msgr2=0x7f58981e4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f588e000640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f589814c2c0 0x7f58981e4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f588e000640 1 -- 172.21.15.88:0/3183848200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f589806cbe0 msgr2=0x7f5898142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f588e000640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f589806cbe0 0x7f5898142ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f588e000640 1 -- 172.21.15.88:0/3183848200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58981444c0 con 0x7f589806e720 2024-04-24T08:25:32.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f588e000640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f589806e720 0x7f58981e0cf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5880019010 tx=0x7f58800191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:32.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f588f400640 1 -- 172.21.15.88:0/3183848200 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58800b1040 con 0x7f589806e720 2024-04-24T08:25:32.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f588f400640 1 -- 172.21.15.88:0/3183848200 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58800b5420 con 0x7f589806e720 2024-04-24T08:25:32.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f588f400640 1 -- 172.21.15.88:0/3183848200 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58800b57f0 con 0x7f589806e720 2024-04-24T08:25:32.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f589dc00640 1 -- 172.21.15.88:0/3183848200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5898148e80 con 0x7f589806e720 2024-04-24T08:25:32.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f589dc00640 1 -- 172.21.15.88:0/3183848200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58981441e0 con 0x7f589806e720 2024-04-24T08:25:32.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.750+0000 7f589dc00640 1 -- 172.21.15.88:0/3183848200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5898068b90 con 0x7f589806e720 2024-04-24T08:25:32.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.754+0000 7f588f400640 1 -- 172.21.15.88:0/3183848200 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58800b5990 con 0x7f589806e720 2024-04-24T08:25:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.754+0000 7f588f400640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5874068380 0x7f587406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.754+0000 7f588f400640 1 -- 172.21.15.88:0/3183848200 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f58801204d0 con 0x7f589806e720 2024-04-24T08:25:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.754+0000 7f5896a00640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5874068380 0x7f587406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.754+0000 7f5896a00640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5874068380 0x7f587406a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5888001650 tx=0x7f5888009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.758+0000 7f588f400640 1 -- 172.21.15.88:0/3183848200 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5880016110 con 0x7f589806e720 2024-04-24T08:25:32.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.954+0000 7f589dc00640 1 -- 172.21.15.88:0/3183848200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f58980a9b20 con 0x7f589806e720 2024-04-24T08:25:32.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.958+0000 7f588f400640 1 -- 172.21.15.88:0/3183848200 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168084 (secure 0 0 0) 0x7f58800f0ba0 con 0x7f589806e720 2024-04-24T08:25:32.960 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:32.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.962+0000 7f589dc00640 1 -- 172.21.15.88:0/3183848200 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5874068380 msgr2=0x7f587406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.962+0000 7f589dc00640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5874068380 0x7f587406a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5888001650 tx=0x7f5888009040 comp rx=0 tx=0).stop 2024-04-24T08:25:32.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.962+0000 7f589dc00640 1 -- 172.21.15.88:0/3183848200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f589806e720 msgr2=0x7f58981e0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:32.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.962+0000 7f589dc00640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f589806e720 0x7f58981e0cf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5880019010 tx=0x7f58800191a0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.962+0000 7f589dc00640 1 -- 172.21.15.88:0/3183848200 shutdown_connections 2024-04-24T08:25:32.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.962+0000 7f589dc00640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5874068380 0x7f587406a840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.962+0000 7f589dc00640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f589814c2c0 0x7f58981e4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.962+0000 7f589dc00640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f589806e720 0x7f58981e0cf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.962+0000 7f589dc00640 1 --2- 172.21.15.88:0/3183848200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f589806cbe0 0x7f5898142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.962+0000 7f589dc00640 1 -- 172.21.15.88:0/3183848200 >> 172.21.15.88:0/3183848200 conn(0x7f5898067810 msgr2=0x7f58980b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.962+0000 7f589dc00640 1 -- 172.21.15.88:0/3183848200 shutdown_connections 2024-04-24T08:25:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:32.962+0000 7f589dc00640 1 -- 172.21.15.88:0/3183848200 wait complete. 2024-04-24T08:25:32.980 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1577478747},{"type":"v1","addr":"172.21.15.88:6833","nonce":1577478747}]},"active_addr":"172.21.15.88:6833/1577478747","active_change":"2024-04-24T08:25:06.974158+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":3136144501}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":3391349935}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":834453585}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":3621522571}]}]} 2024-04-24T08:25:32.983 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-24T08:25:32.983 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-24T08:25:32.984 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:33.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.118+0000 7f1865200640 1 Processor -- start 2024-04-24T08:25:33.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.118+0000 7f1865200640 1 -- start start 2024-04-24T08:25:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.118+0000 7f1865200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18600af4f0 0x7f18600b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.118+0000 7f1865200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f18600af8d0 0x7f1860148550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.118+0000 7f1865200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f186006bad0 con 0x7f1860148a90 2024-04-24T08:25:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.118+0000 7f1865200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f1860147db0 con 0x7f18600af8d0 2024-04-24T08:25:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.118+0000 7f1865200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f18600b6b90 con 0x7f18600af4f0 2024-04-24T08:25:33.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.118+0000 7f1855400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f18600af8d0 0x7f1860148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.118+0000 7f185e800640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1860148a90 0x7f186006bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59542/0 (socket says 172.21.15.88:59542) 2024-04-24T08:25:33.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.118+0000 7f185e800640 1 -- 172.21.15.88:0/2254632212 learned_addr learned my addr 172.21.15.88:0/2254632212 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:33.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.122+0000 7f185de00640 1 --2- 172.21.15.88:0/2254632212 >> v2:172.21.15.142:3300/0 conn(0x7f18600af4f0 0x7f18600b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.122+0000 7f1855400640 1 -- 172.21.15.88:0/2254632212 >> v2:172.21.15.142:3300/0 conn(0x7f18600af4f0 msgr2=0x7f18600b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.122+0000 7f1855400640 1 --2- 172.21.15.88:0/2254632212 >> v2:172.21.15.142:3300/0 conn(0x7f18600af4f0 0x7f18600b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.122+0000 7f1855400640 1 -- 172.21.15.88:0/2254632212 >> v1:172.21.15.88:6789/0 conn(0x7f1860148a90 legacy=0x7f186006bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.122+0000 7f1855400640 1 -- 172.21.15.88:0/2254632212 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1860148030 con 0x7f18600af8d0 2024-04-24T08:25:33.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.122+0000 7f185de00640 1 --2- 172.21.15.88:0/2254632212 >> v2:172.21.15.142:3300/0 conn(0x7f18600af4f0 0x7f18600b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:33.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.122+0000 7f1855400640 1 --2- 172.21.15.88:0/2254632212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18600af8d0 0x7f1860148550 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f186006db50 tx=0x7f184801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7183f01b543fbd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.122+0000 7f185d400640 1 -- 172.21.15.88:0/2254632212 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18480b1070 con 0x7f18600af8d0 2024-04-24T08:25:33.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.122+0000 7f185d400640 1 -- 172.21.15.88:0/2254632212 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18480ac600 con 0x7f18600af8d0 2024-04-24T08:25:33.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.122+0000 7f185d400640 1 -- 172.21.15.88:0/2254632212 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18480ac9d0 con 0x7f18600af8d0 2024-04-24T08:25:33.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.122+0000 7f1865200640 1 -- 172.21.15.88:0/2254632212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18600af8d0 msgr2=0x7f1860148550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.122+0000 7f1865200640 1 --2- 172.21.15.88:0/2254632212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18600af8d0 0x7f1860148550 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f186006db50 tx=0x7f184801c510 comp rx=0 tx=0).stop 2024-04-24T08:25:33.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 -- 172.21.15.88:0/2254632212 shutdown_connections 2024-04-24T08:25:33.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 --2- 172.21.15.88:0/2254632212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18600af8d0 0x7f1860148550 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 --2- 172.21.15.88:0/2254632212 >> v2:172.21.15.142:3300/0 conn(0x7f18600af4f0 0x7f18600b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 -- 172.21.15.88:0/2254632212 >> 172.21.15.88:0/2254632212 conn(0x7f18600b6fd0 msgr2=0x7f18600b73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 -- 172.21.15.88:0/2254632212 shutdown_connections 2024-04-24T08:25:33.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 -- 172.21.15.88:0/2254632212 wait complete. 2024-04-24T08:25:33.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 Processor -- start 2024-04-24T08:25:33.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 -- start start 2024-04-24T08:25:33.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18600af4f0 0x7f1860149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18600af8d0 0x7f186009f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1860148a90 0x7f186009f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f18600b6970 con 0x7f18600af4f0 2024-04-24T08:25:33.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f18600b67f0 con 0x7f1860148a90 2024-04-24T08:25:33.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1860154660 con 0x7f18600af8d0 2024-04-24T08:25:33.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f185de00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18600af4f0 0x7f1860149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f185de00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18600af4f0 0x7f1860149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34568/0 (socket says 172.21.15.88:34568) 2024-04-24T08:25:33.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f185de00640 1 -- 172.21.15.88:0/511869015 learned_addr learned my addr 172.21.15.88:0/511869015 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f185e800640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1860148a90 0x7f186009f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1855400640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18600af8d0 0x7f186009f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f185de00640 1 -- 172.21.15.88:0/511869015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18600af8d0 msgr2=0x7f186009f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f185de00640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18600af8d0 0x7f186009f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f185de00640 1 -- 172.21.15.88:0/511869015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1860148a90 msgr2=0x7f186009f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f185de00640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1860148a90 0x7f186009f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f185de00640 1 -- 172.21.15.88:0/511869015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1860147be0 con 0x7f18600af4f0 2024-04-24T08:25:33.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1855400640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18600af8d0 0x7f186009f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:33.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f185e800640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1860148a90 0x7f186009f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:33.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f185de00640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18600af4f0 0x7f1860149170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f185000d800 tx=0x7f185000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1856a00640 1 -- 172.21.15.88:0/511869015 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185000b660 con 0x7f18600af4f0 2024-04-24T08:25:33.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1856a00640 1 -- 172.21.15.88:0/511869015 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1850019070 con 0x7f18600af4f0 2024-04-24T08:25:33.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1856a00640 1 -- 172.21.15.88:0/511869015 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185000ba40 con 0x7f18600af4f0 2024-04-24T08:25:33.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 -- 172.21.15.88:0/511869015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186014a820 con 0x7f18600af4f0 2024-04-24T08:25:33.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.126+0000 7f1865200640 1 -- 172.21.15.88:0/511869015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1860145310 con 0x7f18600af4f0 2024-04-24T08:25:33.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.130+0000 7f1865200640 1 -- 172.21.15.88:0/511869015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1860068b90 con 0x7f18600af4f0 2024-04-24T08:25:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.130+0000 7f1856a00640 1 -- 172.21.15.88:0/511869015 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f185000bbe0 con 0x7f18600af4f0 2024-04-24T08:25:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.130+0000 7f1856a00640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f183c0683b0 0x7f183c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.130+0000 7f1856a00640 1 -- 172.21.15.88:0/511869015 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1850086d70 con 0x7f18600af4f0 2024-04-24T08:25:33.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.130+0000 7f1855400640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f183c0683b0 0x7f183c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.130+0000 7f1855400640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f183c0683b0 0x7f183c06a870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18480ae000 tx=0x7f1848008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.134+0000 7f1856a00640 1 -- 172.21.15.88:0/511869015 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1850057320 con 0x7f18600af4f0 2024-04-24T08:25:33.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.290+0000 7f1865200640 1 -- 172.21.15.88:0/511869015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18600b4bb0 con 0x7f18600af4f0 2024-04-24T08:25:33.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1856a00640 1 -- 172.21.15.88:0/511869015 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f1850056c20 con 0x7f18600af4f0 2024-04-24T08:25:33.294 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:33.294 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:33.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1865200640 1 -- 172.21.15.88:0/511869015 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f183c0683b0 msgr2=0x7f183c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1865200640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f183c0683b0 0x7f183c06a870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18480ae000 tx=0x7f1848008040 comp rx=0 tx=0).stop 2024-04-24T08:25:33.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1865200640 1 -- 172.21.15.88:0/511869015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18600af4f0 msgr2=0x7f1860149170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1865200640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18600af4f0 0x7f1860149170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f185000d800 tx=0x7f185000dcc0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1865200640 1 -- 172.21.15.88:0/511869015 shutdown_connections 2024-04-24T08:25:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1865200640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f183c0683b0 0x7f183c06a870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1865200640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1860148a90 0x7f186009f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1865200640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18600af8d0 0x7f186009f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1865200640 1 --2- 172.21.15.88:0/511869015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18600af4f0 0x7f1860149170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1865200640 1 -- 172.21.15.88:0/511869015 >> 172.21.15.88:0/511869015 conn(0x7f18600b6fd0 msgr2=0x7f1860146bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1865200640 1 -- 172.21.15.88:0/511869015 shutdown_connections 2024-04-24T08:25:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.294+0000 7f1865200640 1 -- 172.21.15.88:0/511869015 wait complete. 2024-04-24T08:25:33.315 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-24T08:25:33.315 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:33.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3fe200640 1 Processor -- start 2024-04-24T08:25:33.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3fe200640 1 -- start start 2024-04-24T08:25:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3fe200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe3f80b6770 0x7fe3f806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3fe200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe3f814c5e0 0x7fe3f814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3fe200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3f80aba50 con 0x7fe3f806e720 2024-04-24T08:25:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3fe200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fe3f806eb00 con 0x7fe3f80b6770 2024-04-24T08:25:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3fe200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe3f80b64a0 con 0x7fe3f814c5e0 2024-04-24T08:25:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3f6a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe3f80b6770 0x7fe3f806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3f6a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe3f80b6770 0x7fe3f806cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34574/0 (socket says 172.21.15.88:34574) 2024-04-24T08:25:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3f6a00640 1 -- 172.21.15.88:0/1811423568 learned_addr learned my addr 172.21.15.88:0/1811423568 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3f7e00640 1 --2- 172.21.15.88:0/1811423568 >> v2:172.21.15.142:3300/0 conn(0x7fe3f814c5e0 0x7fe3f814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3f6a00640 1 -- 172.21.15.88:0/1811423568 >> v2:172.21.15.142:3300/0 conn(0x7fe3f814c5e0 msgr2=0x7fe3f814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3f6a00640 1 --2- 172.21.15.88:0/1811423568 >> v2:172.21.15.142:3300/0 conn(0x7fe3f814c5e0 0x7fe3f814ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3f6a00640 1 -- 172.21.15.88:0/1811423568 >> v1:172.21.15.142:6789/0 conn(0x7fe3f806e720 legacy=0x7fe3f80b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.450+0000 7fe3f6a00640 1 -- 172.21.15.88:0/1811423568 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f80abcf0 con 0x7fe3f80b6770 2024-04-24T08:25:33.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.454+0000 7fe3f6a00640 1 --2- 172.21.15.88:0/1811423568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3f80b6770 0x7fe3f806cbe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80abf80 tx=0x7fe3e401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de854220035ef1fd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.454+0000 7fe3f6000640 1 -- 172.21.15.88:0/1811423568 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e40b0070 con 0x7fe3f80b6770 2024-04-24T08:25:33.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.454+0000 7fe3f6000640 1 -- 172.21.15.88:0/1811423568 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e40a4e50 con 0x7fe3f80b6770 2024-04-24T08:25:33.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.454+0000 7fe3f6000640 1 -- 172.21.15.88:0/1811423568 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e40ab820 con 0x7fe3f80b6770 2024-04-24T08:25:33.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.454+0000 7fe3fe200640 1 -- 172.21.15.88:0/1811423568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3f80b6770 msgr2=0x7fe3f806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.454+0000 7fe3fe200640 1 --2- 172.21.15.88:0/1811423568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3f80b6770 0x7fe3f806cbe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80abf80 tx=0x7fe3e401c3c0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.454+0000 7fe3fe200640 1 -- 172.21.15.88:0/1811423568 shutdown_connections 2024-04-24T08:25:33.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.454+0000 7fe3fe200640 1 --2- 172.21.15.88:0/1811423568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3f80b6770 0x7fe3f806cbe0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.454+0000 7fe3fe200640 1 --2- 172.21.15.88:0/1811423568 >> v2:172.21.15.142:3300/0 conn(0x7fe3f814c5e0 0x7fe3f814ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.454+0000 7fe3fe200640 1 -- 172.21.15.88:0/1811423568 >> 172.21.15.88:0/1811423568 conn(0x7fe3f8067810 msgr2=0x7fe3f8067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.454+0000 7fe3fe200640 1 -- 172.21.15.88:0/1811423568 shutdown_connections 2024-04-24T08:25:33.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.454+0000 7fe3fe200640 1 -- 172.21.15.88:0/1811423568 wait complete. 2024-04-24T08:25:33.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3fe200640 1 Processor -- start 2024-04-24T08:25:33.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3fe200640 1 -- start start 2024-04-24T08:25:33.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3fe200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3f806e720 0x7fe3f8142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3fe200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3f80b6770 0x7fe3f80a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3fe200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3f814c5e0 0x7fe3f8147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3fe200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f8159a30 con 0x7fe3f806e720 2024-04-24T08:25:33.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3fe200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81598b0 con 0x7fe3f80b6770 2024-04-24T08:25:33.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3fe200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f8159bb0 con 0x7fe3f814c5e0 2024-04-24T08:25:33.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3f7400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3f806e720 0x7fe3f8142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3f7400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3f806e720 0x7fe3f8142d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34586/0 (socket says 172.21.15.88:34586) 2024-04-24T08:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3f7400640 1 -- 172.21.15.88:0/1831300764 learned_addr learned my addr 172.21.15.88:0/1831300764 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3f7e00640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3f814c5e0 0x7fe3f8147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3f6a00640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3f80b6770 0x7fe3f80a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3f7400640 1 -- 172.21.15.88:0/1831300764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3f814c5e0 msgr2=0x7fe3f8147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3f7400640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3f814c5e0 0x7fe3f8147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3f7400640 1 -- 172.21.15.88:0/1831300764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3f80b6770 msgr2=0x7fe3f80a9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3f7400640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3f80b6770 0x7fe3f80a9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3f7400640 1 -- 172.21.15.88:0/1831300764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f80af0c0 con 0x7fe3f806e720 2024-04-24T08:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3f7400640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3f806e720 0x7fe3f8142d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800c7c0 tx=0x7fe3e800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3ef400640 1 -- 172.21.15.88:0/1831300764 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8016020 con 0x7fe3f806e720 2024-04-24T08:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3ef400640 1 -- 172.21.15.88:0/1831300764 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e800aa50 con 0x7fe3f806e720 2024-04-24T08:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3fe200640 1 -- 172.21.15.88:0/1831300764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f813e030 con 0x7fe3f806e720 2024-04-24T08:25:33.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3ef400640 1 -- 172.21.15.88:0/1831300764 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8012420 con 0x7fe3f806e720 2024-04-24T08:25:33.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3fe200640 1 -- 172.21.15.88:0/1831300764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f80a9990 con 0x7fe3f806e720 2024-04-24T08:25:33.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.458+0000 7fe3fe200640 1 -- 172.21.15.88:0/1831300764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f8068b90 con 0x7fe3f806e720 2024-04-24T08:25:33.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.462+0000 7fe3ef400640 1 -- 172.21.15.88:0/1831300764 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe3e8019020 con 0x7fe3f806e720 2024-04-24T08:25:33.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.462+0000 7fe3ef400640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe3d8068380 0x7fe3d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.462+0000 7fe3ef400640 1 -- 172.21.15.88:0/1831300764 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe3e8086a20 con 0x7fe3f806e720 2024-04-24T08:25:33.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.462+0000 7fe3f6a00640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe3d8068380 0x7fe3d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.462+0000 7fe3f6a00640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe3d8068380 0x7fe3d806a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40ad000 tx=0x7fe3e40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.466+0000 7fe3ef400640 1 -- 172.21.15.88:0/1831300764 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe3e8020030 con 0x7fe3f806e720 2024-04-24T08:25:33.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.622+0000 7fe3fe200640 1 -- 172.21.15.88:0/1831300764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3f80ab7e0 con 0x7fe3f806e720 2024-04-24T08:25:33.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3ef400640 1 -- 172.21.15.88:0/1831300764 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fe3e8056fd0 con 0x7fe3f806e720 2024-04-24T08:25:33.626 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:33.626 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:33.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3fe200640 1 -- 172.21.15.88:0/1831300764 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe3d8068380 msgr2=0x7fe3d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3fe200640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe3d8068380 0x7fe3d806a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40ad000 tx=0x7fe3e40a6000 comp rx=0 tx=0).stop 2024-04-24T08:25:33.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3fe200640 1 -- 172.21.15.88:0/1831300764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3f806e720 msgr2=0x7fe3f8142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3fe200640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3f806e720 0x7fe3f8142d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800c7c0 tx=0x7fe3e800cc80 comp rx=0 tx=0).stop 2024-04-24T08:25:33.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3fe200640 1 -- 172.21.15.88:0/1831300764 shutdown_connections 2024-04-24T08:25:33.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3fe200640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe3d8068380 0x7fe3d806a840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3fe200640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3f814c5e0 0x7fe3f8147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3fe200640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3f80b6770 0x7fe3f80a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3fe200640 1 --2- 172.21.15.88:0/1831300764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3f806e720 0x7fe3f8142d40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3fe200640 1 -- 172.21.15.88:0/1831300764 >> 172.21.15.88:0/1831300764 conn(0x7fe3f8067810 msgr2=0x7fe3f8072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3fe200640 1 -- 172.21.15.88:0/1831300764 shutdown_connections 2024-04-24T08:25:33.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.626+0000 7fe3fe200640 1 -- 172.21.15.88:0/1831300764 wait complete. 2024-04-24T08:25:33.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-24T08:25:33.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-24T08:25:33.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-24T08:25:33.648 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-24T08:25:33.648 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-24T08:25:33.648 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-24T08:25:33.649 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-24T08:25:33.649 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-24T08:25:33.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f105fe00640 1 Processor -- start 2024-04-24T08:25:33.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f105fe00640 1 -- start start 2024-04-24T08:25:33.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f105fe00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1060147230 0x7f10600b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f105fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600b2890 0x7f10600b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f1395000640 1 Processor -- start 2024-04-24T08:25:33.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f105fe00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10600b1620 con 0x7f10600b11b0 2024-04-24T08:25:33.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f105fe00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f1060073b80 con 0x7f1060147230 2024-04-24T08:25:33.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f105fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1060070460 con 0x7f10600b2890 2024-04-24T08:25:33.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f1395000640 1 -- start start 2024-04-24T08:25:33.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f105e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600b2890 0x7f10600b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f7760e00640 1 Processor -- start 2024-04-24T08:25:33.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f105e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600b2890 0x7f10600b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:43800/0 (socket says 172.21.15.88:43800) 2024-04-24T08:25:33.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.890+0000 7f105e000640 1 -- 172.21.15.88:0/1096997714 learned_addr learned my addr 172.21.15.88:0/1096997714 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92920765 0 0) 0x7f10600b1620 con 0x7f10600b11b0 2024-04-24T08:25:33.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1044003530 con 0x7f10600b11b0 2024-04-24T08:25:33.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105ea00640 1 --2- 172.21.15.88:0/1096997714 >> v2:172.21.15.88:3300/0 conn(0x7f1060147230 0x7f10600b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f1395000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1390146530 0x7f139006cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f1395000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f139006eb10 con 0x7f139014cb30 2024-04-24T08:25:33.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3747226941 0 0) 0x7f1044003530 con 0x7f10600b11b0 2024-04-24T08:25:33.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f7760e00640 1 -- start start 2024-04-24T08:25:33.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f7760e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c0b0b70 0x7f775c0b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f7760e00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775c0b6e50 con 0x7f775c148150 2024-04-24T08:25:33.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f7760e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775c0af560 con 0x7f775c0b0040 2024-04-24T08:25:33.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f7760e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f775c0af840 con 0x7f775c0b0b70 2024-04-24T08:25:33.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600b2890 msgr2=0x7f10600b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 --2- 172.21.15.88:0/1096997714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600b2890 0x7f10600b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 >> v2:172.21.15.88:3300/0 conn(0x7f1060147230 msgr2=0x7f10600b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 --2- 172.21.15.88:0/1096997714 >> v2:172.21.15.88:3300/0 conn(0x7f1060147230 0x7f10600b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10601479d0 con 0x7f10600b11b0 2024-04-24T08:25:33.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f1058001a00 con 0x7f10600b11b0 2024-04-24T08:25:33.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f7759400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c0b0b70 0x7f775c0b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f7759400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c0b0b70 0x7f775c0b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:43822/0 (socket says 172.21.15.88:43822) 2024-04-24T08:25:33.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f7759400640 1 -- 172.21.15.88:0/1510483231 learned_addr learned my addr 172.21.15.88:0/1510483231 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 >> v1:172.21.15.88:6789/0 conn(0x7f10600b11b0 legacy=0x7f1060072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 --2- 172.21.15.88:0/1096997714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1044004ba0 0x7f10440037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 --2- 172.21.15.88:0/1096997714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1044003e70 0x7f104400d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 --2- 172.21.15.88:0/1096997714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600b2890 0x7f104400f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1060073b80 con 0x7f1044004ba0 2024-04-24T08:25:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1060070460 con 0x7f1044003e70 2024-04-24T08:25:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f104400ff30 con 0x7f10600b2890 2024-04-24T08:25:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f6a95600640 1 Processor -- start 2024-04-24T08:25:33.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f6a95600640 1 -- start start 2024-04-24T08:25:33.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105e000640 1 --2- 172.21.15.88:0/1096997714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1044003e70 0x7f104400d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f1395000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13900b5380 con 0x7f139006e730 2024-04-24T08:25:33.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f1395000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f139006dfd0 con 0x7f1390146530 2024-04-24T08:25:33.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f138de00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f139006e730 0x7f139014c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:60804/0 (socket says 172.21.15.88:60804) 2024-04-24T08:25:33.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f138de00640 1 -- 172.21.15.88:0/2094892785 learned_addr learned my addr 172.21.15.88:0/2094892785 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:33.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f138e800640 1 --2- 172.21.15.88:0/2094892785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1390146530 0x7f139006cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f138e800640 1 -- 172.21.15.88:0/2094892785 >> v1:172.21.15.142:6789/0 conn(0x7f139006e730 legacy=0x7f139014c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f138e800640 1 -- 172.21.15.88:0/2094892785 >> v1:172.21.15.88:6789/0 conn(0x7f139014cb30 legacy=0x7f1390145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f138e800640 1 -- 172.21.15.88:0/2094892785 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13900b5660 con 0x7f1390146530 2024-04-24T08:25:33.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f7759400640 1 -- 172.21.15.88:0/1510483231 >> v1:172.21.15.142:6789/0 conn(0x7f775c0b0040 legacy=0x7f775c09c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105f400640 1 --2- 172.21.15.88:0/1096997714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600b2890 0x7f104400f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f7759400640 1 -- 172.21.15.88:0/1510483231 >> v1:172.21.15.88:6789/0 conn(0x7f775c148150 legacy=0x7f775c148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f6a95600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9014cb20 0x7f6a901577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f7759400640 1 -- 172.21.15.88:0/1510483231 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c0afb20 con 0x7f775c0b0b70 2024-04-24T08:25:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105f400640 1 -- 172.21.15.88:0/1096997714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1044003e70 msgr2=0x7f104400d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105f400640 1 --2- 172.21.15.88:0/1096997714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1044003e70 0x7f104400d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105f400640 1 -- 172.21.15.88:0/1096997714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1044004ba0 msgr2=0x7f10440037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105f400640 1 --2- 172.21.15.88:0/1096997714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1044004ba0 0x7f10440037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7f105f400640 1 -- 172.21.15.88:0/1096997714 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1044003530 con 0x7f10600b2890 2024-04-24T08:25:33.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7f6a95600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a900b0dc0 con 0x7f6a900b1ec0 2024-04-24T08:25:33.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7f6a94c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9014cb20 0x7f6a901577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7f6a94c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9014cb20 0x7f6a901577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:43840/0 (socket says 172.21.15.88:43840) 2024-04-24T08:25:33.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7f6a94c00640 1 -- 172.21.15.88:0/294648642 learned_addr learned my addr 172.21.15.88:0/294648642 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.894+0000 7fab48c00640 1 Processor -- start 2024-04-24T08:25:33.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fab48c00640 1 -- start start 2024-04-24T08:25:33.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7f6a95600640 1 -- 172.21.15.88:0/294648642 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a9014bf30 con 0x7f6a90146270 2024-04-24T08:25:33.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7f6a95600640 1 -- 172.21.15.88:0/294648642 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6a900b1060 con 0x7f6a9014cb20 2024-04-24T08:25:33.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fab48c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fab4409c4d0 0x7fab4409c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fab48c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440b3eb0 0x7fab440b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fab48c00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab440b4850 con 0x7fab4406d210 2024-04-24T08:25:33.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fab48c00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fab44098da0 con 0x7fab4409c4d0 2024-04-24T08:25:33.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fab48c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fab440b5970 con 0x7fab440b3eb0 2024-04-24T08:25:33.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fab42800640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fab4406d210 0x7fab4406d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59590/0 (socket says 172.21.15.88:59590) 2024-04-24T08:25:33.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fab42800640 1 -- 172.21.15.88:0/2726203662 learned_addr learned my addr 172.21.15.88:0/2726203662 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:33.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fb664400640 1 Processor -- start 2024-04-24T08:25:33.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fb664400640 1 -- start start 2024-04-24T08:25:33.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fb664400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb65c0af990 0x7fb65c0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fab41e00640 1 --2- 172.21.15.88:0/2726203662 >> v2:172.21.15.88:3300/0 conn(0x7fab4409c4d0 0x7fab4409c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fb664400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb65c14fbb0 0x7fb65c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fb664400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb65c150120 con 0x7fb65c14f770 2024-04-24T08:25:33.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fb664400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb65c1506e0 con 0x7fb65c14fbb0 2024-04-24T08:25:33.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7fb664400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb65c150400 con 0x7fb65c0af990 2024-04-24T08:25:33.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7f138e800640 1 --2- 172.21.15.88:0/2094892785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1390146530 0x7f139006cbe0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1388009dc0 tx=0x7f138801c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=babef22eb122db55 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fab41400640 1 --2- 172.21.15.88:0/2726203662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440b3eb0 0x7fab440b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fb662400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb65c14fbb0 0x7fb65c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fb661a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb65c0af990 0x7fb65c0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fb662400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb65c14fbb0 0x7fb65c06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34610/0 (socket says 172.21.15.88:34610) 2024-04-24T08:25:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fb662400640 1 -- 172.21.15.88:0/488927319 learned_addr learned my addr 172.21.15.88:0/488927319 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f138d400640 1 -- 172.21.15.88:0/2094892785 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13900b5140 con 0x7f1390146530 2024-04-24T08:25:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f138d400640 1 -- 172.21.15.88:0/2094892785 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13880a66b0 con 0x7f1390146530 2024-04-24T08:25:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f138d400640 1 -- 172.21.15.88:0/2094892785 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13880a6a80 con 0x7f1390146530 2024-04-24T08:25:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f7759400640 1 --2- 172.21.15.88:0/1510483231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c0b0b70 0x7f775c0b4f40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f77480098a0 tx=0x7f774801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55d89ce028e5990d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f105f400640 1 --2- 172.21.15.88:0/1096997714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600b2890 0x7f104400f970 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f105800c490 tx=0x7f105801cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26d09f8af9f2ea4b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fb662400640 1 -- 172.21.15.88:0/488927319 >> v2:172.21.15.142:3300/0 conn(0x7fb65c0af990 msgr2=0x7fb65c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fb662400640 1 --2- 172.21.15.88:0/488927319 >> v2:172.21.15.142:3300/0 conn(0x7fb65c0af990 0x7fb65c0afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fb662400640 1 -- 172.21.15.88:0/488927319 >> v1:172.21.15.88:6789/0 conn(0x7fb65c14f770 legacy=0x7fb65c0b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fb662400640 1 -- 172.21.15.88:0/488927319 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65c0b5a00 con 0x7fb65c14fbb0 2024-04-24T08:25:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7f6a94c00640 1 -- 172.21.15.88:0/294648642 >> v1:172.21.15.142:6789/0 conn(0x7f6a90146270 legacy=0x7f6a9014c410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T08:25:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7f6a94c00640 1 -- 172.21.15.88:0/294648642 >> v1:172.21.15.88:6789/0 conn(0x7f6a900b1ec0 legacy=0x7f6a90145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.898+0000 7f6a94c00640 1 -- 172.21.15.88:0/294648642 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a900b1340 con 0x7f6a9014cb20 2024-04-24T08:25:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10580b2070 con 0x7f10600b2890 2024-04-24T08:25:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10580a5c00 con 0x7f10600b2890 2024-04-24T08:25:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f105d600640 1 -- 172.21.15.88:0/1096997714 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105800c0e0 con 0x7f10600b2890 2024-04-24T08:25:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fab41e00640 1 -- 172.21.15.88:0/2726203662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440b3eb0 msgr2=0x7fab440b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fab41e00640 1 --2- 172.21.15.88:0/2726203662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440b3eb0 0x7fab440b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fab41e00640 1 -- 172.21.15.88:0/2726203662 >> v1:172.21.15.88:6789/0 conn(0x7fab4406d210 legacy=0x7fab4406d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7fab41e00640 1 -- 172.21.15.88:0/2726203662 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4409dc60 con 0x7fab4409c4d0 2024-04-24T08:25:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f7758a00640 1 -- 172.21.15.88:0/1510483231 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77480b0070 con 0x7f775c0b0b70 2024-04-24T08:25:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f7758a00640 1 -- 172.21.15.88:0/1510483231 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77480ab600 con 0x7f775c0b0b70 2024-04-24T08:25:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f7758a00640 1 -- 172.21.15.88:0/1510483231 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77480ab9d0 con 0x7f775c0b0b70 2024-04-24T08:25:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f1395000640 1 -- 172.21.15.88:0/2094892785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1390146530 msgr2=0x7f139006cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f1395000640 1 --2- 172.21.15.88:0/2094892785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1390146530 0x7f139006cbe0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1388009dc0 tx=0x7f138801c750 comp rx=0 tx=0).stop 2024-04-24T08:25:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f1395000640 1 -- 172.21.15.88:0/2094892785 shutdown_connections 2024-04-24T08:25:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f1395000640 1 --2- 172.21.15.88:0/2094892785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1390146530 0x7f139006cbe0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f1395000640 1 -- 172.21.15.88:0/2094892785 >> 172.21.15.88:0/2094892785 conn(0x7f13900bb4d0 msgr2=0x7f13900bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f6a94c00640 1 --2- 172.21.15.88:0/294648642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9014cb20 0x7f6a901577b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009e80 tx=0x7f6a8801c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2168b1283aeb5321 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f1395000640 1 -- 172.21.15.88:0/2094892785 shutdown_connections 2024-04-24T08:25:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f36d8e00640 1 Processor -- start 2024-04-24T08:25:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f1395000640 1 -- 172.21.15.88:0/2094892785 wait complete. 2024-04-24T08:25:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f105fe00640 1 -- 172.21.15.88:0/1096997714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600b2890 msgr2=0x7f104400f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f105fe00640 1 --2- 172.21.15.88:0/1096997714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600b2890 0x7f104400f970 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f105800c490 tx=0x7f105801cf20 comp rx=0 tx=0).stop 2024-04-24T08:25:33.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f7760e00640 1 -- 172.21.15.88:0/1510483231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c0b0b70 msgr2=0x7f775c0b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f7760e00640 1 --2- 172.21.15.88:0/1510483231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c0b0b70 0x7f775c0b4f40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f77480098a0 tx=0x7f774801c420 comp rx=0 tx=0).stop 2024-04-24T08:25:33.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f105f400640 1 -- 172.21.15.88:0/1096997714 reap_dead start 2024-04-24T08:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f6a8ea00640 1 -- 172.21.15.88:0/294648642 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a880a5690 con 0x7f6a9014cb20 2024-04-24T08:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f6a8ea00640 1 -- 172.21.15.88:0/294648642 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a880a5830 con 0x7f6a9014cb20 2024-04-24T08:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f6a8ea00640 1 -- 172.21.15.88:0/294648642 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a880a5c00 con 0x7f6a9014cb20 2024-04-24T08:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f36d8e00640 1 -- start start 2024-04-24T08:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f7760e00640 1 -- 172.21.15.88:0/1510483231 shutdown_connections 2024-04-24T08:25:33.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f7760e00640 1 --2- 172.21.15.88:0/1510483231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c0b0b70 0x7f775c0b4f40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f7760e00640 1 -- 172.21.15.88:0/1510483231 >> 172.21.15.88:0/1510483231 conn(0x7f775c0b7040 msgr2=0x7f775c0b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f7760e00640 1 -- 172.21.15.88:0/1510483231 shutdown_connections 2024-04-24T08:25:33.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f7760e00640 1 -- 172.21.15.88:0/1510483231 wait complete. 2024-04-24T08:25:33.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f105fe00640 1 -- 172.21.15.88:0/1096997714 shutdown_connections 2024-04-24T08:25:33.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.902+0000 7f105fe00640 1 -- 172.21.15.88:0/1096997714 >> 172.21.15.88:0/1096997714 conn(0x7f10600b91f0 msgr2=0x7f10600b9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a38400640 1 Processor -- start 2024-04-24T08:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f105fe00640 1 -- 172.21.15.88:0/1096997714 shutdown_connections 2024-04-24T08:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f6a95600640 1 -- 172.21.15.88:0/294648642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9014cb20 msgr2=0x7f6a901577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f6a95600640 1 --2- 172.21.15.88:0/294648642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9014cb20 0x7f6a901577b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009e80 tx=0x7f6a8801c9a0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f6a95600640 1 -- 172.21.15.88:0/294648642 shutdown_connections 2024-04-24T08:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f6a95600640 1 --2- 172.21.15.88:0/294648642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9014cb20 0x7f6a901577b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f6a95600640 1 -- 172.21.15.88:0/294648642 >> 172.21.15.88:0/294648642 conn(0x7f6a900b91f0 msgr2=0x7f6a900b9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f6a95600640 1 -- 172.21.15.88:0/294648642 shutdown_connections 2024-04-24T08:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f6a95600640 1 -- 172.21.15.88:0/294648642 wait complete. 2024-04-24T08:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d8e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f36d4071300 0x7f36d40b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d8e00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d40bb070 con 0x7f36d40bac90 2024-04-24T08:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d8e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d4071c10 con 0x7f36d4145cf0 2024-04-24T08:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d8e00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f36d4071ef0 con 0x7f36d4071300 2024-04-24T08:25:33.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a38400640 1 -- start start 2024-04-24T08:25:33.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f1395000640 1 Processor -- start 2024-04-24T08:25:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7760e00640 1 Processor -- start 2024-04-24T08:25:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a38400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7a300b9f40 0x7f7a3006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a38400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a300af900 con 0x7f7a30143c90 2024-04-24T08:25:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a38400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a300ae4e0 con 0x7f7a300b5780 2024-04-24T08:25:33.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a38400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f7a300aea60 con 0x7f7a300b9f40 2024-04-24T08:25:33.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d2800640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f36d4145cf0 0x7f36d4146120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:60814/0 (socket says 172.21.15.88:60814) 2024-04-24T08:25:33.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d2800640 1 -- 172.21.15.88:0/228117705 learned_addr learned my addr 172.21.15.88:0/228117705 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:33.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f105fe00640 1 -- 172.21.15.88:0/1096997714 wait complete. 2024-04-24T08:25:33.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f1395000640 1 -- start start 2024-04-24T08:25:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7760e00640 1 -- start start 2024-04-24T08:25:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f105fe00640 1 Processor -- start 2024-04-24T08:25:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a35000640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7a300b5780 0x7f7a3006e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:60822/0 (socket says 172.21.15.88:60822) 2024-04-24T08:25:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a35000640 1 -- 172.21.15.88:0/1517132668 learned_addr learned my addr 172.21.15.88:0/1517132668 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a35a00640 1 --2- 172.21.15.88:0/1517132668 >> v2:172.21.15.88:3300/0 conn(0x7f7a300b9f40 0x7f7a3006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7760e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f775c0b0040 0x7f775c1e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57071778 0 0) 0x7f36d4071c10 con 0x7f36d4145cf0 2024-04-24T08:25:33.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36b8003530 con 0x7f36d4145cf0 2024-04-24T08:25:33.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7760e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f775c148150 0x7f775c0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7760e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c1e4130 0x7f775c140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7760e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f775c06be60 con 0x7f775c148150 2024-04-24T08:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7760e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f775c06bce0 con 0x7f775c0b0040 2024-04-24T08:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7760e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f775c06bfe0 con 0x7f775c1e4130 2024-04-24T08:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f6a95600640 1 Processor -- start 2024-04-24T08:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3446337102 0 0) 0x7f36b8003530 con 0x7f36d4145cf0 2024-04-24T08:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 >> v2:172.21.15.88:3300/0 conn(0x7f36d4071300 msgr2=0x7f36d40b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 --2- 172.21.15.88:0/228117705 >> v2:172.21.15.88:3300/0 conn(0x7f36d4071300 0x7f36d40b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 >> v1:172.21.15.88:6789/0 conn(0x7f36d40bac90 legacy=0x7f36d4073830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7759e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f775c0b0040 0x7f775c1e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f775a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c1e4130 0x7f775c140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f775a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c1e4130 0x7f775c140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:43866/0 (socket says 172.21.15.88:43866) 2024-04-24T08:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f775a800640 1 -- 172.21.15.88:0/1157441574 learned_addr learned my addr 172.21.15.88:0/1157441574 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f7759400640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f775c148150 0x7f775c0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f775a800640 1 -- 172.21.15.88:0/1157441574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f775c0b0040 msgr2=0x7f775c1e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f775a800640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f775c0b0040 0x7f775c1e4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f775a800640 1 -- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f775c148150 msgr2=0x7f775c0b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f775a800640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f775c148150 0x7f775c0b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f775a800640 1 -- 172.21.15.88:0/1157441574 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c0b3f70 con 0x7f775c1e4130 2024-04-24T08:25:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f6a95600640 1 -- start start 2024-04-24T08:25:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d4073f40 con 0x7f36d4145cf0 2024-04-24T08:25:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f36cc001a00 con 0x7f36d4145cf0 2024-04-24T08:25:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 >> v1:172.21.15.142:6789/0 conn(0x7f36d4145cf0 legacy=0x7f36d4146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 --2- 172.21.15.88:0/228117705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36b80039c0 0x7f36b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 --2- 172.21.15.88:0/228117705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36b8004810 0x7f36b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 --2- 172.21.15.88:0/228117705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b80053d0 0x7f36b800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f36d4071ef0 con 0x7f36b80053d0 2024-04-24T08:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f36b800c310 con 0x7f36b80039c0 2024-04-24T08:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f36b800c510 con 0x7f36b8004810 2024-04-24T08:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f36d1e00640 1 --2- 172.21.15.88:0/228117705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36b80039c0 0x7f36b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a2fe00640 1 -- 172.21.15.88:0/1517132668 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868591304 0 0) 0x7f7a300ae4e0 con 0x7f7a300b5780 2024-04-24T08:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a2fe00640 1 -- 172.21.15.88:0/1517132668 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a18003530 con 0x7f7a300b5780 2024-04-24T08:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a2fe00640 1 -- 172.21.15.88:0/1517132668 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893835299 0 0) 0x7f7a300af900 con 0x7f7a30143c90 2024-04-24T08:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.906+0000 7f7a2fe00640 1 -- 172.21.15.88:0/1517132668 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a300ae4e0 con 0x7f7a30143c90 2024-04-24T08:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f7a35a00640 1 -- 172.21.15.88:0/1517132668 >> v1:172.21.15.142:6789/0 conn(0x7f7a300b5780 legacy=0x7f7a3006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f7a35a00640 1 -- 172.21.15.88:0/1517132668 >> v1:172.21.15.88:6789/0 conn(0x7f7a30143c90 legacy=0x7f7a3013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f7a2fe00640 1 -- 172.21.15.88:0/1517132668 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3508965012 0 0) 0x7f7a300ae4e0 con 0x7f7a30143c90 2024-04-24T08:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f7a35a00640 1 -- 172.21.15.88:0/1517132668 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a301440a0 con 0x7f7a300b9f40 2024-04-24T08:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f775a800640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c1e4130 0x7f775c140a80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f775400c740 tx=0x7f775400cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f7752000640 1 -- 172.21.15.88:0/1157441574 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754016020 con 0x7f775c1e4130 2024-04-24T08:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f7752000640 1 -- 172.21.15.88:0/1157441574 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775400ce50 con 0x7f775c1e4130 2024-04-24T08:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f7752000640 1 -- 172.21.15.88:0/1157441574 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754003980 con 0x7f775c1e4130 2024-04-24T08:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105fe00640 1 -- start start 2024-04-24T08:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1395000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139006e730 0x7f13900b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1395000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1390146530 0x7f1390146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1395000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f139014cb30 0x7f1390136cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1395000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f139015aa20 con 0x7f139014cb30 2024-04-24T08:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1395000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f139015a8a0 con 0x7f1390146530 2024-04-24T08:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1395000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f139015aba0 con 0x7f139006e730 2024-04-24T08:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f36d2800640 1 --2- 172.21.15.88:0/228117705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b80053d0 0x7f36b800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7fb662400640 1 --2- 172.21.15.88:0/488927319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb65c14fbb0 0x7fb65c06d580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb65c06ef30 tx=0x7fb65401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a915bfcb0177b73 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f7760e00640 1 -- 172.21.15.88:0/1157441574 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c1446b0 con 0x7f775c1e4130 2024-04-24T08:25:33.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f7760e00640 1 -- 172.21.15.88:0/1157441574 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c0b46e0 con 0x7f775c1e4130 2024-04-24T08:25:33.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1385400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1390146530 0x7f1390146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f138de00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139006e730 0x7f13900b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1385400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1390146530 0x7f1390146b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:55878/0 (socket says 172.21.15.88:55878) 2024-04-24T08:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1385400640 1 -- 172.21.15.88:0/3188451052 learned_addr learned my addr 172.21.15.88:0/3188451052 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a95600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a900b1ec0 0x7f6a9013d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a95600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a90146270 0x7f6a9014f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a95600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9014cb20 0x7f6a9014f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a95600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9015a8a0 con 0x7f6a900b1ec0 2024-04-24T08:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a95600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9015a720 con 0x7f6a90146270 2024-04-24T08:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a95600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9015aa20 con 0x7f6a9014cb20 2024-04-24T08:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a8f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a90146270 0x7f6a9014f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a8f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a90146270 0x7f6a9014f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:55894/0 (socket says 172.21.15.88:55894) 2024-04-24T08:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a8f400640 1 -- 172.21.15.88:0/3257057921 learned_addr learned my addr 172.21.15.88:0/3257057921 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f36d1e00640 1 -- 172.21.15.88:0/228117705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36b8004810 msgr2=0x7f36b8004c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-24T08:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f36d1e00640 1 --2- 172.21.15.88:0/228117705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36b8004810 0x7f36b8004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f36d1e00640 1 -- 172.21.15.88:0/228117705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b80053d0 msgr2=0x7f36b800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f36d1e00640 1 --2- 172.21.15.88:0/228117705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b80053d0 0x7f36b800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f36d1e00640 1 -- 172.21.15.88:0/228117705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b8003530 con 0x7f36b80039c0 2024-04-24T08:25:33.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7fab41e00640 1 --2- 172.21.15.88:0/2726203662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab4409c4d0 0x7fab4409c8b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fab300097c0 tx=0x7fab3001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4a6be256bb8b7a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10600b2890 0x7f10601e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1385400640 1 -- 172.21.15.88:0/3188451052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139006e730 msgr2=0x7f13900b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f7760e00640 1 -- 172.21.15.88:0/1157441574 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f775c0b3a40 con 0x7f775c1e4130 2024-04-24T08:25:33.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10601df990 0x7f10601dec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a8fe00640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a900b1ec0 0x7f6a9013d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10601463d0 0x7f1060146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105fe00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f10600b1000 con 0x7f10601463d0 2024-04-24T08:25:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105fe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f10600b0e80 con 0x7f10600b2890 2024-04-24T08:25:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105ea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10600b2890 0x7f10601e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f106014eb70 con 0x7f10601df990 2024-04-24T08:25:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105ea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10600b2890 0x7f10601e2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:55896/0 (socket says 172.21.15.88:55896) 2024-04-24T08:25:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105ea00640 1 -- 172.21.15.88:0/1241528361 learned_addr learned my addr 172.21.15.88:0/1241528361 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1385400640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139006e730 0x7f13900b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1385400640 1 -- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f139014cb30 msgr2=0x7f1390136cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f138e800640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f139014cb30 0x7f1390136cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1385400640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f139014cb30 0x7f1390136cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1385400640 1 -- 172.21.15.88:0/3188451052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1390139f20 con 0x7f1390146530 2024-04-24T08:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1385400640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1390146530 0x7f1390146b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f137800b440 tx=0x7f137800b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a8f400640 1 -- 172.21.15.88:0/3257057921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9014cb20 msgr2=0x7f6a9014f5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-24T08:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a8f400640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9014cb20 0x7f6a9014f5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a8f400640 1 -- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a900b1ec0 msgr2=0x7f6a9013d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a8f400640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a900b1ec0 0x7f6a9013d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a8f400640 1 -- 172.21.15.88:0/3257057921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9014e990 con 0x7f6a90146270 2024-04-24T08:25:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a8fe00640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a900b1ec0 0x7f6a9013d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7fb65be00640 1 -- 172.21.15.88:0/488927319 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6540a5550 con 0x7fb65c14fbb0 2024-04-24T08:25:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1386a00640 1 -- 172.21.15.88:0/3188451052 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378015020 con 0x7f1390146530 2024-04-24T08:25:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1386a00640 1 -- 172.21.15.88:0/3188451052 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13780118b0 con 0x7f1390146530 2024-04-24T08:25:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f1386a00640 1 -- 172.21.15.88:0/3188451052 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378011ca0 con 0x7f1390146530 2024-04-24T08:25:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f6a8f400640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a90146270 0x7f6a9014f090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00b450 tx=0x7f6a7c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7fb65be00640 1 -- 172.21.15.88:0/488927319 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6540a56f0 con 0x7fb65c14fbb0 2024-04-24T08:25:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f1395000640 1 -- 172.21.15.88:0/3188451052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1390149220 con 0x7f1390146530 2024-04-24T08:25:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f6a87e00640 1 -- 172.21.15.88:0/3257057921 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c015020 con 0x7f6a90146270 2024-04-24T08:25:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f6a87e00640 1 -- 172.21.15.88:0/3257057921 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a7c011890 con 0x7f6a90146270 2024-04-24T08:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f6a87e00640 1 -- 172.21.15.88:0/3257057921 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c011c80 con 0x7f6a90146270 2024-04-24T08:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105ea00640 1 -- 172.21.15.88:0/1241528361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10601df990 msgr2=0x7f10601dec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105ea00640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10601df990 0x7f10601dec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105ea00640 1 -- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10601463d0 msgr2=0x7f1060146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105f400640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10601463d0 0x7f1060146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105ea00640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10601463d0 0x7f1060146850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105ea00640 1 -- 172.21.15.88:0/1241528361 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1060146d90 con 0x7f10600b2890 2024-04-24T08:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.910+0000 7f105f400640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10601463d0 0x7f1060146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f105ea00640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10600b2890 0x7f10601e2bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f105000d7d0 tx=0x7f105000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f1056a00640 1 -- 172.21.15.88:0/1241528361 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105000b6c0 con 0x7f10600b2890 2024-04-24T08:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f1056a00640 1 -- 172.21.15.88:0/1241528361 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1050019070 con 0x7f10600b2890 2024-04-24T08:25:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f1056a00640 1 -- 172.21.15.88:0/1241528361 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105000baa0 con 0x7f10600b2890 2024-04-24T08:25:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fb664400640 1 -- 172.21.15.88:0/488927319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb65c14fbb0 msgr2=0x7fb65c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fb65be00640 1 -- 172.21.15.88:0/488927319 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6540a5550 con 0x7fb65c14fbb0 2024-04-24T08:25:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fb664400640 1 --2- 172.21.15.88:0/488927319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb65c14fbb0 0x7fb65c06d580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb65c06ef30 tx=0x7fb65401c890 comp rx=0 tx=0).stop 2024-04-24T08:25:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f1395000640 1 -- 172.21.15.88:0/3188451052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1390149740 con 0x7f1390146530 2024-04-24T08:25:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f6a95600640 1 -- 172.21.15.88:0/3257057921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9014ec00 con 0x7f6a90146270 2024-04-24T08:25:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fab40a00640 1 -- 172.21.15.88:0/2726203662 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab300b0070 con 0x7fab4409c4d0 2024-04-24T08:25:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fab40a00640 1 -- 172.21.15.88:0/2726203662 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab300ab600 con 0x7fab4409c4d0 2024-04-24T08:25:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fab40a00640 1 -- 172.21.15.88:0/2726203662 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab300ab9d0 con 0x7fab4409c4d0 2024-04-24T08:25:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f6a95600640 1 -- 172.21.15.88:0/3257057921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a90144340 con 0x7f6a90146270 2024-04-24T08:25:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f105fe00640 1 -- 172.21.15.88:0/1241528361 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10601e13a0 con 0x7f10600b2890 2024-04-24T08:25:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f105fe00640 1 -- 172.21.15.88:0/1241528361 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10601e0220 con 0x7f10600b2890 2024-04-24T08:25:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f6a95600640 1 -- 172.21.15.88:0/3257057921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a9004fe10 con 0x7f6a90146270 2024-04-24T08:25:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f7a35a00640 1 --2- 172.21.15.88:0/1517132668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a300b9f40 0x7f7a3006d580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7a240097c0 tx=0x7f7a24024ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd4c8ce424479ea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fab48c00640 1 -- 172.21.15.88:0/2726203662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab4409c4d0 msgr2=0x7fab4409c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fab48c00640 1 --2- 172.21.15.88:0/2726203662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab4409c4d0 0x7fab4409c8b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fab300097c0 tx=0x7fab3001c380 comp rx=0 tx=0).stop 2024-04-24T08:25:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fab48c00640 1 -- 172.21.15.88:0/2726203662 shutdown_connections 2024-04-24T08:25:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fab48c00640 1 --2- 172.21.15.88:0/2726203662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440b3eb0 0x7fab440b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fab48c00640 1 --2- 172.21.15.88:0/2726203662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab4409c4d0 0x7fab4409c8b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fab48c00640 1 -- 172.21.15.88:0/2726203662 >> 172.21.15.88:0/2726203662 conn(0x7fab440b9420 msgr2=0x7fab440b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fab48c00640 1 -- 172.21.15.88:0/2726203662 shutdown_connections 2024-04-24T08:25:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fb664400640 1 -- 172.21.15.88:0/488927319 shutdown_connections 2024-04-24T08:25:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fb664400640 1 --2- 172.21.15.88:0/488927319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb65c14fbb0 0x7fb65c06d580 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fb664400640 1 --2- 172.21.15.88:0/488927319 >> v2:172.21.15.142:3300/0 conn(0x7fb65c0af990 0x7fb65c0afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fb664400640 1 -- 172.21.15.88:0/488927319 >> 172.21.15.88:0/488927319 conn(0x7fb65c0b9420 msgr2=0x7fb65c0b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f7752000640 1 -- 172.21.15.88:0/1157441574 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7754003b20 con 0x7f775c1e4130 2024-04-24T08:25:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7752000640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f773c0683d0 0x7f773c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7752000640 1 -- 172.21.15.88:0/1157441574 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7754086640 con 0x7f775c1e4130 2024-04-24T08:25:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7759e00640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f773c0683d0 0x7f773c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7752000640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] conn(0x7f773c0705d0 0x7f773c0729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f6a87e00640 1 -- 172.21.15.88:0/3257057921 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a7c018020 con 0x7f6a90146270 2024-04-24T08:25:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f6a87e00640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6a70068380 0x7f6a7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fab48c00640 1 -- 172.21.15.88:0/2726203662 wait complete. 2024-04-24T08:25:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f36d2800640 1 -- 172.21.15.88:0/228117705 reap_dead start 2024-04-24T08:25:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f36d1e00640 1 --2- 172.21.15.88:0/228117705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36b80039c0 0x7f36b8003dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f36c4003db0 tx=0x7f36c401c320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41d2fefeff7b7cd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c40b0070 con 0x7f36b80039c0 2024-04-24T08:25:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fb664400640 1 -- 172.21.15.88:0/488927319 shutdown_connections 2024-04-24T08:25:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7fb664400640 1 -- 172.21.15.88:0/488927319 wait complete. 2024-04-24T08:25:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f7a2fe00640 1 -- 172.21.15.88:0/1517132668 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240ba070 con 0x7f7a300b9f40 2024-04-24T08:25:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f7a2fe00640 1 -- 172.21.15.88:0/1517132668 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a240ad6c0 con 0x7f7a300b9f40 2024-04-24T08:25:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.914+0000 7f7a2fe00640 1 -- 172.21.15.88:0/1517132668 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240ba070 con 0x7f7a300b9f40 2024-04-24T08:25:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7a38400640 1 -- 172.21.15.88:0/1517132668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a300b9f40 msgr2=0x7f7a3006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7a38400640 1 --2- 172.21.15.88:0/1517132668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a300b9f40 0x7f7a3006d580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7a240097c0 tx=0x7f7a24024ab0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7752000640 1 -- 172.21.15.88:0/1157441574 --> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7754010e50 con 0x7f773c0705d0 2024-04-24T08:25:33.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7752000640 1 -- 172.21.15.88:0/1157441574 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f775408d050 con 0x7f775c1e4130 2024-04-24T08:25:33.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c40ab620 con 0x7f36b80039c0 2024-04-24T08:25:33.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f6a87e00640 1 -- 172.21.15.88:0/3257057921 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6a7c086b10 con 0x7f6a90146270 2024-04-24T08:25:33.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f36d1400640 1 -- 172.21.15.88:0/228117705 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c40039b0 con 0x7f36b80039c0 2024-04-24T08:25:33.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7759400640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] conn(0x7f773c0705d0 0x7f773c0729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f1395000640 1 -- 172.21.15.88:0/3188451052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1390068b20 con 0x7f1390146530 2024-04-24T08:25:33.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f1386a00640 1 -- 172.21.15.88:0/3188451052 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1378018020 con 0x7f1390146530 2024-04-24T08:25:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f6a8fe00640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6a70068380 0x7f6a7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7fab48c00640 1 Processor -- start 2024-04-24T08:25:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f6a87e00640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] conn(0x7f6a70070580 0x7f6a700729a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7759e00640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f773c0683d0 0x7f773c06a890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f774c00b810 tx=0x7f774c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f6a87e00640 1 -- 172.21.15.88:0/3257057921 --> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a7c01deb0 con 0x7f6a70070580 2024-04-24T08:25:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f36d8e00640 1 -- 172.21.15.88:0/228117705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36b80039c0 msgr2=0x7f36b8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f36d8e00640 1 --2- 172.21.15.88:0/228117705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36b80039c0 0x7f36b8003dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f36c4003db0 tx=0x7f36c401c320 comp rx=0 tx=0).stop 2024-04-24T08:25:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f6a87e00640 1 -- 172.21.15.88:0/3257057921 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6a7c052d00 con 0x7f6a90146270 2024-04-24T08:25:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7fb664400640 1 Processor -- start 2024-04-24T08:25:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7a38400640 1 -- 172.21.15.88:0/1517132668 shutdown_connections 2024-04-24T08:25:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7a38400640 1 --2- 172.21.15.88:0/1517132668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a300b9f40 0x7f7a3006d580 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7a38400640 1 -- 172.21.15.88:0/1517132668 >> 172.21.15.88:0/1517132668 conn(0x7f7a300b9420 msgr2=0x7f7a300b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7a38400640 1 -- 172.21.15.88:0/1517132668 shutdown_connections 2024-04-24T08:25:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7a38400640 1 -- 172.21.15.88:0/1517132668 wait complete. 2024-04-24T08:25:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f7759400640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] conn(0x7f773c0705d0 0x7f773c0729f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f6a8fe00640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6a70068380 0x7f6a7006a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6a80000f70 tx=0x7f6a80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f1386a00640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f136c068450 0x7f136c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f36d8e00640 1 -- 172.21.15.88:0/228117705 shutdown_connections 2024-04-24T08:25:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f36d8e00640 1 --2- 172.21.15.88:0/228117705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36b80039c0 0x7f36b8003dc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f36d8e00640 1 -- 172.21.15.88:0/228117705 >> 172.21.15.88:0/228117705 conn(0x7f36d406d2f0 msgr2=0x7f36d40ba270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f1386a00640 1 -- 172.21.15.88:0/3188451052 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1378086b80 con 0x7f1390146530 2024-04-24T08:25:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f6a94c00640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] conn(0x7f6a70070580 0x7f6a700729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7fb664400640 1 -- start start 2024-04-24T08:25:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f36d8e00640 1 -- 172.21.15.88:0/228117705 shutdown_connections 2024-04-24T08:25:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f1386a00640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] conn(0x7f136c0706d0 0x7f136c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f1386a00640 1 -- 172.21.15.88:0/3188451052 --> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1378014e70 con 0x7f136c0706d0 2024-04-24T08:25:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f36d8e00640 1 -- 172.21.15.88:0/228117705 wait complete. 2024-04-24T08:25:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f105fe00640 1 -- 172.21.15.88:0/1241528361 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f106004fe10 con 0x7f10600b2890 2024-04-24T08:25:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f1386a00640 1 -- 172.21.15.88:0/3188451052 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f137808b2a0 con 0x7f1390146530 2024-04-24T08:25:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f1056a00640 1 -- 172.21.15.88:0/1241528361 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f105000bc40 con 0x7f10600b2890 2024-04-24T08:25:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7752000640 1 -- 172.21.15.88:0/1157441574 <== osd.0 v2:172.21.15.88:6800/3837730046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7754010e50 con 0x7f773c0705d0 2024-04-24T08:25:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7f138e800640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] conn(0x7f136c0706d0 0x7f136c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.918+0000 7fab48c00640 1 -- start start 2024-04-24T08:25:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f138de00640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f136c068450 0x7f136c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f138e800640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] conn(0x7f136c0706d0 0x7f136c072af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a38400640 1 Processor -- start 2024-04-24T08:25:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab48c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab4406d210 0x7fab440b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab48c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab4409c4d0 0x7fab440b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab48c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab440b3eb0 0x7fab441444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab48c00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fab4406e2e0 con 0x7fab440b3eb0 2024-04-24T08:25:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab48c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fab4406e160 con 0x7fab4409c4d0 2024-04-24T08:25:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab48c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fab44155490 con 0x7fab4406d210 2024-04-24T08:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a38400640 1 -- start start 2024-04-24T08:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb664400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb65c0af990 0x7fb65c072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb664400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb65c14f770 0x7fb65c073700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb664400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb65c14fbb0 0x7fb65c0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb664400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c1596b0 con 0x7fb65c0af990 2024-04-24T08:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb664400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c159530 con 0x7fb65c14f770 2024-04-24T08:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb664400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb65c159830 con 0x7fb65c14fbb0 2024-04-24T08:25:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb662400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb65c14fbb0 0x7fb65c0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f1056a00640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1040068450 0x7f104006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab41e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab4406d210 0x7fab440b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab42800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab440b3eb0 0x7fab441444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab41e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab4406d210 0x7fab440b20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:43920/0 (socket says 172.21.15.88:43920) 2024-04-24T08:25:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab41e00640 1 -- 172.21.15.88:0/1801172371 learned_addr learned my addr 172.21.15.88:0/1801172371 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab41e00640 1 -- 172.21.15.88:0/1801172371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab4409c4d0 msgr2=0x7fab440b0a80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-24T08:25:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab41e00640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab4409c4d0 0x7fab440b0a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab41e00640 1 -- 172.21.15.88:0/1801172371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab440b3eb0 msgr2=0x7fab441444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab41e00640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab440b3eb0 0x7fab441444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab41e00640 1 -- 172.21.15.88:0/1801172371 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4414da70 con 0x7fab4406d210 2024-04-24T08:25:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb662400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb65c14fbb0 0x7fb65c0714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:43918/0 (socket says 172.21.15.88:43918) 2024-04-24T08:25:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb662400640 1 -- 172.21.15.88:0/1914993098 learned_addr learned my addr 172.21.15.88:0/1914993098 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb661a00640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb65c0af990 0x7fb65c072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb661000640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb65c14f770 0x7fb65c073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb662400640 1 -- 172.21.15.88:0/1914993098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb65c14f770 msgr2=0x7fb65c073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb662400640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb65c14f770 0x7fb65c073700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a38400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a300b5780 0x7f7a30093f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a38400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a300b9f40 0x7f7a30093080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a38400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a30143c90 0x7f7a30092140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a38400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7a30152280 con 0x7f7a300b5780 2024-04-24T08:25:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a38400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7a30152100 con 0x7f7a300b9f40 2024-04-24T08:25:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a38400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7a30152400 con 0x7f7a30143c90 2024-04-24T08:25:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f1056a00640 1 -- 172.21.15.88:0/1241528361 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1050086de0 con 0x7f10600b2890 2024-04-24T08:25:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f105e000640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1040068450 0x7f104006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f1386a00640 1 -- 172.21.15.88:0/3188451052 <== osd.2 v2:172.21.15.88:6808/3194231011 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1378014e70 con 0x7f136c0706d0 2024-04-24T08:25:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f138de00640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f136c068450 0x7f136c06a910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1380000f70 tx=0x7f1380007cb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab42800640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab440b3eb0 0x7fab441444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fab41e00640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab4406d210 0x7fab440b20d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fab30019fb0 tx=0x7fab30019120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f36d8e00640 1 Processor -- start 2024-04-24T08:25:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f36d8e00640 1 -- start start 2024-04-24T08:25:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb662400640 1 -- 172.21.15.88:0/1914993098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb65c0af990 msgr2=0x7fb65c072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb662400640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb65c0af990 0x7fb65c072aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb662400640 1 -- 172.21.15.88:0/1914993098 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65c073ec0 con 0x7fb65c14fbb0 2024-04-24T08:25:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a35000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a300b9f40 0x7f7a30093080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f6a94c00640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] conn(0x7f6a70070580 0x7f6a700729a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a35a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a300b5780 0x7f7a30093f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a35a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a300b5780 0x7f7a30093f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34700/0 (socket says 172.21.15.88:34700) 2024-04-24T08:25:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a35a00640 1 -- 172.21.15.88:0/1800183719 learned_addr learned my addr 172.21.15.88:0/1800183719 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f1056a00640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] conn(0x7f10400706d0 0x7f1040072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f1056a00640 1 -- 172.21.15.88:0/1241528361 --> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10400731a0 con 0x7f10400706d0 2024-04-24T08:25:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f105e000640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1040068450 0x7f104006a910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f10600b0b70 tx=0x7f104c009e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f1056a00640 1 -- 172.21.15.88:0/1241528361 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f105008c3d0 con 0x7f10600b2890 2024-04-24T08:25:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7fb662400640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb65c14fbb0 0x7fb65c0714e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb65401af40 tx=0x7fb654019630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f105f400640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] conn(0x7f10400706d0 0x7f1040072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7fb659600640 1 -- 172.21.15.88:0/1914993098 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6540bc020 con 0x7fb65c14fbb0 2024-04-24T08:25:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7fab3a000640 1 -- 172.21.15.88:0/1801172371 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab300b8020 con 0x7fab4406d210 2024-04-24T08:25:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7fab3a000640 1 -- 172.21.15.88:0/1801172371 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab300b4630 con 0x7fab4406d210 2024-04-24T08:25:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7fab48c00640 1 -- 172.21.15.88:0/1801172371 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab440b1bb0 con 0x7fab4406d210 2024-04-24T08:25:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7fab3a000640 1 -- 172.21.15.88:0/1801172371 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab300b0040 con 0x7fab4406d210 2024-04-24T08:25:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7fab48c00640 1 -- 172.21.15.88:0/1801172371 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fab440b2610 con 0x7fab4406d210 2024-04-24T08:25:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d8e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36b80039c0 0x7f36d413cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d8e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d4142b70 0x7f36d4142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d8e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36d41e8090 0x7f36d41e8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7fb659600640 1 -- 172.21.15.88:0/1914993098 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb654004250 con 0x7fb65c14fbb0 2024-04-24T08:25:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7fb659600640 1 -- 172.21.15.88:0/1914993098 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6540a5550 con 0x7fb65c14fbb0 2024-04-24T08:25:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7fab2f400640 1 -- 172.21.15.88:0/1801172371 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab4414d880 con 0x7fab4406d210 2024-04-24T08:25:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f105f400640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] conn(0x7f10400706d0 0x7f1040072af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d2800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36d41e8090 0x7f36d41e8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d2800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36d41e8090 0x7f36d41e8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34716/0 (socket says 172.21.15.88:34716) 2024-04-24T08:25:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d2800640 1 -- 172.21.15.88:0/2591776397 learned_addr learned my addr 172.21.15.88:0/2591776397 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d8e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f36d40b6a50 con 0x7f36d41e8090 2024-04-24T08:25:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f36d40b68d0 con 0x7f36b80039c0 2024-04-24T08:25:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f36d40b6bd0 con 0x7f36d4142b70 2024-04-24T08:25:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f6a87e00640 1 -- 172.21.15.88:0/3257057921 <== osd.3 v2:172.21.15.88:6817/3914165982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6a7c01deb0 con 0x7f6a70070580 2024-04-24T08:25:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d1e00640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36b80039c0 0x7f36d413cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d2800640 1 -- 172.21.15.88:0/2591776397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d4142b70 msgr2=0x7f36d4142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d2800640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d4142b70 0x7f36d4142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d2800640 1 -- 172.21.15.88:0/2591776397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36b80039c0 msgr2=0x7f36d413cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d2800640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36b80039c0 0x7f36d413cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d2800640 1 -- 172.21.15.88:0/2591776397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d41e8a50 con 0x7f36d41e8090 2024-04-24T08:25:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f36d1e00640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36b80039c0 0x7f36d413cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7fb664400640 1 -- 172.21.15.88:0/1914993098 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65c0b32c0 con 0x7fb65c14fbb0 2024-04-24T08:25:33.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7fb664400640 1 -- 172.21.15.88:0/1914993098 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb65c1e5480 con 0x7fb65c14fbb0 2024-04-24T08:25:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.922+0000 7f7a36400640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a30143c90 0x7f7a30092140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f7a35a00640 1 -- 172.21.15.88:0/1800183719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a30143c90 msgr2=0x7f7a30092140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f7a35a00640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a30143c90 0x7f7a30092140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.926+0000 7f7a35a00640 1 -- 172.21.15.88:0/1800183719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a300b9f40 msgr2=0x7f7a30093080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7fb664400640 1 -- 172.21.15.88:0/1914993098 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb65c068b20 con 0x7fb65c14fbb0 2024-04-24T08:25:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f1056a00640 1 -- 172.21.15.88:0/1241528361 <== osd.1 v2:172.21.15.88:6816/1351635476 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10400731a0 con 0x7f10400706d0 2024-04-24T08:25:33.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f36d2800640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36d41e8090 0x7f36d41e8510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f36d4072b40 tx=0x7f36cc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f7a35a00640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a300b9f40 0x7f7a30093080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f7a35a00640 1 -- 172.21.15.88:0/1800183719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a30092680 con 0x7f7a300b5780 2024-04-24T08:25:33.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f7a35000640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a300b9f40 0x7f7a30093080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:33.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7fab3a000640 1 -- 172.21.15.88:0/1801172371 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fab300bb020 con 0x7fab4406d210 2024-04-24T08:25:33.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7fab3a000640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fab24068450 0x7fab2406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7fab3a000640 1 -- 172.21.15.88:0/1801172371 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fab30120b90 con 0x7fab4406d210 2024-04-24T08:25:33.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7fab3a000640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] conn(0x7fab24070670 0x7fab24072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7fab3a000640 1 -- 172.21.15.88:0/1801172371 --> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab300afe90 con 0x7fab24070670 2024-04-24T08:25:33.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7fab3a000640 1 -- 172.21.15.88:0/1801172371 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fab30120f80 con 0x7fab4406d210 2024-04-24T08:25:33.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f36ca000640 1 -- 172.21.15.88:0/2591776397 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc007aa0 con 0x7f36d41e8090 2024-04-24T08:25:33.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f36ca000640 1 -- 172.21.15.88:0/2591776397 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36cc00ee20 con 0x7f36d41e8090 2024-04-24T08:25:33.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f36ca000640 1 -- 172.21.15.88:0/2591776397 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc014670 con 0x7f36d41e8090 2024-04-24T08:25:33.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d41435f0 con 0x7f36d41e8090 2024-04-24T08:25:33.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d4149520 con 0x7f36d41e8090 2024-04-24T08:25:33.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f7a35a00640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a300b5780 0x7f7a30093f10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7a240226e0 tx=0x7f7a24021850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f7a2d600640 1 -- 172.21.15.88:0/1800183719 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240c2070 con 0x7f7a300b5780 2024-04-24T08:25:33.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f7a2d600640 1 -- 172.21.15.88:0/1800183719 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a240aecb0 con 0x7f7a300b5780 2024-04-24T08:25:33.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f7a2d600640 1 -- 172.21.15.88:0/1800183719 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240ba040 con 0x7f7a300b5780 2024-04-24T08:25:33.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f7a38400640 1 -- 172.21.15.88:0/1800183719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a300b25a0 con 0x7f7a300b5780 2024-04-24T08:25:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.930+0000 7f7a38400640 1 -- 172.21.15.88:0/1800183719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3009c010 con 0x7f7a300b5780 2024-04-24T08:25:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7f7a38400640 1 -- 172.21.15.88:0/1800183719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7a30140b70 con 0x7f7a300b5780 2024-04-24T08:25:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fab41400640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fab24068450 0x7fab2406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fab42800640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] conn(0x7fab24070670 0x7fab24072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fab42800640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] conn(0x7fab24070670 0x7fab24072a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fab41400640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fab24068450 0x7fab2406a910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab4414e3f0 tx=0x7fab34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f36d404fe10 con 0x7f36d41e8090 2024-04-24T08:25:33.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fab3a000640 1 -- 172.21.15.88:0/1801172371 <== osd.4 v2:172.21.15.142:6800/1785360205 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab300afe90 con 0x7fab24070670 2024-04-24T08:25:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fb659600640 1 -- 172.21.15.88:0/1914993098 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6540bf020 con 0x7fb65c14fbb0 2024-04-24T08:25:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fb659600640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb640068450 0x7fb64006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fb659600640 1 -- 172.21.15.88:0/1914993098 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb654122130 con 0x7fb65c14fbb0 2024-04-24T08:25:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fb659600640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] conn(0x7fb640070670 0x7fb640072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fb659600640 1 -- 172.21.15.88:0/1914993098 --> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6540abec0 con 0x7fb640070670 2024-04-24T08:25:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fb659600640 1 -- 172.21.15.88:0/1914993098 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb654122520 con 0x7fb65c14fbb0 2024-04-24T08:25:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7f7a2d600640 1 -- 172.21.15.88:0/1800183719 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a240c5070 con 0x7f7a300b5780 2024-04-24T08:25:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fb661a00640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb640068450 0x7fb64006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.934+0000 7fb661000640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] conn(0x7fb640070670 0x7fb640072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7f7a2d600640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7a10068400 0x7f7a1006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7f7a35000640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7a10068400 0x7f7a1006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7f7a2d600640 1 -- 172.21.15.88:0/1800183719 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7a24128e20 con 0x7f7a300b5780 2024-04-24T08:25:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7fb661a00640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb640068450 0x7fb64006a910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009a30 tx=0x7fb64c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7f7a2d600640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] conn(0x7f7a10070680 0x7f7a10072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7f7a2d600640 1 -- 172.21.15.88:0/1800183719 --> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a10073150 con 0x7f7a10070680 2024-04-24T08:25:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7f7a2d600640 1 -- 172.21.15.88:0/1800183719 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7a24129300 con 0x7f7a300b5780 2024-04-24T08:25:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7fb661000640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] conn(0x7fb640070670 0x7fb640072a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7f7a36400640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] conn(0x7f7a10070680 0x7f7a10072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7f7a35000640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7a10068400 0x7f7a1006a8c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7a3014b270 tx=0x7f7a1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7f7a36400640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] conn(0x7f7a10070680 0x7f7a10072aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7fb659600640 1 -- 172.21.15.88:0/1914993098 <== osd.6 v2:172.21.15.142:6802/3754014946 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb6540abec0 con 0x7fb640070670 2024-04-24T08:25:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.938+0000 7f36ca000640 1 -- 172.21.15.88:0/2591776397 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f36cc01b060 con 0x7f36d41e8090 2024-04-24T08:25:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.942+0000 7f36ca000640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f36b00683d0 0x7f36b006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.942+0000 7f36ca000640 1 -- 172.21.15.88:0/2591776397 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f36cc086a10 con 0x7f36d41e8090 2024-04-24T08:25:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.942+0000 7f36ca000640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] conn(0x7f36b0070650 0x7f36b0072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.942+0000 7f36ca000640 1 -- 172.21.15.88:0/2591776397 --> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36b0073120 con 0x7f36b0070650 2024-04-24T08:25:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.942+0000 7f36ca000640 1 -- 172.21.15.88:0/2591776397 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f36cc086ef0 con 0x7f36d41e8090 2024-04-24T08:25:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.942+0000 7f36d1e00640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f36b00683d0 0x7f36b006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.942+0000 7f36d1e00640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f36b00683d0 0x7f36b006a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f36c40ad000 tx=0x7f36c4003770 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.942+0000 7f36cbe00640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] conn(0x7f36b0070650 0x7f36b0072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.942+0000 7f7a2d600640 1 -- 172.21.15.88:0/1800183719 <== osd.7 v2:172.21.15.142:6816/1975061608 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7a10073150 con 0x7f7a10070680 2024-04-24T08:25:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.942+0000 7f7760e00640 1 -- 172.21.15.88:0/1157441574 --> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f775c0b4a50 con 0x7f773c0705d0 2024-04-24T08:25:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f7752000640 1 -- 172.21.15.88:0/1157441574 <== osd.0 v2:172.21.15.88:6800/3837730046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f775c0b4a50 con 0x7f773c0705d0 2024-04-24T08:25:33.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f7760e00640 1 -- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] conn(0x7f773c0705d0 msgr2=0x7f773c0729f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f7760e00640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] conn(0x7f773c0705d0 0x7f773c0729f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f36cbe00640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] conn(0x7f36b0070650 0x7f36b0072a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f7760e00640 1 -- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f773c0683d0 msgr2=0x7f773c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f7760e00640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f773c0683d0 0x7f773c06a890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f774c00b810 tx=0x7f774c008040 comp rx=0 tx=0).stop 2024-04-24T08:25:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f7760e00640 1 -- 172.21.15.88:0/1157441574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c1e4130 msgr2=0x7f775c140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f7760e00640 1 --2- 172.21.15.88:0/1157441574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f775c1e4130 0x7f775c140a80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f775400c740 tx=0x7f775400cc00 comp rx=0 tx=0).stop 2024-04-24T08:25:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f775a800640 1 -- 172.21.15.88:0/1157441574 reap_dead start 2024-04-24T08:25:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f7760e00640 1 -- 172.21.15.88:0/1157441574 shutdown_connections 2024-04-24T08:25:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f7760e00640 1 -- 172.21.15.88:0/1157441574 >> 172.21.15.88:0/1157441574 conn(0x7f775c0b7040 msgr2=0x7f775c14fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f7760e00640 1 -- 172.21.15.88:0/1157441574 shutdown_connections 2024-04-24T08:25:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f7760e00640 1 -- 172.21.15.88:0/1157441574 wait complete. 2024-04-24T08:25:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f6a95600640 1 -- 172.21.15.88:0/3257057921 --> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6a900b7750 con 0x7f6a70070580 2024-04-24T08:25:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f36ca000640 1 -- 172.21.15.88:0/2591776397 <== osd.5 v2:172.21.15.142:6824/912007372 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f36b0073120 con 0x7f36b0070650 2024-04-24T08:25:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.946+0000 7f6a87e00640 1 -- 172.21.15.88:0/3257057921 <== osd.3 v2:172.21.15.88:6817/3914165982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6a900b7750 con 0x7f6a70070580 2024-04-24T08:25:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.950+0000 7f6a95600640 1 -- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] conn(0x7f6a70070580 msgr2=0x7f6a700729a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.950+0000 7f6a95600640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] conn(0x7f6a70070580 0x7f6a700729a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.950+0000 7f6a95600640 1 -- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6a70068380 msgr2=0x7f6a7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.950+0000 7f6a95600640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6a70068380 0x7f6a7006a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6a80000f70 tx=0x7f6a80009040 comp rx=0 tx=0).stop 2024-04-24T08:25:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.950+0000 7f6a95600640 1 -- 172.21.15.88:0/3257057921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a90146270 msgr2=0x7f6a9014f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.950+0000 7f6a95600640 1 --2- 172.21.15.88:0/3257057921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a90146270 0x7f6a9014f090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00b450 tx=0x7f6a7c00b910 comp rx=0 tx=0).stop 2024-04-24T08:25:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.950+0000 7f6a94c00640 1 -- 172.21.15.88:0/3257057921 reap_dead start 2024-04-24T08:25:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.950+0000 7f6a95600640 1 -- 172.21.15.88:0/3257057921 shutdown_connections 2024-04-24T08:25:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.950+0000 7f6a95600640 1 -- 172.21.15.88:0/3257057921 >> 172.21.15.88:0/3257057921 conn(0x7f6a900b91f0 msgr2=0x7f6a900b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.950+0000 7f6a95600640 1 -- 172.21.15.88:0/3257057921 shutdown_connections 2024-04-24T08:25:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.950+0000 7f6a95600640 1 -- 172.21.15.88:0/3257057921 wait complete. 2024-04-24T08:25:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.954+0000 7f105fe00640 1 -- 172.21.15.88:0/1241528361 --> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f106014a120 con 0x7f10400706d0 2024-04-24T08:25:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.958+0000 7f1056a00640 1 -- 172.21.15.88:0/1241528361 <== osd.1 v2:172.21.15.88:6816/1351635476 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f106014a120 con 0x7f10400706d0 2024-04-24T08:25:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.958+0000 7f104be00640 1 -- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] conn(0x7f10400706d0 msgr2=0x7f1040072af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.958+0000 7f104be00640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] conn(0x7f10400706d0 0x7f1040072af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.958+0000 7f104be00640 1 -- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1040068450 msgr2=0x7f104006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.958+0000 7f104be00640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1040068450 0x7f104006a910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f10600b0b70 tx=0x7f104c009e20 comp rx=0 tx=0).stop 2024-04-24T08:25:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.958+0000 7f104be00640 1 -- 172.21.15.88:0/1241528361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10600b2890 msgr2=0x7f10601e2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.958+0000 7f104be00640 1 --2- 172.21.15.88:0/1241528361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10600b2890 0x7f10601e2bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f105000d7d0 tx=0x7f105000dc90 comp rx=0 tx=0).stop 2024-04-24T08:25:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.958+0000 7f105f400640 1 -- 172.21.15.88:0/1241528361 reap_dead start 2024-04-24T08:25:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.958+0000 7f104be00640 1 -- 172.21.15.88:0/1241528361 shutdown_connections 2024-04-24T08:25:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.958+0000 7f104be00640 1 -- 172.21.15.88:0/1241528361 >> 172.21.15.88:0/1241528361 conn(0x7f10600b91f0 msgr2=0x7f10600b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.958+0000 7f1395000640 1 -- 172.21.15.88:0/3188451052 --> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1390149a10 con 0x7f136c0706d0 2024-04-24T08:25:34.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f104be00640 1 -- 172.21.15.88:0/1241528361 shutdown_connections 2024-04-24T08:25:34.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f1386a00640 1 -- 172.21.15.88:0/3188451052 <== osd.2 v2:172.21.15.88:6808/3194231011 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1390149a10 con 0x7f136c0706d0 2024-04-24T08:25:34.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f104be00640 1 -- 172.21.15.88:0/1241528361 wait complete. 2024-04-24T08:25:34.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f1395000640 1 -- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] conn(0x7f136c0706d0 msgr2=0x7f136c072af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f1395000640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] conn(0x7f136c0706d0 0x7f136c072af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7fab2f400640 1 -- 172.21.15.88:0/1801172371 --> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fab440b19a0 con 0x7fab24070670 2024-04-24T08:25:34.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f1395000640 1 -- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f136c068450 msgr2=0x7f136c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f1395000640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f136c068450 0x7f136c06a910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1380000f70 tx=0x7f1380007cb0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f1395000640 1 -- 172.21.15.88:0/3188451052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1390146530 msgr2=0x7f1390146b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f1395000640 1 --2- 172.21.15.88:0/3188451052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1390146530 0x7f1390146b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f137800b440 tx=0x7f137800b900 comp rx=0 tx=0).stop 2024-04-24T08:25:34.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f138e800640 1 -- 172.21.15.88:0/3188451052 reap_dead start 2024-04-24T08:25:34.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f1395000640 1 -- 172.21.15.88:0/3188451052 shutdown_connections 2024-04-24T08:25:34.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f1395000640 1 -- 172.21.15.88:0/3188451052 >> 172.21.15.88:0/3188451052 conn(0x7f13900bb4d0 msgr2=0x7f1390072420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f1395000640 1 -- 172.21.15.88:0/3188451052 shutdown_connections 2024-04-24T08:25:34.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7f1395000640 1 -- 172.21.15.88:0/3188451052 wait complete. 2024-04-24T08:25:34.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7fab3a000640 1 -- 172.21.15.88:0/1801172371 <== osd.4 v2:172.21.15.142:6800/1785360205 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fab440b19a0 con 0x7fab24070670 2024-04-24T08:25:34.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7fab2f400640 1 -- 172.21.15.88:0/1801172371 >> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] conn(0x7fab24070670 msgr2=0x7fab24072a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7fab2f400640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] conn(0x7fab24070670 0x7fab24072a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7fab2f400640 1 -- 172.21.15.88:0/1801172371 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fab24068450 msgr2=0x7fab2406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7fab2f400640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fab24068450 0x7fab2406a910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab4414e3f0 tx=0x7fab34008040 comp rx=0 tx=0).stop 2024-04-24T08:25:34.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7fab2f400640 1 -- 172.21.15.88:0/1801172371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab4406d210 msgr2=0x7fab440b20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7fab2f400640 1 --2- 172.21.15.88:0/1801172371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab4406d210 0x7fab440b20d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fab30019fb0 tx=0x7fab30019120 comp rx=0 tx=0).stop 2024-04-24T08:25:34.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.962+0000 7fab42800640 1 -- 172.21.15.88:0/1801172371 reap_dead start 2024-04-24T08:25:34.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.966+0000 7fab2f400640 1 -- 172.21.15.88:0/1801172371 shutdown_connections 2024-04-24T08:25:34.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.966+0000 7fab2f400640 1 -- 172.21.15.88:0/1801172371 >> 172.21.15.88:0/1801172371 conn(0x7fab440b9420 msgr2=0x7fab440b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.966+0000 7fab2f400640 1 -- 172.21.15.88:0/1801172371 shutdown_connections 2024-04-24T08:25:34.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.966+0000 7fab2f400640 1 -- 172.21.15.88:0/1801172371 wait complete. 2024-04-24T08:25:34.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.970+0000 7fb664400640 1 -- 172.21.15.88:0/1914993098 --> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb65c0b7ac0 con 0x7fb640070670 2024-04-24T08:25:34.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.970+0000 7fb659600640 1 -- 172.21.15.88:0/1914993098 <== osd.6 v2:172.21.15.142:6802/3754014946 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb65c0b7ac0 con 0x7fb640070670 2024-04-24T08:25:34.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7fb64aa00640 1 -- 172.21.15.88:0/1914993098 >> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] conn(0x7fb640070670 msgr2=0x7fb640072a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7fb64aa00640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] conn(0x7fb640070670 0x7fb640072a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.970+0000 7f7a38400640 1 -- 172.21.15.88:0/1800183719 --> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7a30068b20 con 0x7f7a10070680 2024-04-24T08:25:34.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7f7a2d600640 1 -- 172.21.15.88:0/1800183719 <== osd.7 v2:172.21.15.142:6816/1975061608 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7a30068b20 con 0x7f7a10070680 2024-04-24T08:25:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7fb64aa00640 1 -- 172.21.15.88:0/1914993098 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb640068450 msgr2=0x7fb64006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7fb64aa00640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb640068450 0x7fb64006a910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009a30 tx=0x7fb64c008040 comp rx=0 tx=0).stop 2024-04-24T08:25:34.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7fb64aa00640 1 -- 172.21.15.88:0/1914993098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb65c14fbb0 msgr2=0x7fb65c0714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7fb64aa00640 1 --2- 172.21.15.88:0/1914993098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb65c14fbb0 0x7fb65c0714e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb65401af40 tx=0x7fb654019630 comp rx=0 tx=0).stop 2024-04-24T08:25:34.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7fb662400640 1 -- 172.21.15.88:0/1914993098 reap_dead start 2024-04-24T08:25:34.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7fb64aa00640 1 -- 172.21.15.88:0/1914993098 shutdown_connections 2024-04-24T08:25:34.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7fb64aa00640 1 -- 172.21.15.88:0/1914993098 >> 172.21.15.88:0/1914993098 conn(0x7fb65c0b9420 msgr2=0x7fb65c14e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7fb64aa00640 1 -- 172.21.15.88:0/1914993098 shutdown_connections 2024-04-24T08:25:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7f7a38400640 1 -- 172.21.15.88:0/1800183719 >> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] conn(0x7f7a10070680 msgr2=0x7f7a10072aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7f7a38400640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] conn(0x7f7a10070680 0x7f7a10072aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7fb64aa00640 1 -- 172.21.15.88:0/1914993098 wait complete. 2024-04-24T08:25:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7f7a38400640 1 -- 172.21.15.88:0/1800183719 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7a10068400 msgr2=0x7f7a1006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7f7a38400640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7a10068400 0x7f7a1006a8c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7a3014b270 tx=0x7f7a1c009040 comp rx=0 tx=0).stop 2024-04-24T08:25:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7f7a38400640 1 -- 172.21.15.88:0/1800183719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a300b5780 msgr2=0x7f7a30093f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7f7a38400640 1 --2- 172.21.15.88:0/1800183719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a300b5780 0x7f7a30093f10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7a240226e0 tx=0x7f7a24021850 comp rx=0 tx=0).stop 2024-04-24T08:25:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7f7a36400640 1 -- 172.21.15.88:0/1800183719 reap_dead start 2024-04-24T08:25:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7f7a38400640 1 -- 172.21.15.88:0/1800183719 shutdown_connections 2024-04-24T08:25:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.974+0000 7f7a38400640 1 -- 172.21.15.88:0/1800183719 >> 172.21.15.88:0/1800183719 conn(0x7f7a300b9420 msgr2=0x7f7a300b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.978+0000 7f7a38400640 1 -- 172.21.15.88:0/1800183719 shutdown_connections 2024-04-24T08:25:34.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.978+0000 7f7a38400640 1 -- 172.21.15.88:0/1800183719 wait complete. 2024-04-24T08:25:34.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.978+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 --> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f36d4149f10 con 0x7f36b0070650 2024-04-24T08:25:34.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.978+0000 7f36ca000640 1 -- 172.21.15.88:0/2591776397 <== osd.5 v2:172.21.15.142:6824/912007372 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f36bc0097e0 con 0x7f36b0070650 2024-04-24T08:25:34.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.978+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 >> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] conn(0x7f36b0070650 msgr2=0x7f36b0072a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.978+0000 7f36d8e00640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] conn(0x7f36b0070650 0x7f36b0072a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.978+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f36b00683d0 msgr2=0x7f36b006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.978+0000 7f36d8e00640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f36b00683d0 0x7f36b006a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f36c40ad000 tx=0x7f36c4003770 comp rx=0 tx=0).stop 2024-04-24T08:25:34.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.978+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36d41e8090 msgr2=0x7f36d41e8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.978+0000 7f36d8e00640 1 --2- 172.21.15.88:0/2591776397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36d41e8090 0x7f36d41e8510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f36d4072b40 tx=0x7f36cc00e530 comp rx=0 tx=0).stop 2024-04-24T08:25:34.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.978+0000 7f36d2800640 1 -- 172.21.15.88:0/2591776397 reap_dead start 2024-04-24T08:25:34.014 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-04-24T08:25:34.014 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T08:25:34.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.982+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 shutdown_connections 2024-04-24T08:25:34.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.982+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 >> 172.21.15.88:0/2591776397 conn(0x7f36d406d2f0 msgr2=0x7f36d41451e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.986+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 shutdown_connections 2024-04-24T08:25:34.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:33.986+0000 7f36d8e00640 1 -- 172.21.15.88:0/2591776397 wait complete. 2024-04-24T08:25:34.016 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-04-24T08:25:34.016 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T08:25:34.016 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-04-24T08:25:34.017 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T08:25:34.017 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-04-24T08:25:34.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T08:25:34.018 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-04-24T08:25:34.019 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T08:25:34.019 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-04-24T08:25:34.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T08:25:34.020 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2024-04-24T08:25:34.021 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T08:25:34.022 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-04-24T08:25:34.022 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T08:25:34.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.302+0000 7f09c8200640 1 Processor -- start 2024-04-24T08:25:34.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.302+0000 7f8ad0200640 1 Processor -- start 2024-04-24T08:25:34.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.302+0000 7f09c8200640 1 -- start start 2024-04-24T08:25:34.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.302+0000 7f8ad0200640 1 -- start start 2024-04-24T08:25:34.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.302+0000 7f4d2f200640 1 Processor -- start 2024-04-24T08:25:34.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.302+0000 7f4d2f200640 1 -- start start 2024-04-24T08:25:34.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.302+0000 7f09c8200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 0x7f09c006cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.302+0000 7f8ad0200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac806d470 0x7f8ac80aff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.302+0000 7f8ad0200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ac81485d0 0x7f8ac8148a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.302+0000 7f8ad0200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac80b5b00 con 0x7f8ac814b3e0 2024-04-24T08:25:34.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c5800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 0x7f09c006cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.302+0000 7f8ad0200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac80afb00 con 0x7f8ac81485d0 2024-04-24T08:25:34.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.302+0000 7f8ad0200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac80af390 con 0x7f8ac806d470 2024-04-24T08:25:34.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f8ace200640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8ac814b3e0 0x7f8ac814b850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:60836/0 (socket says 172.21.15.88:60836) 2024-04-24T08:25:34.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f8ace200640 1 -- 172.21.15.88:0/1018141091 learned_addr learned my addr 172.21.15.88:0/1018141091 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:34.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f4d2f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 0x7f4d2814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f8acd800640 1 --2- 172.21.15.88:0/1018141091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac806d470 0x7f8ac80aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f8acce00640 1 --2- 172.21.15.88:0/1018141091 >> v2:172.21.15.88:3300/0 conn(0x7f8ac81485d0 0x7f8ac8148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c5800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 0x7f09c006cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:43944/0 (socket says 172.21.15.88:43944) 2024-04-24T08:25:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c5800640 1 -- 172.21.15.88:0/3828934837 learned_addr learned my addr 172.21.15.88:0/3828934837 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c8200640 1 --2- 172.21.15.88:0/3828934837 >> v2:172.21.15.88:3300/0 conn(0x7f09c0145e20 0x7f09c01462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c8200640 1 -- 172.21.15.88:0/3828934837 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c01467f0 con 0x7f09c014c420 2024-04-24T08:25:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c8200640 1 -- 172.21.15.88:0/3828934837 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f09c006dfd0 con 0x7f09c0145e20 2024-04-24T08:25:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c8200640 1 -- 172.21.15.88:0/3828934837 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f09c006eb10 con 0x7f09c006e730 2024-04-24T08:25:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f4d2f200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d280af900 con 0x7f4d2806d580 2024-04-24T08:25:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f4d2f200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d281440e0 con 0x7f4d280b5780 2024-04-24T08:25:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f4d2f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4d280aea60 con 0x7f4d28143c90 2024-04-24T08:25:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f4d27400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4d2806d580 0x7f4d2813db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59628/0 (socket says 172.21.15.88:59628) 2024-04-24T08:25:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f4d27400640 1 -- 172.21.15.88:0/3099533930 learned_addr learned my addr 172.21.15.88:0/3099533930 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f4d2d200640 1 --2- 172.21.15.88:0/3099533930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 0x7f4d2814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c6200640 1 --2- 172.21.15.88:0/3828934837 >> v2:172.21.15.88:3300/0 conn(0x7f09c0145e20 0x7f09c01462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c5800640 1 -- 172.21.15.88:0/3828934837 >> v2:172.21.15.88:3300/0 conn(0x7f09c0145e20 msgr2=0x7f09c01462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:34.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c5800640 1 --2- 172.21.15.88:0/3828934837 >> v2:172.21.15.88:3300/0 conn(0x7f09c0145e20 0x7f09c01462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c5800640 1 -- 172.21.15.88:0/3828934837 >> v1:172.21.15.142:6789/0 conn(0x7f09c014c420 legacy=0x7f09c014c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c5800640 1 -- 172.21.15.88:0/3828934837 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c00b5380 con 0x7f09c006e730 2024-04-24T08:25:34.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f4d2d200640 1 -- 172.21.15.88:0/3099533930 >> v1:172.21.15.142:6789/0 conn(0x7f4d280b5780 legacy=0x7f4d2806e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:34.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f4d2d200640 1 -- 172.21.15.88:0/3099533930 >> v1:172.21.15.88:6789/0 conn(0x7f4d2806d580 legacy=0x7f4d2813db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f4d2d200640 1 -- 172.21.15.88:0/3099533930 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d280ae4e0 con 0x7f4d28143c90 2024-04-24T08:25:34.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7fbcc2400640 1 Processor -- start 2024-04-24T08:25:34.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f09c6200640 1 --2- 172.21.15.88:0/3828934837 >> v2:172.21.15.88:3300/0 conn(0x7f09c0145e20 0x7f09c01462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:34.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7fbcc2400640 1 -- start start 2024-04-24T08:25:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f8678a00640 1 Processor -- start 2024-04-24T08:25:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f8678a00640 1 -- start start 2024-04-24T08:25:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294620777 0 0) 0x7f8ac80b5b00 con 0x7f8ac814b3e0 2024-04-24T08:25:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab0003530 con 0x7f8ac814b3e0 2024-04-24T08:25:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 286478514 0 0) 0x7f8ab0003530 con 0x7f8ac814b3e0 2024-04-24T08:25:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac806d470 msgr2=0x7f8ac80aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f8ac7e00640 1 --2- 172.21.15.88:0/1018141091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac806d470 0x7f8ac80aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.306+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 >> v2:172.21.15.88:3300/0 conn(0x7f8ac81485d0 msgr2=0x7f8ac8148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcc2400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbcb403ab00 0x7fbcb403af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcc2400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbcb40374d0 0x7fbcb40378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcc2400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb4039320 con 0x7fbcb4038810 2024-04-24T08:25:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcc2400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb4038bf0 con 0x7fbcb403ab00 2024-04-24T08:25:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcc2400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb40395c0 con 0x7fbcb40374d0 2024-04-24T08:25:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8678a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8674155200 0x7f86740b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8678a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f867408b300 0x7f867408b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8678a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8674155640 con 0x7f86740b3cf0 2024-04-24T08:25:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8678a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f86740b40d0 con 0x7f867408b300 2024-04-24T08:25:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8678a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8674154d70 con 0x7f8674155200 2024-04-24T08:25:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcc1000640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbcb4038810 0x7fbcb40cc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:60860/0 (socket says 172.21.15.88:60860) 2024-04-24T08:25:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcc1000640 1 -- 172.21.15.88:0/2559152282 learned_addr learned my addr 172.21.15.88:0/2559152282 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcc1a00640 1 --2- 172.21.15.88:0/2559152282 >> v2:172.21.15.142:3300/0 conn(0x7fbcb40374d0 0x7fbcb40378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcbbe00640 1 --2- 172.21.15.88:0/2559152282 >> v2:172.21.15.88:3300/0 conn(0x7fbcb403ab00 0x7fbcb403af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8671e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f86740b3cf0 0x7f86740b1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:60864/0 (socket says 172.21.15.88:60864) 2024-04-24T08:25:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8671e00640 1 -- 172.21.15.88:0/867216675 learned_addr learned my addr 172.21.15.88:0/867216675 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8671400640 1 --2- 172.21.15.88:0/867216675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8674155200 0x7f86740b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8672800640 1 --2- 172.21.15.88:0/867216675 >> v2:172.21.15.142:3300/0 conn(0x7f867408b300 0x7f867408b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8ac7e00640 1 --2- 172.21.15.88:0/1018141091 >> v2:172.21.15.88:3300/0 conn(0x7f8ac81485d0 0x7f8ac8148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac806d850 con 0x7f8ac814b3e0 2024-04-24T08:25:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f8ab4001680 con 0x7f8ac814b3e0 2024-04-24T08:25:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 >> v1:172.21.15.142:6789/0 conn(0x7f8ac814b3e0 legacy=0x7f8ac814b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8ac7e00640 1 --2- 172.21.15.88:0/1018141091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac806d470 0x7f8ab00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8ac7e00640 1 --2- 172.21.15.88:0/1018141091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab0003f40 0x7f8ab0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8ac7e00640 1 --2- 172.21.15.88:0/1018141091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab0004d50 0x7f8ab00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8670a00640 1 -- 172.21.15.88:0/867216675 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4060003095 0 0) 0x7f8664001120 con 0x7f86740b3cf0 2024-04-24T08:25:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8670a00640 1 -- 172.21.15.88:0/867216675 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8658003530 con 0x7f86740b3cf0 2024-04-24T08:25:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac80af390 con 0x7f8ab0003f40 2024-04-24T08:25:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0014290 con 0x7f8ab0004d50 2024-04-24T08:25:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab0014460 con 0x7f8ac806d470 2024-04-24T08:25:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8acce00640 1 --2- 172.21.15.88:0/1018141091 >> v2:172.21.15.88:3300/0 conn(0x7f8ac81485d0 0x7f8ac8148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8acce00640 1 --2- 172.21.15.88:0/1018141091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab0003f40 0x7f8ab0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8671400640 1 -- 172.21.15.88:0/867216675 >> v2:172.21.15.142:3300/0 conn(0x7f867408b300 msgr2=0x7f867408b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8671400640 1 --2- 172.21.15.88:0/867216675 >> v2:172.21.15.142:3300/0 conn(0x7f867408b300 0x7f867408b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8671400640 1 -- 172.21.15.88:0/867216675 >> v1:172.21.15.142:6789/0 conn(0x7f86740b3cf0 legacy=0x7f86740b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8671400640 1 -- 172.21.15.88:0/867216675 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867408bcd0 con 0x7f8674155200 2024-04-24T08:25:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8ace200640 1 --2- 172.21.15.88:0/1018141091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab0004d50 0x7f8ab00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8acce00640 1 -- 172.21.15.88:0/1018141091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac806d470 msgr2=0x7f8ab00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8acce00640 1 --2- 172.21.15.88:0/1018141091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac806d470 0x7f8ab00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8acce00640 1 -- 172.21.15.88:0/1018141091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab0004d50 msgr2=0x7f8ab00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8acce00640 1 --2- 172.21.15.88:0/1018141091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab0004d50 0x7f8ab00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f8acce00640 1 -- 172.21.15.88:0/1018141091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac806d850 con 0x7f8ab0003f40 2024-04-24T08:25:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7f4d2d200640 1 --2- 172.21.15.88:0/3099533930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 0x7f4d2814f5e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4d180097f0 tx=0x7f4d1801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=635f7f6617cdb3a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcc1a00640 1 -- 172.21.15.88:0/2559152282 >> v2:172.21.15.88:3300/0 conn(0x7fbcb403ab00 msgr2=0x7fbcb403af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcc1a00640 1 --2- 172.21.15.88:0/2559152282 >> v2:172.21.15.88:3300/0 conn(0x7fbcb403ab00 0x7fbcb403af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcc1a00640 1 -- 172.21.15.88:0/2559152282 >> v1:172.21.15.142:6789/0 conn(0x7fbcb4038810 legacy=0x7fbcb40cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fbcc1a00640 1 -- 172.21.15.88:0/2559152282 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb40398a0 con 0x7fbcb40374d0 2024-04-24T08:25:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.310+0000 7fec77600640 1 Processor -- start 2024-04-24T08:25:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec77600640 1 -- start start 2024-04-24T08:25:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f4d26a00640 1 -- 172.21.15.88:0/3099533930 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d180b0070 con 0x7f4d28143c90 2024-04-24T08:25:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f4d26a00640 1 -- 172.21.15.88:0/3099533930 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d180ab600 con 0x7f4d28143c90 2024-04-24T08:25:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f4d26a00640 1 -- 172.21.15.88:0/3099533930 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d180ab9d0 con 0x7f4d28143c90 2024-04-24T08:25:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f09c5800640 1 --2- 172.21.15.88:0/3828934837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 0x7f09c006cbe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009870 tx=0x7f09b401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b3d951fe31cd8d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f4d2f200640 1 -- 172.21.15.88:0/3099533930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 msgr2=0x7f4d2814f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f4d2f200640 1 --2- 172.21.15.88:0/3099533930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 0x7f4d2814f5e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4d180097f0 tx=0x7f4d1801c380 comp rx=0 tx=0).stop 2024-04-24T08:25:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec77600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec700b5740 0x7fec70148690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec77600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec70148bd0 0x7fec700b6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec77600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec700b5b20 con 0x7fec70071f70 2024-04-24T08:25:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec77600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fec70148200 con 0x7fec700b5740 2024-04-24T08:25:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec77600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fec70144a60 con 0x7fec70148bd0 2024-04-24T08:25:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f4d2f200640 1 -- 172.21.15.88:0/3099533930 shutdown_connections 2024-04-24T08:25:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f4d2f200640 1 --2- 172.21.15.88:0/3099533930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 0x7f4d2814f5e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f4d2f200640 1 -- 172.21.15.88:0/3099533930 >> 172.21.15.88:0/3099533930 conn(0x7f4d280b9420 msgr2=0x7f4d280b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec6fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec70148bd0 0x7fec700b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f09bfe00640 1 -- 172.21.15.88:0/3828934837 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b40b1070 con 0x7f09c006e730 2024-04-24T08:25:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f09bfe00640 1 -- 172.21.15.88:0/3828934837 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b40ac620 con 0x7f09c006e730 2024-04-24T08:25:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f09bfe00640 1 -- 172.21.15.88:0/3828934837 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b40ac9f0 con 0x7f09c006e730 2024-04-24T08:25:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec6fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec70148bd0 0x7fec700b6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:43984/0 (socket says 172.21.15.88:43984) 2024-04-24T08:25:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec6fe00640 1 -- 172.21.15.88:0/1747513605 learned_addr learned my addr 172.21.15.88:0/1747513605 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fbcc1a00640 1 --2- 172.21.15.88:0/2559152282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb40374d0 0x7fbcb40378e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc06b3f0 tx=0x7fbcbc097d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=762f391153dc3508 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec74c00640 1 --2- 172.21.15.88:0/1747513605 >> v2:172.21.15.88:3300/0 conn(0x7fec700b5740 0x7fec70148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f4d2f200640 1 -- 172.21.15.88:0/3099533930 shutdown_connections 2024-04-24T08:25:34.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fbcbb400640 1 -- 172.21.15.88:0/2559152282 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc1209e0 con 0x7fbcb40374d0 2024-04-24T08:25:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fbcbb400640 1 -- 172.21.15.88:0/2559152282 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc120b80 con 0x7fbcb40374d0 2024-04-24T08:25:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fbcbb400640 1 -- 172.21.15.88:0/2559152282 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc128440 con 0x7fbcb40374d0 2024-04-24T08:25:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f9189000640 1 Processor -- start 2024-04-24T08:25:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f09c8200640 1 -- 172.21.15.88:0/3828934837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 msgr2=0x7f09c006cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f09c8200640 1 --2- 172.21.15.88:0/3828934837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 0x7f09c006cbe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009870 tx=0x7f09b401c4d0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec74c00640 1 -- 172.21.15.88:0/1747513605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec70148bd0 msgr2=0x7fec700b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec74c00640 1 --2- 172.21.15.88:0/1747513605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec70148bd0 0x7fec700b6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec74c00640 1 -- 172.21.15.88:0/1747513605 >> v1:172.21.15.88:6789/0 conn(0x7fec70071f70 legacy=0x7fec700b6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7fec74c00640 1 -- 172.21.15.88:0/1747513605 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec700b0ae0 con 0x7fec700b5740 2024-04-24T08:25:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f9189000640 1 -- start start 2024-04-24T08:25:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f09c8200640 1 -- 172.21.15.88:0/3828934837 shutdown_connections 2024-04-24T08:25:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f09c8200640 1 --2- 172.21.15.88:0/3828934837 >> v2:172.21.15.88:3300/0 conn(0x7f09c0145e20 0x7f09c01462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f09c8200640 1 --2- 172.21.15.88:0/3828934837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 0x7f09c006cbe0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f09c8200640 1 -- 172.21.15.88:0/3828934837 >> 172.21.15.88:0/3828934837 conn(0x7f09c00bb4d0 msgr2=0x7f09c00bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.314+0000 7f4d2f200640 1 -- 172.21.15.88:0/3099533930 wait complete. 2024-04-24T08:25:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7fbcc2400640 1 -- 172.21.15.88:0/2559152282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb40374d0 msgr2=0x7fbcb40378e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7fbcc2400640 1 --2- 172.21.15.88:0/2559152282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb40374d0 0x7fbcb40378e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc06b3f0 tx=0x7fbcbc097d80 comp rx=0 tx=0).stop 2024-04-24T08:25:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7fbcc2400640 1 -- 172.21.15.88:0/2559152282 shutdown_connections 2024-04-24T08:25:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7fbcc2400640 1 --2- 172.21.15.88:0/2559152282 >> v2:172.21.15.88:3300/0 conn(0x7fbcb403ab00 0x7fbcb403af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7fbcc2400640 1 --2- 172.21.15.88:0/2559152282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb40374d0 0x7fbcb40378e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7fbcc2400640 1 -- 172.21.15.88:0/2559152282 >> 172.21.15.88:0/2559152282 conn(0x7fbcb403ea40 msgr2=0x7fbcb403ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f09c8200640 1 -- 172.21.15.88:0/3828934837 shutdown_connections 2024-04-24T08:25:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f09c8200640 1 -- 172.21.15.88:0/3828934837 wait complete. 2024-04-24T08:25:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f5d9e600640 1 Processor -- start 2024-04-24T08:25:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8671400640 1 --2- 172.21.15.88:0/867216675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8674155200 0x7f86740b0cd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f866000ba60 tx=0x7f866001eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=784f6aeeeaaef9bd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7fbcc2400640 1 -- 172.21.15.88:0/2559152282 shutdown_connections 2024-04-24T08:25:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f9189000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b65f0 0x7f91840b7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8acce00640 1 --2- 172.21.15.88:0/1018141091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab0003f40 0x7f8ab0004810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009cc0 tx=0x7f8abc01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61339926804aa494 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f9189000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91840b5ca0 0x7f91841489a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f9189000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91840b7620 con 0x7f9184141a20 2024-04-24T08:25:34.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f9189000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f91840b7890 con 0x7f91840b5ca0 2024-04-24T08:25:34.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f9189000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f91840b69d0 con 0x7f91840b65f0 2024-04-24T08:25:34.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f5d9e600640 1 -- start start 2024-04-24T08:25:34.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f4d2f200640 1 Processor -- start 2024-04-24T08:25:34.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8670a00640 1 -- 172.21.15.88:0/867216675 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86600b4070 con 0x7f8674155200 2024-04-24T08:25:34.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7fbcc2400640 1 -- 172.21.15.88:0/2559152282 wait complete. 2024-04-24T08:25:34.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f4d2f200640 1 -- start start 2024-04-24T08:25:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc009860 con 0x7f8ab0003f40 2024-04-24T08:25:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc004020 con 0x7f8ab0003f40 2024-04-24T08:25:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8ac7e00640 1 -- 172.21.15.88:0/1018141091 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc009860 con 0x7f8ab0003f40 2024-04-24T08:25:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8670a00640 1 -- 172.21.15.88:0/867216675 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86600a78b0 con 0x7f8674155200 2024-04-24T08:25:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8670a00640 1 -- 172.21.15.88:0/867216675 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86600b4070 con 0x7f8674155200 2024-04-24T08:25:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f917be00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91840b5ca0 0x7f91841489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f9181e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b65f0 0x7f91840b7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f917be00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91840b5ca0 0x7f91841489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:55996/0 (socket says 172.21.15.88:55996) 2024-04-24T08:25:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f917be00640 1 -- 172.21.15.88:0/1109460666 learned_addr learned my addr 172.21.15.88:0/1109460666 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f9182800640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9184141a20 0x7f9184141e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:60874/0 (socket says 172.21.15.88:60874) 2024-04-24T08:25:34.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f09c8200640 1 Processor -- start 2024-04-24T08:25:34.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f09c8200640 1 -- start start 2024-04-24T08:25:34.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7fbcc2400640 1 Processor -- start 2024-04-24T08:25:34.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f5d9e600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 0x7f5d9814c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f4d2f200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d2806d580 0x7f4d2809a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f4d2f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d280b5780 0x7f4d281e0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f4d2f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 0x7f4d281e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8ad0200640 1 -- 172.21.15.88:0/1018141091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab0003f40 msgr2=0x7f8ab0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8ad0200640 1 --2- 172.21.15.88:0/1018141091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab0003f40 0x7f8ab0004810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009cc0 tx=0x7f8abc01cc50 comp rx=0 tx=0).stop 2024-04-24T08:25:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8ace200640 1 -- 172.21.15.88:0/1018141091 reap_dead start 2024-04-24T08:25:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8678a00640 1 -- 172.21.15.88:0/867216675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8674155200 msgr2=0x7f86740b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f8678a00640 1 --2- 172.21.15.88:0/867216675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8674155200 0x7f86740b0cd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f866000ba60 tx=0x7f866001eb20 comp rx=0 tx=0).stop 2024-04-24T08:25:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f5d9e600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d980afa70 con 0x7f5d98073400 2024-04-24T08:25:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f5d97400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5d98073400 0x7f5d98067810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59642/0 (socket says 172.21.15.88:59642) 2024-04-24T08:25:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f5d97400640 1 -- 172.21.15.88:0/1913288236 learned_addr learned my addr 172.21.15.88:0/1913288236 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f4d2f200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2813e3e0 con 0x7f4d2806d580 2024-04-24T08:25:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f4d2f200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2813e260 con 0x7f4d280b5780 2024-04-24T08:25:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7f4d2f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4d28152340 con 0x7f4d28143c90 2024-04-24T08:25:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d2d200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 0x7f4d281e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d27e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d2806d580 0x7f4d2809a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d2d200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 0x7f4d281e0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:44000/0 (socket says 172.21.15.88:44000) 2024-04-24T08:25:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d2d200640 1 -- 172.21.15.88:0/3916390682 learned_addr learned my addr 172.21.15.88:0/3916390682 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f5d9e600640 1 -- 172.21.15.88:0/1913288236 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d9814cfa0 con 0x7f5d9814cb30 2024-04-24T08:25:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f5d9e600640 1 -- 172.21.15.88:0/1913288236 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9806f940 con 0x7f5d9806f4e0 2024-04-24T08:25:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f8ad0200640 1 -- 172.21.15.88:0/1018141091 shutdown_connections 2024-04-24T08:25:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fec74c00640 1 --2- 172.21.15.88:0/1747513605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec700b5740 0x7fec70148690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0097c0 tx=0x7fec5c01e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45dabdc620587b7c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f8ad0200640 1 -- 172.21.15.88:0/1018141091 >> 172.21.15.88:0/1018141091 conn(0x7f8ac80b9420 msgr2=0x7f8ac80b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c8200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 0x7f09c014f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c8200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09c0145e20 0x7f09c0148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c8200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c014c420 0x7f09c01491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c8200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f09c0159270 con 0x7f09c0145e20 2024-04-24T08:25:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c8200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f09c00b5140 con 0x7f09c014c420 2024-04-24T08:25:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c8200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f09c01593f0 con 0x7f09c006e730 2024-04-24T08:25:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.318+0000 7fbcc2400640 1 -- start start 2024-04-24T08:25:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f5d96a00640 1 --2- 172.21.15.88:0/1913288236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 0x7f5d9814c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d27400640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d280b5780 0x7f4d281e0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c5800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 0x7f09c014f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c5800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 0x7f09c014f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:44002/0 (socket says 172.21.15.88:44002) 2024-04-24T08:25:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c5800640 1 -- 172.21.15.88:0/3176697074 learned_addr learned my addr 172.21.15.88:0/3176697074 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:34.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f8ad0200640 1 -- 172.21.15.88:0/1018141091 shutdown_connections 2024-04-24T08:25:34.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c6200640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c014c420 0x7f09c01491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c4e00640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09c0145e20 0x7f09c0148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fbcc2400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcb40374d0 0x7fbcb40c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fec6f400640 1 -- 172.21.15.88:0/1747513605 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0b2070 con 0x7fec700b5740 2024-04-24T08:25:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fec6f400640 1 -- 172.21.15.88:0/1747513605 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5c0ad600 con 0x7fec700b5740 2024-04-24T08:25:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fec6f400640 1 -- 172.21.15.88:0/1747513605 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0ad9d0 con 0x7fec700b5740 2024-04-24T08:25:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f5d96000640 1 -- 172.21.15.88:0/1913288236 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4250930057 0 0) 0x7f5d88001120 con 0x7f5d98073400 2024-04-24T08:25:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f5d96000640 1 -- 172.21.15.88:0/1913288236 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d7c003530 con 0x7f5d98073400 2024-04-24T08:25:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f5d96000640 1 -- 172.21.15.88:0/1913288236 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172407605 0 0) 0x7f5d9814cfa0 con 0x7f5d9814cb30 2024-04-24T08:25:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f5d96000640 1 -- 172.21.15.88:0/1913288236 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d88001120 con 0x7f5d9814cb30 2024-04-24T08:25:34.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d2d200640 1 -- 172.21.15.88:0/3916390682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d280b5780 msgr2=0x7f4d281e0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fbcc2400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcb4038810 0x7fbcb40c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f8ad0200640 1 -- 172.21.15.88:0/1018141091 wait complete. 2024-04-24T08:25:34.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c4e00640 1 -- 172.21.15.88:0/3176697074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 msgr2=0x7f09c014f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c4e00640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 0x7f09c014f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c4e00640 1 -- 172.21.15.88:0/3176697074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c014c420 msgr2=0x7f09c01491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c4e00640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c014c420 0x7f09c01491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c4e00640 1 -- 172.21.15.88:0/3176697074 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c01e8d30 con 0x7f09c0145e20 2024-04-24T08:25:34.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c5800640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 0x7f09c014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:34.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fbcc1000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcb40374d0 0x7fbcb40c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fbcc1000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcb40374d0 0x7fbcb40c2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:44004/0 (socket says 172.21.15.88:44004) 2024-04-24T08:25:34.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fbcc1000640 1 -- 172.21.15.88:0/1115619186 learned_addr learned my addr 172.21.15.88:0/1115619186 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:34.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f5d96a00640 1 -- 172.21.15.88:0/1913288236 >> v1:172.21.15.142:6789/0 conn(0x7f5d9814cb30 legacy=0x7f5d98156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f5d96a00640 1 -- 172.21.15.88:0/1913288236 >> v1:172.21.15.88:6789/0 conn(0x7f5d98073400 legacy=0x7f5d98067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f5d96a00640 1 -- 172.21.15.88:0/1913288236 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d980b07d0 con 0x7f5d9806f4e0 2024-04-24T08:25:34.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d2d200640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d280b5780 0x7f4d281e0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d2d200640 1 -- 172.21.15.88:0/3916390682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d2806d580 msgr2=0x7f4d2809a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d2d200640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d2806d580 0x7f4d2809a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d2d200640 1 -- 172.21.15.88:0/3916390682 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d281e40a0 con 0x7f4d28143c90 2024-04-24T08:25:34.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fbcc2400640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb403ab00 0x7fbcb4169050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c4e00640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09c0145e20 0x7f09c0148c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00c390 tx=0x7f09ac00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb40d9930 con 0x7fbcb4038810 2024-04-24T08:25:34.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f917be00640 1 -- 172.21.15.88:0/1109460666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b65f0 msgr2=0x7f91840b7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:34.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f917be00640 1 --2- 172.21.15.88:0/1109460666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b65f0 0x7f91840b7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f917be00640 1 -- 172.21.15.88:0/1109460666 >> v1:172.21.15.142:6789/0 conn(0x7f9184141a20 legacy=0x7f9184141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f917be00640 1 -- 172.21.15.88:0/1109460666 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9184147ec0 con 0x7f91840b5ca0 2024-04-24T08:25:34.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb40d97b0 con 0x7fbcb403ab00 2024-04-24T08:25:34.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d2d200640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 0x7f4d281e0bb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4d180097f0 tx=0x7f4d18019120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fbcc1a00640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb403ab00 0x7fbcb4169050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fbcbbe00640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcb4038810 0x7fbcb40c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09bd600640 1 -- 172.21.15.88:0/3176697074 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac017070 con 0x7f09c0145e20 2024-04-24T08:25:34.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09bd600640 1 -- 172.21.15.88:0/3176697074 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ac0052d0 con 0x7f09c0145e20 2024-04-24T08:25:34.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09bd600640 1 -- 172.21.15.88:0/3176697074 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac003840 con 0x7f09c0145e20 2024-04-24T08:25:34.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f8678a00640 1 -- 172.21.15.88:0/867216675 shutdown_connections 2024-04-24T08:25:34.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f8678a00640 1 --2- 172.21.15.88:0/867216675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8674155200 0x7f86740b0cd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f8678a00640 1 --2- 172.21.15.88:0/867216675 >> v2:172.21.15.142:3300/0 conn(0x7f867408b300 0x7f867408b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f8678a00640 1 -- 172.21.15.88:0/867216675 >> 172.21.15.88:0/867216675 conn(0x7f86740b92f0 msgr2=0x7f86740b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f8678a00640 1 -- 172.21.15.88:0/867216675 shutdown_connections 2024-04-24T08:25:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f8678a00640 1 -- 172.21.15.88:0/867216675 wait complete. 2024-04-24T08:25:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c8200640 1 -- 172.21.15.88:0/3176697074 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c01e9010 con 0x7f09c0145e20 2024-04-24T08:25:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f09c8200640 1 -- 172.21.15.88:0/3176697074 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c01e8850 con 0x7f09c0145e20 2024-04-24T08:25:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d1fe00640 1 -- 172.21.15.88:0/3916390682 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d180b9020 con 0x7f4d28143c90 2024-04-24T08:25:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb40d9ab0 con 0x7fbcb40374d0 2024-04-24T08:25:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d1fe00640 1 -- 172.21.15.88:0/3916390682 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d180b58b0 con 0x7f4d28143c90 2024-04-24T08:25:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d1fe00640 1 -- 172.21.15.88:0/3916390682 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d180b0040 con 0x7f4d28143c90 2024-04-24T08:25:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7f4d2f200640 1 -- 172.21.15.88:0/3916390682 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d280af170 con 0x7f4d28143c90 2024-04-24T08:25:34.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fec77600640 1 -- 172.21.15.88:0/1747513605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec700b5740 msgr2=0x7fec70148690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.322+0000 7fec77600640 1 --2- 172.21.15.88:0/1747513605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec700b5740 0x7fec70148690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0097c0 tx=0x7fec5c01e600 comp rx=0 tx=0).stop 2024-04-24T08:25:34.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fbcc1a00640 1 -- 172.21.15.88:0/1115619186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcb40374d0 msgr2=0x7fbcb40c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fec77600640 1 -- 172.21.15.88:0/1747513605 shutdown_connections 2024-04-24T08:25:34.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fbcc1a00640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcb40374d0 0x7fbcb40c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fec77600640 1 --2- 172.21.15.88:0/1747513605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec70148bd0 0x7fec700b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fec77600640 1 --2- 172.21.15.88:0/1747513605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec700b5740 0x7fec70148690 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fec77600640 1 -- 172.21.15.88:0/1747513605 >> 172.21.15.88:0/1747513605 conn(0x7fec7006dda0 msgr2=0x7fec7006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fbcc1a00640 1 -- 172.21.15.88:0/1115619186 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcb4038810 msgr2=0x7fbcb40c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fbcc1a00640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcb4038810 0x7fbcb40c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fbcc1a00640 1 -- 172.21.15.88:0/1115619186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb40c73b0 con 0x7fbcb403ab00 2024-04-24T08:25:34.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fec77600640 1 -- 172.21.15.88:0/1747513605 shutdown_connections 2024-04-24T08:25:34.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7f8ad0200640 1 Processor -- start 2024-04-24T08:25:34.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fec77600640 1 -- 172.21.15.88:0/1747513605 wait complete. 2024-04-24T08:25:34.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7f8ad0200640 1 -- start start 2024-04-24T08:25:34.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7f09c8200640 1 -- 172.21.15.88:0/3176697074 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f099c0052a0 con 0x7f09c0145e20 2024-04-24T08:25:34.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fbcc1000640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcb40374d0 0x7fbcb40c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:34.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7f4d2f200640 1 -- 172.21.15.88:0/3916390682 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d280b8600 con 0x7f4d28143c90 2024-04-24T08:25:34.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fbcc1a00640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb403ab00 0x7fbcb4169050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc06a910 tx=0x7fbcbc094bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7f8678a00640 1 Processor -- start 2024-04-24T08:25:34.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fbcb8c00640 1 -- 172.21.15.88:0/1115619186 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc134070 con 0x7fbcb403ab00 2024-04-24T08:25:34.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7f5d96a00640 1 --2- 172.21.15.88:0/1913288236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 0x7f5d9814c5f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5d840097f0 tx=0x7f5d8401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9a8c91669b35f39 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7f8678a00640 1 -- start start 2024-04-24T08:25:34.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fbcb8c00640 1 -- 172.21.15.88:0/1115619186 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc1207e0 con 0x7fbcb403ab00 2024-04-24T08:25:34.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb416c5c0 con 0x7fbcb403ab00 2024-04-24T08:25:34.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb416cb80 con 0x7fbcb403ab00 2024-04-24T08:25:34.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7fbcb8c00640 1 -- 172.21.15.88:0/1115619186 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc130600 con 0x7fbcb403ab00 2024-04-24T08:25:34.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7f5d96000640 1 -- 172.21.15.88:0/1913288236 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d840b0070 con 0x7f5d9806f4e0 2024-04-24T08:25:34.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7f5d96000640 1 -- 172.21.15.88:0/1913288236 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d840a4e50 con 0x7f5d9806f4e0 2024-04-24T08:25:34.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7f5d96000640 1 -- 172.21.15.88:0/1913288236 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d840ab820 con 0x7f5d9806f4e0 2024-04-24T08:25:34.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7f917be00640 1 --2- 172.21.15.88:0/1109460666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91840b5ca0 0x7f91841489a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f916c009870 tx=0x7f916c01c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be965f350a32b6a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.326+0000 7f09bd600640 1 -- 172.21.15.88:0/3176697074 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f09ac01a070 con 0x7f09c0145e20 2024-04-24T08:25:34.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f5d9e600640 1 -- 172.21.15.88:0/1913288236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 msgr2=0x7f5d9814c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f5d9e600640 1 --2- 172.21.15.88:0/1913288236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 0x7f5d9814c5f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5d840097f0 tx=0x7f5d8401c3e0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8ad0200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab0003f40 0x7f8ac8073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8ad0200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac809bc30 0x7f8ac81dc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8ad0200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ac81dc570 0x7f8ac81dc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8ad0200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac80ba0c0 con 0x7f8ac81dc570 2024-04-24T08:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8ad0200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac80b9f40 con 0x7f8ab0003f40 2024-04-24T08:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8ad0200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac8147e70 con 0x7f8ac809bc30 2024-04-24T08:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8acd800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab0003f40 0x7f8ac8073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8ace200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ac81dc570 0x7f8ac81dc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8acd800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab0003f40 0x7f8ac8073bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:56042/0 (socket says 172.21.15.88:56042) 2024-04-24T08:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8acd800640 1 -- 172.21.15.88:0/2753820326 learned_addr learned my addr 172.21.15.88:0/2753820326 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8acce00640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac809bc30 0x7f8ac81dc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8acd800640 1 -- 172.21.15.88:0/2753820326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac809bc30 msgr2=0x7f8ac81dc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8acd800640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac809bc30 0x7f8ac81dc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8acd800640 1 -- 172.21.15.88:0/2753820326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ac81dc570 msgr2=0x7f8ac81dc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8acd800640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ac81dc570 0x7f8ac81dc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8acd800640 1 -- 172.21.15.88:0/2753820326 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac81df5a0 con 0x7f8ab0003f40 2024-04-24T08:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8acd800640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab0003f40 0x7f8ac8073bc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0007e70 tx=0x7f8ac000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f09bd600640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f09a00683d0 0x7f09a006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f09bd600640 1 -- 172.21.15.88:0/3176697074 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f09ac085b60 con 0x7f09c0145e20 2024-04-24T08:25:34.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8678a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f867408b300 0x7f86741f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc980052a0 con 0x7fbcb403ab00 2024-04-24T08:25:34.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec77600640 1 Processor -- start 2024-04-24T08:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec77600640 1 -- start start 2024-04-24T08:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f9181400640 1 -- 172.21.15.88:0/1109460666 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c0b1070 con 0x7f91840b5ca0 2024-04-24T08:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f9181400640 1 -- 172.21.15.88:0/1109460666 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f916c0a47b0 con 0x7f91840b5ca0 2024-04-24T08:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f9181400640 1 -- 172.21.15.88:0/1109460666 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c0a4b80 con 0x7f91840b5ca0 2024-04-24T08:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f5d9e600640 1 -- 172.21.15.88:0/1913288236 shutdown_connections 2024-04-24T08:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f5d9e600640 1 --2- 172.21.15.88:0/1913288236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 0x7f5d9814c5f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f5d9e600640 1 -- 172.21.15.88:0/1913288236 >> 172.21.15.88:0/1913288236 conn(0x7f5d980b7bf0 msgr2=0x7f5d980b7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f5d9e600640 1 -- 172.21.15.88:0/1913288236 shutdown_connections 2024-04-24T08:25:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f5d9e600640 1 -- 172.21.15.88:0/1913288236 wait complete. 2024-04-24T08:25:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f4d1fe00640 1 -- 172.21.15.88:0/3916390682 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d180bc020 con 0x7f4d28143c90 2024-04-24T08:25:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f4d2f200640 1 -- 172.21.15.88:0/3916390682 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d28068b20 con 0x7f4d28143c90 2024-04-24T08:25:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f4d1fe00640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4d08068450 0x7f4d0806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f4d1fe00640 1 -- 172.21.15.88:0/3916390682 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4d18120d40 con 0x7f4d28143c90 2024-04-24T08:25:34.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8678a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86740b3cf0 0x7f867408a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8678a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8674155200 0x7f86741f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8678a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f86740b5c40 con 0x7f86740b3cf0 2024-04-24T08:25:34.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8678a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f86740b1420 con 0x7f8674155200 2024-04-24T08:25:34.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8678a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f86741597c0 con 0x7f867408b300 2024-04-24T08:25:34.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec77600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec70071f70 0x7fec70143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec77600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec700b5740 0x7fec7014e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec77600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec70148bd0 0x7fec7013f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec77600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fec700b4be0 con 0x7fec70148bd0 2024-04-24T08:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec77600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fec700b7260 con 0x7fec700b5740 2024-04-24T08:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec77600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fec700b4d60 con 0x7fec70071f70 2024-04-24T08:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8ac5600640 1 -- 172.21.15.88:0/2753820326 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0014620 con 0x7f8ab0003f40 2024-04-24T08:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8ad0200640 1 -- 172.21.15.88:0/2753820326 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac81df880 con 0x7f8ab0003f40 2024-04-24T08:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8ad0200640 1 -- 172.21.15.88:0/2753820326 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac8073160 con 0x7f8ab0003f40 2024-04-24T08:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8ac5600640 1 -- 172.21.15.88:0/2753820326 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac0019070 con 0x7f8ab0003f40 2024-04-24T08:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8ac5600640 1 -- 172.21.15.88:0/2753820326 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00149e0 con 0x7f8ab0003f40 2024-04-24T08:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f09c5800640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f09a00683d0 0x7f09a006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8671400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86740b3cf0 0x7f867408a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8671400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86740b3cf0 0x7f867408a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34822/0 (socket says 172.21.15.88:34822) 2024-04-24T08:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8671400640 1 -- 172.21.15.88:0/1797536516 learned_addr learned my addr 172.21.15.88:0/1797536516 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8671e00640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f867408b300 0x7f86741f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8671400640 1 -- 172.21.15.88:0/1797536516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f867408b300 msgr2=0x7f86741f19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8671400640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f867408b300 0x7f86741f19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8671400640 1 -- 172.21.15.88:0/1797536516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8674155200 msgr2=0x7f86741f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8671400640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8674155200 0x7f86741f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f8671400640 1 -- 172.21.15.88:0/1797536516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86741f1f90 con 0x7f86740b3cf0 2024-04-24T08:25:34.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f8671400640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86740b3cf0 0x7f867408a710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f86600b2040 tx=0x7f866001b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fbcb8c00640 1 -- 172.21.15.88:0/1115619186 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbcbc137070 con 0x7fbcb403ab00 2024-04-24T08:25:34.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7fbcb8c00640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc9c068380 0x7fbc9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7fbcb8c00640 1 -- 172.21.15.88:0/1115619186 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbcbc19c110 con 0x7fbcb403ab00 2024-04-24T08:25:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec75600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec70148bd0 0x7fec7013f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec75600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec70148bd0 0x7fec7013f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34826/0 (socket says 172.21.15.88:34826) 2024-04-24T08:25:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec75600640 1 -- 172.21.15.88:0/1175759733 learned_addr learned my addr 172.21.15.88:0/1175759733 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f9189000640 1 -- 172.21.15.88:0/1109460666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91840b5ca0 msgr2=0x7f91841489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7f9189000640 1 --2- 172.21.15.88:0/1109460666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91840b5ca0 0x7f91841489a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f916c009870 tx=0x7f916c01c010 comp rx=0 tx=0).stop 2024-04-24T08:25:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d9e600640 1 Processor -- start 2024-04-24T08:25:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d9e600640 1 -- start start 2024-04-24T08:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec75600640 1 -- 172.21.15.88:0/1175759733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec70071f70 msgr2=0x7fec70143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec75600640 1 --2- 172.21.15.88:0/1175759733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec70071f70 0x7fec70143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec75600640 1 -- 172.21.15.88:0/1175759733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec700b5740 msgr2=0x7fec7014e780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-24T08:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec75600640 1 --2- 172.21.15.88:0/1175759733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec700b5740 0x7fec7014e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.330+0000 7fec75600640 1 -- 172.21.15.88:0/1175759733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7013ea60 con 0x7fec70148bd0 2024-04-24T08:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7fec75600640 1 --2- 172.21.15.88:0/1175759733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec70148bd0 0x7fec7013f1d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c7b0 tx=0x7fec6800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f9189000640 1 -- 172.21.15.88:0/1109460666 shutdown_connections 2024-04-24T08:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f9189000640 1 --2- 172.21.15.88:0/1109460666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91840b5ca0 0x7f91841489a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f9189000640 1 --2- 172.21.15.88:0/1109460666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b65f0 0x7f91840b7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f9189000640 1 -- 172.21.15.88:0/1109460666 >> 172.21.15.88:0/1109460666 conn(0x7f91840681f0 msgr2=0x7f91840bd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f4d27e00640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4d08068450 0x7f4d0806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f9189000640 1 -- 172.21.15.88:0/1109460666 shutdown_connections 2024-04-24T08:25:34.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f9189000640 1 -- 172.21.15.88:0/1109460666 wait complete. 2024-04-24T08:25:34.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7fbcc1000640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc9c068380 0x7fbc9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d9e600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 0x7f5d9813ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d9e600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d98073400 0x7f5d981e8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d9e600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d9814cb30 0x7f5d981e8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d9e600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5d980b0420 con 0x7f5d9814cb30 2024-04-24T08:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d9e600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9815aa40 con 0x7f5d98073400 2024-04-24T08:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d9e600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5d981438a0 con 0x7f5d9806f4e0 2024-04-24T08:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d97400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 0x7f5d9813ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d97400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 0x7f5d9813ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:44034/0 (socket says 172.21.15.88:44034) 2024-04-24T08:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d97400640 1 -- 172.21.15.88:0/1033186253 learned_addr learned my addr 172.21.15.88:0/1033186253 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:34.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f4d27e00640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4d08068450 0x7f4d0806a910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d20005530 tx=0x7f4d20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d96a00640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d98073400 0x7f5d981e8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7fbcc1000640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc9c068380 0x7fbc9c06a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0000f70 tx=0x7fbcb0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d97e00640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d9814cb30 0x7f5d981e8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d97400640 1 -- 172.21.15.88:0/1033186253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d98073400 msgr2=0x7f5d981e8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d97400640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d98073400 0x7f5d981e8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d97400640 1 -- 172.21.15.88:0/1033186253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d9814cb30 msgr2=0x7f5d981e8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d97400640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d9814cb30 0x7f5d981e8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d97400640 1 -- 172.21.15.88:0/1033186253 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d98144370 con 0x7f5d9806f4e0 2024-04-24T08:25:34.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f8ad0200640 1 -- 172.21.15.88:0/2753820326 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa40052a0 con 0x7f8ab0003f40 2024-04-24T08:25:34.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f09c5800640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f09a00683d0 0x7f09a006a890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f09b4000c10 tx=0x7f09b40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f5d97400640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 0x7f5d9813ec90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800c700 tx=0x7f5d8800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f9189000640 1 Processor -- start 2024-04-24T08:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.334+0000 7f9189000640 1 -- start start 2024-04-24T08:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f9189000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91840b5ca0 0x7f918413eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f9189000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b65f0 0x7f918413c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f9189000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9184141a20 0x7f91841e0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f9189000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9184155b00 con 0x7f91840b5ca0 2024-04-24T08:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f9189000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9184155980 con 0x7f9184141a20 2024-04-24T08:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f9189000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9184155c80 con 0x7f91840b65f0 2024-04-24T08:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f9181e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91840b5ca0 0x7f918413eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f5d8f400640 1 -- 172.21.15.88:0/1033186253 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88017070 con 0x7f5d9806f4e0 2024-04-24T08:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f5d8f400640 1 -- 172.21.15.88:0/1033186253 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d88005cf0 con 0x7f5d9806f4e0 2024-04-24T08:25:34.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f5d8f400640 1 -- 172.21.15.88:0/1033186253 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88007270 con 0x7f5d9806f4e0 2024-04-24T08:25:34.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f5d9e600640 1 -- 172.21.15.88:0/1033186253 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d98148930 con 0x7f5d9806f4e0 2024-04-24T08:25:34.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f917be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b65f0 0x7f918413c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f917be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b65f0 0x7f918413c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:44048/0 (socket says 172.21.15.88:44048) 2024-04-24T08:25:34.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f917be00640 1 -- 172.21.15.88:0/2662967405 learned_addr learned my addr 172.21.15.88:0/2662967405 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:34.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f5d9e600640 1 -- 172.21.15.88:0/1033186253 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d981445e0 con 0x7f5d9806f4e0 2024-04-24T08:25:34.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f4d1fe00640 1 -- 172.21.15.88:0/3916390682 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d180f7020 con 0x7f4d28143c90 2024-04-24T08:25:34.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f9182800640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9184141a20 0x7f91841e0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f917be00640 1 -- 172.21.15.88:0/2662967405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9184141a20 msgr2=0x7f91841e0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f09bd600640 1 -- 172.21.15.88:0/3176697074 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f09ac005480 con 0x7f09c0145e20 2024-04-24T08:25:34.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7fbcb8c00640 1 -- 172.21.15.88:0/1115619186 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbcbc091cc0 con 0x7fbcb403ab00 2024-04-24T08:25:34.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7fec6cc00640 1 -- 172.21.15.88:0/1175759733 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec68004b70 con 0x7fec70148bd0 2024-04-24T08:25:34.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7fec6cc00640 1 -- 172.21.15.88:0/1175759733 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec68004d10 con 0x7fec70148bd0 2024-04-24T08:25:34.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7fec6cc00640 1 -- 172.21.15.88:0/1175759733 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec68004b70 con 0x7fec70148bd0 2024-04-24T08:25:34.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7fec77600640 1 -- 172.21.15.88:0/1175759733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7013ed40 con 0x7fec70148bd0 2024-04-24T08:25:34.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f5d9e600640 1 -- 172.21.15.88:0/1033186253 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d98069230 con 0x7f5d9806f4e0 2024-04-24T08:25:34.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7fec77600640 1 -- 172.21.15.88:0/1175759733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7013e510 con 0x7fec70148bd0 2024-04-24T08:25:34.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f917be00640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9184141a20 0x7f91841e0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f917be00640 1 -- 172.21.15.88:0/2662967405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91840b5ca0 msgr2=0x7f918413eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f917be00640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91840b5ca0 0x7f918413eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f917be00640 1 -- 172.21.15.88:0/2662967405 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918413fcd0 con 0x7f91840b65f0 2024-04-24T08:25:34.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f8ac5600640 1 -- 172.21.15.88:0/2753820326 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8ac0014b80 con 0x7f8ab0003f40 2024-04-24T08:25:34.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7fec66000640 1 -- 172.21.15.88:0/1175759733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7006ca60 con 0x7fec70148bd0 2024-04-24T08:25:34.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7f8ac5600640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8aa80683d0 0x7f8aa806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7f8ac5600640 1 -- 172.21.15.88:0/2753820326 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8ac0087db0 con 0x7f8ab0003f40 2024-04-24T08:25:34.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7f8acce00640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8aa80683d0 0x7f8aa806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7f5d8f400640 1 -- 172.21.15.88:0/1033186253 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d8801a070 con 0x7f5d9806f4e0 2024-04-24T08:25:34.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7f5d8f400640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5d780683d0 0x7f5d7806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7fec6cc00640 1 -- 172.21.15.88:0/1175759733 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec6800a850 con 0x7fec70148bd0 2024-04-24T08:25:34.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7f8acce00640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8aa80683d0 0x7f8aa806a890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0ae000 tx=0x7f8abc0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7f5d8f400640 1 -- 172.21.15.88:0/1033186253 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5d88086310 con 0x7f5d9806f4e0 2024-04-24T08:25:34.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7f5d96a00640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5d780683d0 0x7f5d7806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7fec6cc00640 1 --2- 172.21.15.88:0/1175759733 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fec500685b0 0x7fec5006aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7f5d96a00640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5d780683d0 0x7f5d7806a890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d840ad000 tx=0x7f5d84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.342+0000 7f8ac5600640 1 -- 172.21.15.88:0/2753820326 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8ac0057e90 con 0x7f8ab0003f40 2024-04-24T08:25:34.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f866a000640 1 -- 172.21.15.88:0/1797536516 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86600b4070 con 0x7f86740b3cf0 2024-04-24T08:25:34.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f866a000640 1 -- 172.21.15.88:0/1797536516 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86600bf070 con 0x7f86740b3cf0 2024-04-24T08:25:34.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f866a000640 1 -- 172.21.15.88:0/1797536516 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86600af870 con 0x7f86740b3cf0 2024-04-24T08:25:34.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f5d8f400640 1 -- 172.21.15.88:0/1033186253 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5d980afa70 con 0x7f5d9806f4e0 2024-04-24T08:25:34.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f8678a00640 1 -- 172.21.15.88:0/1797536516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86741f2270 con 0x7f86740b3cf0 2024-04-24T08:25:34.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.338+0000 7f9181e00640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91840b5ca0 0x7f918413eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:34.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f8678a00640 1 -- 172.21.15.88:0/1797536516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867408ac50 con 0x7f86740b3cf0 2024-04-24T08:25:34.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7fec6cc00640 1 -- 172.21.15.88:0/1175759733 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fec68086820 con 0x7fec70148bd0 2024-04-24T08:25:34.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7fec74c00640 1 --2- 172.21.15.88:0/1175759733 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fec500685b0 0x7fec5006aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f9182800640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9184141a20 0x7f91841e0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f917be00640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b65f0 0x7f918413c6d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f916c0af040 tx=0x7f916c019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f917a000640 1 -- 172.21.15.88:0/2662967405 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c0b1070 con 0x7f91840b65f0 2024-04-24T08:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f917a000640 1 -- 172.21.15.88:0/2662967405 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f916c0ac890 con 0x7f91840b65f0 2024-04-24T08:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f917a000640 1 -- 172.21.15.88:0/2662967405 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c0acc80 con 0x7f91840b65f0 2024-04-24T08:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f9189000640 1 -- 172.21.15.88:0/2662967405 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f918414c1e0 con 0x7f91840b65f0 2024-04-24T08:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7f9189000640 1 -- 172.21.15.88:0/2662967405 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f918413e380 con 0x7f91840b65f0 2024-04-24T08:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.346+0000 7fec74c00640 1 --2- 172.21.15.88:0/1175759733 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fec500685b0 0x7fec5006aa70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0af000 tx=0x7fec5c004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.350+0000 7f8678a00640 1 -- 172.21.15.88:0/1797536516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f864c0052a0 con 0x7f86740b3cf0 2024-04-24T08:25:34.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.350+0000 7f917a000640 1 -- 172.21.15.88:0/2662967405 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f916c0be060 con 0x7f91840b65f0 2024-04-24T08:25:34.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.350+0000 7f9173400640 1 -- 172.21.15.88:0/2662967405 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9184069230 con 0x7f91840b65f0 2024-04-24T08:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.350+0000 7f917a000640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9160068480 0x7f916006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.350+0000 7f917a000640 1 -- 172.21.15.88:0/2662967405 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f916c11f880 con 0x7f91840b65f0 2024-04-24T08:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.350+0000 7f9181e00640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9160068480 0x7f916006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.350+0000 7f9181e00640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9160068480 0x7f916006a940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9174007520 tx=0x7f917400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.354+0000 7fec6cc00640 1 -- 172.21.15.88:0/1175759733 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fec68020070 con 0x7fec70148bd0 2024-04-24T08:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.354+0000 7f917a000640 1 -- 172.21.15.88:0/2662967405 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f916c016090 con 0x7f91840b65f0 2024-04-24T08:25:34.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.362+0000 7f866a000640 1 -- 172.21.15.88:0/1797536516 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86600afa10 con 0x7f86740b3cf0 2024-04-24T08:25:34.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.362+0000 7f866a000640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8654068450 0x7f865406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:34.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.362+0000 7f866a000640 1 -- 172.21.15.88:0/1797536516 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8660122010 con 0x7f86740b3cf0 2024-04-24T08:25:34.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.362+0000 7f866a000640 1 -- 172.21.15.88:0/1797536516 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f86600187a0 con 0x7f86740b3cf0 2024-04-24T08:25:34.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.374+0000 7f8671e00640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8654068450 0x7f865406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:34.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.374+0000 7f8671e00640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8654068450 0x7f865406a910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86640012c0 tx=0x7f8664007b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:34.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.678+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbc98005590 con 0x7fbcb403ab00 2024-04-24T08:25:34.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.678+0000 7fbcb8c00640 1 -- 172.21.15.88:0/1115619186 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbcbc16c070 con 0x7fbcb403ab00 2024-04-24T08:25:34.679 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-04-24T08:25:34.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7f09c8200640 1 -- 172.21.15.88:0/3176697074 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f099c005590 con 0x7f09c0145e20 2024-04-24T08:25:34.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc9c068380 msgr2=0x7fbc9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7fbcc2400640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc9c068380 0x7fbc9c06a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0000f70 tx=0x7fbcb0009040 comp rx=0 tx=0).stop 2024-04-24T08:25:34.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7f09bd600640 1 -- 172.21.15.88:0/3176697074 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f09ac055b40 con 0x7f09c0145e20 2024-04-24T08:25:34.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb403ab00 msgr2=0x7fbcb4169050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.684 INFO:teuthology.orchestra.run.smithi088.stdout:55834574852 2024-04-24T08:25:34.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7fbcc2400640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb403ab00 0x7fbcb4169050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc06a910 tx=0x7fbcbc094bc0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 shutdown_connections 2024-04-24T08:25:34.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7fbcc2400640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc9c068380 0x7fbc9c06a840 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0000f70 tx=0x7fbcb0009040 comp rx=0 tx=0).stop 2024-04-24T08:25:34.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7fbcc2400640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb403ab00 0x7fbcb4169050 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7fbcc2400640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcb4038810 0x7fbcb40c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7fbcc2400640 1 --2- 172.21.15.88:0/1115619186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcb40374d0 0x7fbcb40c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 >> 172.21.15.88:0/1115619186 conn(0x7fbcb403ea40 msgr2=0x7fbcb40bee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7f4d2f200640 1 -- 172.21.15.88:0/3916390682 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4d28070730 con 0x7f4d28143c90 2024-04-24T08:25:34.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 shutdown_connections 2024-04-24T08:25:34.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.682+0000 7fbcc2400640 1 -- 172.21.15.88:0/1115619186 wait complete. 2024-04-24T08:25:34.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.686+0000 7f4d1fe00640 1 -- 172.21.15.88:0/3916390682 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4d18016090 con 0x7f4d28143c90 2024-04-24T08:25:34.687 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-04-24T08:25:34.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.686+0000 7f8ad0200640 1 -- 172.21.15.88:0/2753820326 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8aa4005860 con 0x7f8ab0003f40 2024-04-24T08:25:34.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.686+0000 7f09c8200640 1 -- 172.21.15.88:0/3176697074 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f09a00683d0 msgr2=0x7f09a006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.686+0000 7f09c8200640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f09a00683d0 0x7f09a006a890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f09b4000c10 tx=0x7f09b40a7000 comp rx=0 tx=0).stop 2024-04-24T08:25:34.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.686+0000 7f09c8200640 1 -- 172.21.15.88:0/3176697074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09c0145e20 msgr2=0x7f09c0148c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.686+0000 7f09c8200640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09c0145e20 0x7f09c0148c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00c390 tx=0x7f09ac00c850 comp rx=0 tx=0).stop 2024-04-24T08:25:34.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.686+0000 7f8ac5600640 1 -- 172.21.15.88:0/2753820326 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ac005c190 con 0x7f8ab0003f40 2024-04-24T08:25:34.688 INFO:teuthology.orchestra.run.smithi088.stdout:55834574852 2024-04-24T08:25:34.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.686+0000 7f5d9e600640 1 -- 172.21.15.88:0/1033186253 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5d98072740 con 0x7f5d9806f4e0 2024-04-24T08:25:34.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.686+0000 7f5d8f400640 1 -- 172.21.15.88:0/1033186253 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5d880562f0 con 0x7f5d9806f4e0 2024-04-24T08:25:34.689 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-04-24T08:25:34.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7fec66000640 1 -- 172.21.15.88:0/1175759733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fec7013e7d0 con 0x7fec70148bd0 2024-04-24T08:25:34.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f4d2f200640 1 -- 172.21.15.88:0/3916390682 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4d08068450 msgr2=0x7f4d0806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f4d2f200640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4d08068450 0x7f4d0806a910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d20005530 tx=0x7f4d20009040 comp rx=0 tx=0).stop 2024-04-24T08:25:34.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f4d2f200640 1 -- 172.21.15.88:0/3916390682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 msgr2=0x7f4d281e0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f4d2f200640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 0x7f4d281e0bb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4d180097f0 tx=0x7f4d18019120 comp rx=0 tx=0).stop 2024-04-24T08:25:34.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f4d2f200640 1 -- 172.21.15.88:0/3916390682 shutdown_connections 2024-04-24T08:25:34.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f4d2f200640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4d08068450 0x7f4d0806a910 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f4d2f200640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d28143c90 0x7f4d281e0bb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f4d2f200640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d280b5780 0x7f4d281e0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f4d2f200640 1 --2- 172.21.15.88:0/3916390682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d2806d580 0x7f4d2809a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f4d2f200640 1 -- 172.21.15.88:0/3916390682 >> 172.21.15.88:0/3916390682 conn(0x7f4d280b9420 msgr2=0x7f4d28142da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f4d2f200640 1 -- 172.21.15.88:0/3916390682 shutdown_connections 2024-04-24T08:25:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f4d2f200640 1 -- 172.21.15.88:0/3916390682 wait complete. 2024-04-24T08:25:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f09c8200640 1 -- 172.21.15.88:0/3176697074 shutdown_connections 2024-04-24T08:25:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f09c8200640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f09a00683d0 0x7f09a006a890 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f09c8200640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c014c420 0x7f09c01491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f09c8200640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09c0145e20 0x7f09c0148c90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f09c8200640 1 --2- 172.21.15.88:0/3176697074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c006e730 0x7f09c014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f09c8200640 1 -- 172.21.15.88:0/3176697074 >> 172.21.15.88:0/3176697074 conn(0x7f09c00bb4d0 msgr2=0x7f09c014a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f09c8200640 1 -- 172.21.15.88:0/3176697074 shutdown_connections 2024-04-24T08:25:34.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f09c8200640 1 -- 172.21.15.88:0/3176697074 wait complete. 2024-04-24T08:25:34.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7fec6cc00640 1 -- 172.21.15.88:0/1175759733 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fec68056e70 con 0x7fec70148bd0 2024-04-24T08:25:34.693 INFO:teuthology.orchestra.run.smithi088.stdout:55834574852 2024-04-24T08:25:34.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f8ad0200640 1 -- 172.21.15.88:0/2753820326 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8aa80683d0 msgr2=0x7f8aa806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f8ad0200640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8aa80683d0 0x7f8aa806a890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0ae000 tx=0x7f8abc0046d0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f8ad0200640 1 -- 172.21.15.88:0/2753820326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab0003f40 msgr2=0x7f8ac8073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f8ad0200640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab0003f40 0x7f8ac8073bc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0007e70 tx=0x7f8ac000e4b0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f8ad0200640 1 -- 172.21.15.88:0/2753820326 shutdown_connections 2024-04-24T08:25:34.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f8ad0200640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8aa80683d0 0x7f8aa806a890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f8ad0200640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ac81dc570 0x7f8ac81dc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f8ad0200640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac809bc30 0x7f8ac81dc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f8ad0200640 1 --2- 172.21.15.88:0/2753820326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab0003f40 0x7f8ac8073bc0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0007e70 tx=0x7f8ac000e4b0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.690+0000 7f8ad0200640 1 -- 172.21.15.88:0/2753820326 >> 172.21.15.88:0/2753820326 conn(0x7f8ac80b9420 msgr2=0x7f8ac80b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f8ad0200640 1 -- 172.21.15.88:0/2753820326 shutdown_connections 2024-04-24T08:25:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f8ad0200640 1 -- 172.21.15.88:0/2753820326 wait complete. 2024-04-24T08:25:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7fec66000640 1 -- 172.21.15.88:0/1175759733 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fec500685b0 msgr2=0x7fec5006aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7fec66000640 1 --2- 172.21.15.88:0/1175759733 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fec500685b0 0x7fec5006aa70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0af000 tx=0x7fec5c004740 comp rx=0 tx=0).stop 2024-04-24T08:25:34.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f5d9e600640 1 -- 172.21.15.88:0/1033186253 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5d780683d0 msgr2=0x7f5d7806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f5d9e600640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5d780683d0 0x7f5d7806a890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d840ad000 tx=0x7f5d84008040 comp rx=0 tx=0).stop 2024-04-24T08:25:34.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f5d9e600640 1 -- 172.21.15.88:0/1033186253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 msgr2=0x7f5d9813ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f5d9e600640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 0x7f5d9813ec90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800c700 tx=0x7f5d8800cbc0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f5d9e600640 1 -- 172.21.15.88:0/1033186253 shutdown_connections 2024-04-24T08:25:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7fec66000640 1 -- 172.21.15.88:0/1175759733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec70148bd0 msgr2=0x7fec7013f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7fec66000640 1 --2- 172.21.15.88:0/1175759733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec70148bd0 0x7fec7013f1d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c7b0 tx=0x7fec6800cc70 comp rx=0 tx=0).stop 2024-04-24T08:25:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f5d9e600640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5d780683d0 0x7f5d7806a890 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d840ad000 tx=0x7f5d84008040 comp rx=0 tx=0).stop 2024-04-24T08:25:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f5d9e600640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d9814cb30 0x7f5d981e8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f5d9e600640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d98073400 0x7f5d981e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f5d9e600640 1 --2- 172.21.15.88:0/1033186253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d9806f4e0 0x7f5d9813ec90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f5d9e600640 1 -- 172.21.15.88:0/1033186253 >> 172.21.15.88:0/1033186253 conn(0x7f5d980b7bf0 msgr2=0x7f5d980b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7fec66000640 1 -- 172.21.15.88:0/1175759733 shutdown_connections 2024-04-24T08:25:34.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7fec66000640 1 --2- 172.21.15.88:0/1175759733 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fec500685b0 0x7fec5006aa70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7fec66000640 1 --2- 172.21.15.88:0/1175759733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec70148bd0 0x7fec7013f1d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7fec66000640 1 --2- 172.21.15.88:0/1175759733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec700b5740 0x7fec7014e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7fec66000640 1 --2- 172.21.15.88:0/1175759733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec70071f70 0x7fec70143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7fec66000640 1 -- 172.21.15.88:0/1175759733 >> 172.21.15.88:0/1175759733 conn(0x7fec7006dda0 msgr2=0x7fec70145dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7fec66000640 1 -- 172.21.15.88:0/1175759733 shutdown_connections 2024-04-24T08:25:34.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7fec66000640 1 -- 172.21.15.88:0/1175759733 wait complete. 2024-04-24T08:25:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.694+0000 7f5d9e600640 1 -- 172.21.15.88:0/1033186253 shutdown_connections 2024-04-24T08:25:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.698+0000 7f5d9e600640 1 -- 172.21.15.88:0/1033186253 wait complete. 2024-04-24T08:25:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.698+0000 7f9173400640 1 -- 172.21.15.88:0/2662967405 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f918413ff40 con 0x7f91840b65f0 2024-04-24T08:25:34.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.702+0000 7f917a000640 1 -- 172.21.15.88:0/2662967405 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f916c0efe30 con 0x7f91840b65f0 2024-04-24T08:25:34.706 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-04-24T08:25:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f8678a00640 1 -- 172.21.15.88:0/1797536516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f864c005860 con 0x7f86740b3cf0 2024-04-24T08:25:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f9173400640 1 -- 172.21.15.88:0/2662967405 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9160068480 msgr2=0x7f916006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f9173400640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9160068480 0x7f916006a940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9174007520 tx=0x7f917400b040 comp rx=0 tx=0).stop 2024-04-24T08:25:34.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f9173400640 1 -- 172.21.15.88:0/2662967405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b65f0 msgr2=0x7f918413c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f9173400640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b65f0 0x7f918413c6d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f916c0af040 tx=0x7f916c019100 comp rx=0 tx=0).stop 2024-04-24T08:25:34.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f9173400640 1 -- 172.21.15.88:0/2662967405 shutdown_connections 2024-04-24T08:25:34.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f9173400640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9160068480 0x7f916006a940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f9173400640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9184141a20 0x7f91841e0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f9173400640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b65f0 0x7f918413c6d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f9173400640 1 --2- 172.21.15.88:0/2662967405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91840b5ca0 0x7f918413eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f866a000640 1 -- 172.21.15.88:0/1797536516 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f86600f2670 con 0x7f86740b3cf0 2024-04-24T08:25:34.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f9173400640 1 -- 172.21.15.88:0/2662967405 >> 172.21.15.88:0/2662967405 conn(0x7f91840681f0 msgr2=0x7f91840ba6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.709 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-04-24T08:25:34.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f9173400640 1 -- 172.21.15.88:0/2662967405 shutdown_connections 2024-04-24T08:25:34.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.706+0000 7f9173400640 1 -- 172.21.15.88:0/2662967405 wait complete. 2024-04-24T08:25:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.710+0000 7f8678a00640 1 -- 172.21.15.88:0/1797536516 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8654068450 msgr2=0x7f865406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.710+0000 7f8678a00640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8654068450 0x7f865406a910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86640012c0 tx=0x7f8664007b80 comp rx=0 tx=0).stop 2024-04-24T08:25:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.710+0000 7f8678a00640 1 -- 172.21.15.88:0/1797536516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86740b3cf0 msgr2=0x7f867408a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.710+0000 7f8678a00640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86740b3cf0 0x7f867408a710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f86600b2040 tx=0x7f866001b8c0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.710+0000 7f8678a00640 1 -- 172.21.15.88:0/1797536516 shutdown_connections 2024-04-24T08:25:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.710+0000 7f8678a00640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8654068450 0x7f865406a910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.710+0000 7f8678a00640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8674155200 0x7f86741f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.710+0000 7f8678a00640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86740b3cf0 0x7f867408a710 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.710+0000 7f8678a00640 1 --2- 172.21.15.88:0/1797536516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f867408b300 0x7f86741f19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.710+0000 7f8678a00640 1 -- 172.21.15.88:0/1797536516 >> 172.21.15.88:0/1797536516 conn(0x7f86740b92f0 msgr2=0x7f86740b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.714+0000 7f8678a00640 1 -- 172.21.15.88:0/1797536516 shutdown_connections 2024-04-24T08:25:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:34.714+0000 7f8678a00640 1 -- 172.21.15.88:0/1797536516 wait complete. 2024-04-24T08:25:34.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-04-24T08:25:34.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-04-24T08:25:34.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-04-24T08:25:34.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-04-24T08:25:34.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-04-24T08:25:34.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-04-24T08:25:34.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-24T08:25:34.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-04-24T08:25:35.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T08:25:35.741 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T08:25:35.741 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T08:25:35.742 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T08:25:35.744 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T08:25:35.744 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T08:25:35.747 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T08:25:35.752 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T08:25:35.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a0e200640 1 Processor -- start 2024-04-24T08:25:35.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a0e200640 1 -- start start 2024-04-24T08:25:35.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a0e200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7a080b1ed0 0x7f7a0814c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:35.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a0e200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08145ad0 0x7f7a08145f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:35.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a0e200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a0814be10 con 0x7f7a080b3cf0 2024-04-24T08:25:35.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a0e200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f7a0814cdd0 con 0x7f7a080b1ed0 2024-04-24T08:25:35.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a0e200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7a0814c400 con 0x7f7a08145ad0 2024-04-24T08:25:35.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a07400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7a080b1ed0 0x7f7a0814c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:35.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a07400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7a080b1ed0 0x7f7a0814c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34858/0 (socket says 172.21.15.88:34858) 2024-04-24T08:25:35.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a07400640 1 -- 172.21.15.88:0/3077391817 learned_addr learned my addr 172.21.15.88:0/3077391817 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:35.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a07400640 1 -- 172.21.15.88:0/3077391817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08145ad0 msgr2=0x7f7a08145f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-24T08:25:35.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a07400640 1 --2- 172.21.15.88:0/3077391817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08145ad0 0x7f7a08145f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:35.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a07400640 1 -- 172.21.15.88:0/3077391817 >> v1:172.21.15.142:6789/0 conn(0x7f7a080b3cf0 legacy=0x7f7a080b0cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T08:25:35.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.938+0000 7f7a07400640 1 -- 172.21.15.88:0/3077391817 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a080b13e0 con 0x7f7a080b1ed0 2024-04-24T08:25:35.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.946+0000 7f7a07400640 1 --2- 172.21.15.88:0/3077391817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a080b1ed0 0x7f7a0814c890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009e50 tx=0x7f7a0001c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88a81615841673b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:35.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.946+0000 7f7a06000640 1 -- 172.21.15.88:0/3077391817 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a000a5510 con 0x7f7a080b1ed0 2024-04-24T08:25:35.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.946+0000 7f7a06000640 1 -- 172.21.15.88:0/3077391817 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a000a56b0 con 0x7f7a080b1ed0 2024-04-24T08:25:35.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.946+0000 7f7a0e200640 1 -- 172.21.15.88:0/3077391817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a080b1ed0 msgr2=0x7f7a0814c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:35.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.946+0000 7f7a0e200640 1 --2- 172.21.15.88:0/3077391817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a080b1ed0 0x7f7a0814c890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009e50 tx=0x7f7a0001c7a0 comp rx=0 tx=0).stop 2024-04-24T08:25:35.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.946+0000 7f7a0e200640 1 -- 172.21.15.88:0/3077391817 shutdown_connections 2024-04-24T08:25:35.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.946+0000 7f7a0e200640 1 --2- 172.21.15.88:0/3077391817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08145ad0 0x7f7a08145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:35.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.946+0000 7f7a0e200640 1 --2- 172.21.15.88:0/3077391817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a080b1ed0 0x7f7a0814c890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:35.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.946+0000 7f7a0e200640 1 -- 172.21.15.88:0/3077391817 >> 172.21.15.88:0/3077391817 conn(0x7f7a080b92f0 msgr2=0x7f7a080b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:35.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.946+0000 7f7a0e200640 1 -- 172.21.15.88:0/3077391817 shutdown_connections 2024-04-24T08:25:35.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.946+0000 7f7a0e200640 1 -- 172.21.15.88:0/3077391817 wait complete. 2024-04-24T08:25:35.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.950+0000 7f7a0e200640 1 Processor -- start 2024-04-24T08:25:35.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.950+0000 7f7a0e200640 1 -- start start 2024-04-24T08:25:35.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a0e200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a080b1ed0 0x7f7a0814f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:35.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a0e200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a080b3cf0 0x7f7a08145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:35.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a0e200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08145ad0 0x7f7a08142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:35.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a0e200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7a080b5bb0 con 0x7f7a080b3cf0 2024-04-24T08:25:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a0e200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7a080b5a30 con 0x7f7a080b1ed0 2024-04-24T08:25:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a07400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a080b1ed0 0x7f7a0814f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a07400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a080b1ed0 0x7f7a0814f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:56078/0 (socket says 172.21.15.88:56078) 2024-04-24T08:25:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a07400640 1 -- 172.21.15.88:0/4017967250 learned_addr learned my addr 172.21.15.88:0/4017967250 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a06a00640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a080b3cf0 0x7f7a08145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a07e00640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08145ad0 0x7f7a08142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a0e200640 1 -- 172.21.15.88:0/4017967250 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7a08158fb0 con 0x7f7a08145ad0 2024-04-24T08:25:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a06a00640 1 -- 172.21.15.88:0/4017967250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08145ad0 msgr2=0x7f7a08142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a06a00640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08145ad0 0x7f7a08142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:35.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a06a00640 1 -- 172.21.15.88:0/4017967250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a080b1ed0 msgr2=0x7f7a0814f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a06a00640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a080b1ed0 0x7f7a0814f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a06a00640 1 -- 172.21.15.88:0/4017967250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a08144cc0 con 0x7f7a080b3cf0 2024-04-24T08:25:35.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.954+0000 7f7a06a00640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a080b3cf0 0x7f7a08145170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f79f800b3c0 tx=0x7f79f800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:35.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.958+0000 7f79ff400640 1 -- 172.21.15.88:0/4017967250 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f8011830 con 0x7f7a080b3cf0 2024-04-24T08:25:35.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.958+0000 7f7a0e200640 1 -- 172.21.15.88:0/4017967250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a081432b0 con 0x7f7a080b3cf0 2024-04-24T08:25:35.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.958+0000 7f79ff400640 1 -- 172.21.15.88:0/4017967250 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f8016070 con 0x7f7a080b3cf0 2024-04-24T08:25:35.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.958+0000 7f79ff400640 1 -- 172.21.15.88:0/4017967250 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f8011830 con 0x7f7a080b3cf0 2024-04-24T08:25:35.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.958+0000 7f7a0e200640 1 -- 172.21.15.88:0/4017967250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a08143550 con 0x7f7a080b3cf0 2024-04-24T08:25:35.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.962+0000 7f7a0e200640 1 -- 172.21.15.88:0/4017967250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a0804fe10 con 0x7f7a080b3cf0 2024-04-24T08:25:35.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.962+0000 7f79ff400640 1 -- 172.21.15.88:0/4017967250 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f79f8011a10 con 0x7f7a080b3cf0 2024-04-24T08:25:35.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.962+0000 7f79ff400640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f79e4068580 0x7f79e406aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:35.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.966+0000 7f7a07400640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f79e4068580 0x7f79e406aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:35.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.966+0000 7f79ff400640 1 -- 172.21.15.88:0/4017967250 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f79f8054150 con 0x7f7a080b3cf0 2024-04-24T08:25:35.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.970+0000 7f7a07400640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f79e4068580 0x7f79e406aa40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7a00000f90 tx=0x7f7a000a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:35.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:35.974+0000 7f79ff400640 1 -- 172.21.15.88:0/4017967250 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f79f80560b0 con 0x7f7a080b3cf0 2024-04-24T08:25:36.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.026+0000 7fb57ca00640 1 Processor -- start 2024-04-24T08:25:36.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.026+0000 7fb57ca00640 1 -- start start 2024-04-24T08:25:36.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb57ca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5780b2370 0x7fb5780b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb57ca00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb5780b1880 0x7fb5780b5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb575e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5780b2370 0x7fb5780b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb57ca00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5780b0a40 con 0x7fb578073aa0 2024-04-24T08:25:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb575400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb578073aa0 0x7fb578147100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:60892/0 (socket says 172.21.15.88:60892) 2024-04-24T08:25:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb575400640 1 -- 172.21.15.88:0/2492321291 learned_addr learned my addr 172.21.15.88:0/2492321291 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb57ca00640 1 -- 172.21.15.88:0/2492321291 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb5780b0d20 con 0x7fb5780b1880 2024-04-24T08:25:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb575e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5780b2370 0x7fb5780b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:44062/0 (socket says 172.21.15.88:44062) 2024-04-24T08:25:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb57ca00640 1 -- 172.21.15.88:0/2492321291 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb5780b1000 con 0x7fb5780b2370 2024-04-24T08:25:36.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb576800640 1 --2- 172.21.15.88:0/2492321291 >> v2:172.21.15.88:3300/0 conn(0x7fb5780b1880 0x7fb5780b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb576800640 1 -- 172.21.15.88:0/2492321291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5780b2370 msgr2=0x7fb5780b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:36.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb576800640 1 --2- 172.21.15.88:0/2492321291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5780b2370 0x7fb5780b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb576800640 1 -- 172.21.15.88:0/2492321291 >> v1:172.21.15.142:6789/0 conn(0x7fb578073aa0 legacy=0x7fb578147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.030+0000 7fb576800640 1 -- 172.21.15.88:0/2492321291 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5780b2750 con 0x7fb5780b1880 2024-04-24T08:25:36.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7fbbb2600640 1 Processor -- start 2024-04-24T08:25:36.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7fbbb2600640 1 -- start start 2024-04-24T08:25:36.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7f5bd4e00640 1 Processor -- start 2024-04-24T08:25:36.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7f5bd4e00640 1 -- start start 2024-04-24T08:25:36.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7fbbb2600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbac06d580 0x7fbbac0b5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7fbbb2600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbbac143c90 0x7fbbac13db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7fbbb2600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbac0af900 con 0x7fbbac0b9f40 2024-04-24T08:25:36.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7fbbb2600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fbbac0aea60 con 0x7fbbac143c90 2024-04-24T08:25:36.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7fbbb2600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac1440e0 con 0x7fbbac06d580 2024-04-24T08:25:36.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7f2b4b000640 1 Processor -- start 2024-04-24T08:25:36.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7f5bd4e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5bd00ba010 0x7f5bd00b7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7fbbab400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbbac0b9f40 0x7fbbac06e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:60902/0 (socket says 172.21.15.88:60902) 2024-04-24T08:25:36.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7fbbab400640 1 -- 172.21.15.88:0/824643087 learned_addr learned my addr 172.21.15.88:0/824643087 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:36.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7f5bd4e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd00b85c0 0x7f5bd01441f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7f5bd4e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd00ba3f0 con 0x7f5bd0144730 2024-04-24T08:25:36.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7f5bd4e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5bd006e7d0 con 0x7f5bd00ba010 2024-04-24T08:25:36.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7f5bd4e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5bd00b4280 con 0x7f5bd00b85c0 2024-04-24T08:25:36.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7fbbaaa00640 1 --2- 172.21.15.88:0/824643087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbac06d580 0x7fbbac0b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7fbbabe00640 1 --2- 172.21.15.88:0/824643087 >> v2:172.21.15.142:3300/0 conn(0x7fbbac143c90 0x7fbbac13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.034+0000 7f5bcf400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5bd00ba010 0x7f5bd00b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5bcf400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5bd00ba010 0x7f5bd00b7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:56106/0 (socket says 172.21.15.88:56106) 2024-04-24T08:25:36.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5bcfe00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5bd0144730 0x7f5bd00b6100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:60910/0 (socket says 172.21.15.88:60910) 2024-04-24T08:25:36.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5bcf400640 1 -- 172.21.15.88:0/2342946772 learned_addr learned my addr 172.21.15.88:0/2342946772 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:36.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a84a00640 1 Processor -- start 2024-04-24T08:25:36.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f2b4b000640 1 -- start start 2024-04-24T08:25:36.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5bcea00640 1 --2- 172.21.15.88:0/2342946772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd00b85c0 0x7f5bd01441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5d18c00640 1 Processor -- start 2024-04-24T08:25:36.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7fbbabe00640 1 -- 172.21.15.88:0/824643087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbac06d580 msgr2=0x7fbbac0b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:36.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7fbbabe00640 1 --2- 172.21.15.88:0/824643087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbac06d580 0x7fbbac0b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7fbbabe00640 1 -- 172.21.15.88:0/824643087 >> v1:172.21.15.142:6789/0 conn(0x7fbbac0b9f40 legacy=0x7fbbac06e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7fbbabe00640 1 -- 172.21.15.88:0/824643087 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac0ae4e0 con 0x7fbbac143c90 2024-04-24T08:25:36.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5bcf400640 1 -- 172.21.15.88:0/2342946772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd00b85c0 msgr2=0x7f5bd01441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:36.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a84a00640 1 -- start start 2024-04-24T08:25:36.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5d18c00640 1 -- start start 2024-04-24T08:25:36.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5bcf400640 1 --2- 172.21.15.88:0/2342946772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd00b85c0 0x7f5bd01441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5bcf400640 1 -- 172.21.15.88:0/2342946772 >> v1:172.21.15.142:6789/0 conn(0x7f5bd0144730 legacy=0x7f5bd00b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5bce000640 1 -- 172.21.15.88:0/2342946772 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1433087777 0 0) 0x7f5bd00ba3f0 con 0x7f5bd0144730 2024-04-24T08:25:36.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a84a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a800b91c0 0x7f6a8014c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a84a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a800b49f0 0x7f6a80145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a84a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a801461f0 0x7f6a8014f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5bcf400640 1 -- 172.21.15.88:0/2342946772 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd006dea0 con 0x7f5bd00ba010 2024-04-24T08:25:36.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5bcea00640 1 --2- 172.21.15.88:0/2342946772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd00b85c0 0x7f5bd01441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:36.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a84a00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6a8014c550 con 0x7f6a801461f0 2024-04-24T08:25:36.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a84a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6a800b4e30 con 0x7f6a800b91c0 2024-04-24T08:25:36.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a84a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6a800b95a0 con 0x7f6a800b49f0 2024-04-24T08:25:36.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5d18c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1409c730 0x7f5d14148130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5d18c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d1406d920 0x7f5d1414f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5d18c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d140b4fd0 con 0x7f5d140b5760 2024-04-24T08:25:36.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5d18c00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f5d140b52d0 con 0x7f5d1406d920 2024-04-24T08:25:36.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5d18c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5d140aeb30 con 0x7f5d1409c730 2024-04-24T08:25:36.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a7fe00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a801461f0 0x7f6a8014f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a7f400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a800b91c0 0x7f6a8014c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a7fe00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a801461f0 0x7f6a8014f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34892/0 (socket says 172.21.15.88:34892) 2024-04-24T08:25:36.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a7fe00640 1 -- 172.21.15.88:0/3098262950 learned_addr learned my addr 172.21.15.88:0/3098262950 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:36.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f2b4b000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b440b9e10 0x7f2b44143c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f2b4b000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2b440b1490 0x7f2b44073a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f2b4b000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b440b0cd0 con 0x7f2b440b24d0 2024-04-24T08:25:36.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f2b4b000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2b4413e3f0 con 0x7f2b440b9e10 2024-04-24T08:25:36.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f2b4b000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2b44144140 con 0x7f2b440b1490 2024-04-24T08:25:36.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f2b4a600640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2b440b24d0 0x7f2b440729a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:60924/0 (socket says 172.21.15.88:60924) 2024-04-24T08:25:36.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f2b4a600640 1 -- 172.21.15.88:0/922781115 learned_addr learned my addr 172.21.15.88:0/922781115 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:36.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5d11e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1409c730 0x7f5d14148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f6a7ea00640 1 --2- 172.21.15.88:0/3098262950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a800b49f0 0x7f6a80145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f2b49200640 1 --2- 172.21.15.88:0/922781115 >> v2:172.21.15.142:3300/0 conn(0x7f2b440b1490 0x7f2b44073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f2b49c00640 1 --2- 172.21.15.88:0/922781115 >> v2:172.21.15.88:3300/0 conn(0x7f2b440b9e10 0x7f2b44143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7f5d11e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1409c730 0x7f5d14148130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:44102/0 (socket says 172.21.15.88:44102) 2024-04-24T08:25:36.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f5d11e00640 1 -- 172.21.15.88:0/1651481974 learned_addr learned my addr 172.21.15.88:0/1651481974 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:36.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.038+0000 7fb576800640 1 --2- 172.21.15.88:0/2492321291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5780b1880 0x7fb5780b5600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb57000c2e0 tx=0x7fb5700210e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63076057669b629 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f5d11e00640 1 -- 172.21.15.88:0/1651481974 >> v2:172.21.15.88:3300/0 conn(0x7f5d1406d920 msgr2=0x7f5d1414f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:36.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f5d11e00640 1 --2- 172.21.15.88:0/1651481974 >> v2:172.21.15.88:3300/0 conn(0x7f5d1406d920 0x7f5d1414f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f5d11e00640 1 -- 172.21.15.88:0/1651481974 >> v1:172.21.15.142:6789/0 conn(0x7f5d140b5760 legacy=0x7f5d1406d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f5d11e00640 1 -- 172.21.15.88:0/1651481974 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d14148670 con 0x7f5d1409c730 2024-04-24T08:25:36.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f2b49c00640 1 -- 172.21.15.88:0/922781115 >> v2:172.21.15.142:3300/0 conn(0x7f2b440b1490 msgr2=0x7f2b44073a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:36.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f2b49c00640 1 --2- 172.21.15.88:0/922781115 >> v2:172.21.15.142:3300/0 conn(0x7f2b440b1490 0x7f2b44073a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f2b49c00640 1 -- 172.21.15.88:0/922781115 >> v1:172.21.15.142:6789/0 conn(0x7f2b440b24d0 legacy=0x7f2b440729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:36.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f3247800640 1 Processor -- start 2024-04-24T08:25:36.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f2b49c00640 1 -- 172.21.15.88:0/922781115 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b440b21e0 con 0x7f2b440b9e10 2024-04-24T08:25:36.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f2b49200640 1 --2- 172.21.15.88:0/922781115 >> v2:172.21.15.142:3300/0 conn(0x7f2b440b1490 0x7f2b44073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:36.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f6a7fe00640 1 -- 172.21.15.88:0/3098262950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a800b49f0 msgr2=0x7f6a80145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:36.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f6a7fe00640 1 --2- 172.21.15.88:0/3098262950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a800b49f0 0x7f6a80145cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f6a7fe00640 1 -- 172.21.15.88:0/3098262950 >> v2:172.21.15.142:3300/0 conn(0x7f6a800b91c0 msgr2=0x7f6a8014c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:36.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f6a7fe00640 1 --2- 172.21.15.88:0/3098262950 >> v2:172.21.15.142:3300/0 conn(0x7f6a800b91c0 0x7f6a8014c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f6a7fe00640 1 -- 172.21.15.88:0/3098262950 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a800bae80 con 0x7f6a801461f0 2024-04-24T08:25:36.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f6a7ea00640 1 --2- 172.21.15.88:0/3098262950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a800b49f0 0x7f6a80145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:36.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7fb574a00640 1 -- 172.21.15.88:0/2492321291 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700b5070 con 0x7fb5780b1880 2024-04-24T08:25:36.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f3247800640 1 -- start start 2024-04-24T08:25:36.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7fb574a00640 1 -- 172.21.15.88:0/2492321291 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb57000a2d0 con 0x7fb5780b1880 2024-04-24T08:25:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7fb574a00640 1 -- 172.21.15.88:0/2492321291 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57000a6a0 con 0x7fb5780b1880 2024-04-24T08:25:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7fb57ca00640 1 -- 172.21.15.88:0/2492321291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5780b1880 msgr2=0x7fb5780b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7fb57ca00640 1 --2- 172.21.15.88:0/2492321291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5780b1880 0x7fb5780b5600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb57000c2e0 tx=0x7fb5700210e0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f3247800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32400aaf50 0x7f32400b7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f3247800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3240149170 0x7f3240149a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7fb57ca00640 1 -- 172.21.15.88:0/2492321291 shutdown_connections 2024-04-24T08:25:36.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7fb57ca00640 1 --2- 172.21.15.88:0/2492321291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5780b1880 0x7fb5780b5600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7fb57ca00640 1 --2- 172.21.15.88:0/2492321291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5780b2370 0x7fb5780b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7fb57ca00640 1 -- 172.21.15.88:0/2492321291 >> 172.21.15.88:0/2492321291 conn(0x7fb5780b92f0 msgr2=0x7fb5780b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f3247800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32400aa560 con 0x7f32400ab330 2024-04-24T08:25:36.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f3247800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f32400b62a0 con 0x7f3240149170 2024-04-24T08:25:36.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f3247800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f32400b7850 con 0x7f32400aaf50 2024-04-24T08:25:36.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7fb57ca00640 1 -- 172.21.15.88:0/2492321291 shutdown_connections 2024-04-24T08:25:36.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7fb57ca00640 1 -- 172.21.15.88:0/2492321291 wait complete. 2024-04-24T08:25:36.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f3244e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32400aaf50 0x7f32400b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f3244e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32400aaf50 0x7f32400b7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:44110/0 (socket says 172.21.15.88:44110) 2024-04-24T08:25:36.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f3244e00640 1 -- 172.21.15.88:0/3498974375 learned_addr learned my addr 172.21.15.88:0/3498974375 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:36.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7f323fe00640 1 --2- 172.21.15.88:0/3498974375 >> v2:172.21.15.142:3300/0 conn(0x7f3240149170 0x7f3240149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.042+0000 7fbbabe00640 1 --2- 172.21.15.88:0/824643087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbac143c90 0x7fbbac13db50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009d90 tx=0x7fbba401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd8b312e046990e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5bcf400640 1 --2- 172.21.15.88:0/2342946772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd00ba010 0x7f5bd00b7780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8009e50 tx=0x7f5bc801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcfd14f322e47e87 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f3244e00640 1 -- 172.21.15.88:0/3498974375 >> v2:172.21.15.142:3300/0 conn(0x7f3240149170 msgr2=0x7f3240149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:36.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f3244e00640 1 --2- 172.21.15.88:0/3498974375 >> v2:172.21.15.142:3300/0 conn(0x7f3240149170 0x7f3240149a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f3244e00640 1 -- 172.21.15.88:0/3498974375 >> v1:172.21.15.142:6789/0 conn(0x7f32400ab330 legacy=0x7f3240145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:36.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f3244e00640 1 -- 172.21.15.88:0/3498974375 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32400b6540 con 0x7f32400aaf50 2024-04-24T08:25:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5d11e00640 1 --2- 172.21.15.88:0/1651481974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1409c730 0x7f5d14148130 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009870 tx=0x7f5d0401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a77d51e58b3894d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7fbbaa000640 1 -- 172.21.15.88:0/824643087 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba40b1070 con 0x7fbbac143c90 2024-04-24T08:25:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7fbbaa000640 1 -- 172.21.15.88:0/824643087 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba40a49c0 con 0x7fbbac143c90 2024-04-24T08:25:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7fbbaa000640 1 -- 172.21.15.88:0/824643087 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba40a4d90 con 0x7fbbac143c90 2024-04-24T08:25:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5bce000640 1 -- 172.21.15.88:0/2342946772 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc80a5720 con 0x7f5bd00ba010 2024-04-24T08:25:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5bce000640 1 -- 172.21.15.88:0/2342946772 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc80a58c0 con 0x7f5bd00ba010 2024-04-24T08:25:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5bce000640 1 -- 172.21.15.88:0/2342946772 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc80a5c90 con 0x7f5bd00ba010 2024-04-24T08:25:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5d10a00640 1 -- 172.21.15.88:0/1651481974 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d040aa650 con 0x7f5d1409c730 2024-04-24T08:25:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5d10a00640 1 -- 172.21.15.88:0/1651481974 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d040af070 con 0x7f5d1409c730 2024-04-24T08:25:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5d10a00640 1 -- 172.21.15.88:0/1651481974 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d040aaa10 con 0x7f5d1409c730 2024-04-24T08:25:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7fbbb2600640 1 -- 172.21.15.88:0/824643087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbac143c90 msgr2=0x7fbbac13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7fbbb2600640 1 --2- 172.21.15.88:0/824643087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbac143c90 0x7fbbac13db50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009d90 tx=0x7fbba401c470 comp rx=0 tx=0).stop 2024-04-24T08:25:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2342946772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd00ba010 msgr2=0x7f5bd00b7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f6a7fe00640 1 --2- 172.21.15.88:0/3098262950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a801461f0 0x7f6a8014f480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6a8006eb20 tx=0x7f6a7801c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb37ca66eaeaf87 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5bd4e00640 1 --2- 172.21.15.88:0/2342946772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd00ba010 0x7f5bd00b7780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8009e50 tx=0x7f5bc801c970 comp rx=0 tx=0).stop 2024-04-24T08:25:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5d18c00640 1 -- 172.21.15.88:0/1651481974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1409c730 msgr2=0x7f5d14148130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5d18c00640 1 --2- 172.21.15.88:0/1651481974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1409c730 0x7f5d14148130 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009870 tx=0x7f5d0401c4d0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2342946772 shutdown_connections 2024-04-24T08:25:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5bd4e00640 1 --2- 172.21.15.88:0/2342946772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd00b85c0 0x7f5bd01441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7fb57ca00640 1 Processor -- start 2024-04-24T08:25:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5bd4e00640 1 --2- 172.21.15.88:0/2342946772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd00ba010 0x7f5bd00b7780 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2342946772 >> 172.21.15.88:0/2342946772 conn(0x7f5bd009ee70 msgr2=0x7f5bd00b96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f6a7e000640 1 -- 172.21.15.88:0/3098262950 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a780b0070 con 0x7f6a801461f0 2024-04-24T08:25:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5d18c00640 1 -- 172.21.15.88:0/1651481974 shutdown_connections 2024-04-24T08:25:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5d18c00640 1 --2- 172.21.15.88:0/1651481974 >> v2:172.21.15.88:3300/0 conn(0x7f5d1406d920 0x7f5d1414f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5d18c00640 1 --2- 172.21.15.88:0/1651481974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1409c730 0x7f5d14148130 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5d18c00640 1 -- 172.21.15.88:0/1651481974 >> 172.21.15.88:0/1651481974 conn(0x7f5d140b9420 msgr2=0x7f5d140b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f6a7e000640 1 -- 172.21.15.88:0/3098262950 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a780ab600 con 0x7f6a801461f0 2024-04-24T08:25:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f6a7e000640 1 -- 172.21.15.88:0/3098262950 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a780ab9d0 con 0x7f6a801461f0 2024-04-24T08:25:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7fb57ca00640 1 -- start start 2024-04-24T08:25:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2342946772 shutdown_connections 2024-04-24T08:25:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2342946772 wait complete. 2024-04-24T08:25:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7fbbb2600640 1 -- 172.21.15.88:0/824643087 shutdown_connections 2024-04-24T08:25:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7fbbb2600640 1 --2- 172.21.15.88:0/824643087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbac06d580 0x7fbbac0b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7fbbb2600640 1 --2- 172.21.15.88:0/824643087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbac143c90 0x7fbbac13db50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7fbbb2600640 1 -- 172.21.15.88:0/824643087 >> 172.21.15.88:0/824643087 conn(0x7fbbac0b9420 msgr2=0x7fbbac0b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f6a84a00640 1 -- 172.21.15.88:0/3098262950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a801461f0 msgr2=0x7f6a8014f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f6a84a00640 1 --2- 172.21.15.88:0/3098262950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a801461f0 0x7f6a8014f480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6a8006eb20 tx=0x7f6a7801c280 comp rx=0 tx=0).stop 2024-04-24T08:25:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f2b49c00640 1 --2- 172.21.15.88:0/922781115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b440b9e10 0x7f2b44143c00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2b4406fe90 tx=0x7f2b3801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ae79e32cd11bd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f6a84a00640 1 -- 172.21.15.88:0/3098262950 shutdown_connections 2024-04-24T08:25:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f6a84a00640 1 --2- 172.21.15.88:0/3098262950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a801461f0 0x7f6a8014f480 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f6a84a00640 1 --2- 172.21.15.88:0/3098262950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a800b49f0 0x7f6a80145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f6a84a00640 1 --2- 172.21.15.88:0/3098262950 >> v2:172.21.15.142:3300/0 conn(0x7f6a800b91c0 0x7f6a8014c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f6a84a00640 1 -- 172.21.15.88:0/3098262950 >> 172.21.15.88:0/3098262950 conn(0x7f6a800b9ff0 msgr2=0x7f6a800ba400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb57ca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb578073aa0 0x7fb5781d70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb57ca00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5780b1880 0x7fb5781e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb57ca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5780b2370 0x7fb5781e5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb57ca00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb578150f90 con 0x7fb5780b1880 2024-04-24T08:25:36.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb57ca00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb578150e10 con 0x7fb5780b2370 2024-04-24T08:25:36.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb57ca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb578151110 con 0x7fb578073aa0 2024-04-24T08:25:36.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bd4e00640 1 Processor -- start 2024-04-24T08:25:36.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fbbb2600640 1 -- 172.21.15.88:0/824643087 shutdown_connections 2024-04-24T08:25:36.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5d18c00640 1 -- 172.21.15.88:0/1651481974 shutdown_connections 2024-04-24T08:25:36.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.046+0000 7f5d18c00640 1 -- 172.21.15.88:0/1651481974 wait complete. 2024-04-24T08:25:36.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f2b43e00640 1 -- 172.21.15.88:0/922781115 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b380b0070 con 0x7f2b440b9e10 2024-04-24T08:25:36.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fbbb2600640 1 -- 172.21.15.88:0/824643087 wait complete. 2024-04-24T08:25:36.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bd4e00640 1 -- start start 2024-04-24T08:25:36.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb575400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5780b1880 0x7fb5781e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb575400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5780b1880 0x7fb5781e4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34908/0 (socket says 172.21.15.88:34908) 2024-04-24T08:25:36.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb575400640 1 -- 172.21.15.88:0/3839566813 learned_addr learned my addr 172.21.15.88:0/3839566813 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:36.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb575e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb578073aa0 0x7fb5781d70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb576800640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5780b2370 0x7fb5781e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d18c00640 1 Processor -- start 2024-04-24T08:25:36.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d18c00640 1 -- start start 2024-04-24T08:25:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f6a84a00640 1 -- 172.21.15.88:0/3098262950 shutdown_connections 2024-04-24T08:25:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f6a84a00640 1 -- 172.21.15.88:0/3098262950 wait complete. 2024-04-24T08:25:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f3244e00640 1 --2- 172.21.15.88:0/3498974375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32400aaf50 0x7f32400b7310 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3238009e50 tx=0x7f323801c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0bad95f5343d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bd4e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd00ba010 0x7f5bd009dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bd4e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd0144730 0x7f5bd0147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f323f400640 1 -- 172.21.15.88:0/3498974375 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32380a55e0 con 0x7f32400aaf50 2024-04-24T08:25:36.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bd4e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd01e7c50 0x7f5bd01e80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bd4e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd0144b80 con 0x7f5bd0144730 2024-04-24T08:25:36.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bd4e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd00b9190 con 0x7f5bd00ba010 2024-04-24T08:25:36.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bd4e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5bd00b4710 con 0x7f5bd01e7c50 2024-04-24T08:25:36.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f323f400640 1 -- 172.21.15.88:0/3498974375 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32380a5780 con 0x7f32400aaf50 2024-04-24T08:25:36.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f323f400640 1 -- 172.21.15.88:0/3498974375 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32380a5b50 con 0x7f32400aaf50 2024-04-24T08:25:36.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb575e00640 1 -- 172.21.15.88:0/3839566813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5780b2370 msgr2=0x7fb5781e5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb575e00640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5780b2370 0x7fb5781e5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb575e00640 1 -- 172.21.15.88:0/3839566813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5780b1880 msgr2=0x7fb5781e4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb575e00640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5780b1880 0x7fb5781e4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb575e00640 1 -- 172.21.15.88:0/3839566813 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb578143d00 con 0x7fb578073aa0 2024-04-24T08:25:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bcf400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd00ba010 0x7f5bd009dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bcf400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd00ba010 0x7f5bd009dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:56146/0 (socket says 172.21.15.88:56146) 2024-04-24T08:25:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bcf400640 1 -- 172.21.15.88:0/2595863678 learned_addr learned my addr 172.21.15.88:0/2595863678 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bcfe00640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd01e7c50 0x7f5bd01e80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d18c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1406d920 0x7f5d14072760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d18c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d1409c730 0x7f5d141ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bcf400640 1 -- 172.21.15.88:0/2595863678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd01e7c50 msgr2=0x7f5bd01e80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bcf400640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd01e7c50 0x7f5bd01e80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bcf400640 1 -- 172.21.15.88:0/2595863678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd0144730 msgr2=0x7f5bd0147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bcf400640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd0144730 0x7f5bd0147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bcf400640 1 -- 172.21.15.88:0/2595863678 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd01414f0 con 0x7f5bd00ba010 2024-04-24T08:25:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f2b43e00640 1 -- 172.21.15.88:0/922781115 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b380ab400 con 0x7f2b440b9e10 2024-04-24T08:25:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f2b43e00640 1 -- 172.21.15.88:0/922781115 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b380b0070 con 0x7f2b440b9e10 2024-04-24T08:25:36.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d11e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1406d920 0x7f5d14072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d11e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1406d920 0x7f5d14072760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:44144/0 (socket says 172.21.15.88:44144) 2024-04-24T08:25:36.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb576800640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5780b2370 0x7fb5781e5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:36.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fbbb2600640 1 Processor -- start 2024-04-24T08:25:36.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d11e00640 1 -- 172.21.15.88:0/3189195716 learned_addr learned my addr 172.21.15.88:0/3189195716 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:36.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d18c00640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d140b5760 0x7f5d141ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d11400640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d1409c730 0x7f5d141ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1409dbe0 con 0x7f5d140b5760 2024-04-24T08:25:36.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1409d3d0 con 0x7f5d1409c730 2024-04-24T08:25:36.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1409dd60 con 0x7f5d1406d920 2024-04-24T08:25:36.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bcf400640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd00ba010 0x7f5bd009dca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5bc80af040 tx=0x7f5bc8019710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f3247800640 1 -- 172.21.15.88:0/3498974375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32400aaf50 msgr2=0x7f32400b7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f3247800640 1 --2- 172.21.15.88:0/3498974375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32400aaf50 0x7f32400b7310 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3238009e50 tx=0x7f323801c960 comp rx=0 tx=0).stop 2024-04-24T08:25:36.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f3247800640 1 -- 172.21.15.88:0/3498974375 shutdown_connections 2024-04-24T08:25:36.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f3247800640 1 --2- 172.21.15.88:0/3498974375 >> v2:172.21.15.142:3300/0 conn(0x7f3240149170 0x7f3240149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f3247800640 1 --2- 172.21.15.88:0/3498974375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32400aaf50 0x7f32400b7310 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f3247800640 1 -- 172.21.15.88:0/3498974375 >> 172.21.15.88:0/3498974375 conn(0x7f32400bb4d0 msgr2=0x7f32400bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bc7400640 1 -- 172.21.15.88:0/2595863678 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc80bc020 con 0x7f5bd00ba010 2024-04-24T08:25:36.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bc7400640 1 -- 172.21.15.88:0/2595863678 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc80b8670 con 0x7f5bd00ba010 2024-04-24T08:25:36.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f6a84a00640 1 Processor -- start 2024-04-24T08:25:36.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d12800640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d140b5760 0x7f5d141ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d11e00640 1 -- 172.21.15.88:0/3189195716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d1409c730 msgr2=0x7f5d141ed1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d11e00640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d1409c730 0x7f5d141ed1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d11e00640 1 -- 172.21.15.88:0/3189195716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d140b5760 msgr2=0x7f5d141ed6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5d11e00640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d140b5760 0x7f5d141ed6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f5d11e00640 1 -- 172.21.15.88:0/3189195716 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d14141b60 con 0x7f5d1406d920 2024-04-24T08:25:36.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f5d12800640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d140b5760 0x7f5d141ed6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:36.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7f5bc7400640 1 -- 172.21.15.88:0/2595863678 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc80b8a40 con 0x7f5bd00ba010 2024-04-24T08:25:36.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2595863678 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd009e900 con 0x7f5bd00ba010 2024-04-24T08:25:36.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f3247800640 1 -- 172.21.15.88:0/3498974375 shutdown_connections 2024-04-24T08:25:36.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f2b4b000640 1 -- 172.21.15.88:0/922781115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b440b9e10 msgr2=0x7f2b44143c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f2b4b000640 1 --2- 172.21.15.88:0/922781115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b440b9e10 0x7f2b44143c00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2b4406fe90 tx=0x7f2b3801c370 comp rx=0 tx=0).stop 2024-04-24T08:25:36.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f3247800640 1 -- 172.21.15.88:0/3498974375 wait complete. 2024-04-24T08:25:36.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f5d11e00640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1406d920 0x7f5d14072760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5d040ac040 tx=0x7f5d0401ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2595863678 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd01e8600 con 0x7f5bd00ba010 2024-04-24T08:25:36.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f2b4b000640 1 -- 172.21.15.88:0/922781115 shutdown_connections 2024-04-24T08:25:36.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f2b4b000640 1 --2- 172.21.15.88:0/922781115 >> v2:172.21.15.142:3300/0 conn(0x7f2b440b1490 0x7f2b44073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f2b4b000640 1 --2- 172.21.15.88:0/922781115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b440b9e10 0x7f2b44143c00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f2b4b000640 1 -- 172.21.15.88:0/922781115 >> 172.21.15.88:0/922781115 conn(0x7f2b440b92f0 msgr2=0x7f2b440b9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f5d0a000640 1 -- 172.21.15.88:0/3189195716 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d040a9b70 con 0x7f5d1406d920 2024-04-24T08:25:36.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f5d0a000640 1 -- 172.21.15.88:0/3189195716 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d040a6040 con 0x7f5d1406d920 2024-04-24T08:25:36.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f5d0a000640 1 -- 172.21.15.88:0/3189195716 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d040aae50 con 0x7f5d1406d920 2024-04-24T08:25:36.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb575e00640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb578073aa0 0x7fb5781d70c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb56400d620 tx=0x7fb56400dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7fb56e000640 1 -- 172.21.15.88:0/3839566813 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56400b620 con 0x7fb578073aa0 2024-04-24T08:25:36.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d14141e40 con 0x7f5d1406d920 2024-04-24T08:25:36.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.050+0000 7fb575400640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5780b1880 0x7fb5781e4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:36.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7fbbb2600640 1 -- start start 2024-04-24T08:25:36.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d140b35e0 con 0x7f5d1406d920 2024-04-24T08:25:36.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f6a84a00640 1 -- start start 2024-04-24T08:25:36.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f6a84a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800b49f0 0x7f6a801404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f2b4b000640 1 -- 172.21.15.88:0/922781115 shutdown_connections 2024-04-24T08:25:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7fb57ca00640 1 -- 172.21.15.88:0/3839566813 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5781d7b00 con 0x7fb578073aa0 2024-04-24T08:25:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7fb57ca00640 1 -- 172.21.15.88:0/3839566813 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5781448c0 con 0x7fb578073aa0 2024-04-24T08:25:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7fb56e000640 1 -- 172.21.15.88:0/3839566813 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb564019070 con 0x7fb578073aa0 2024-04-24T08:25:36.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7fb56e000640 1 -- 172.21.15.88:0/3839566813 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56400ba00 con 0x7fb578073aa0 2024-04-24T08:25:36.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f2b4b000640 1 -- 172.21.15.88:0/922781115 wait complete. 2024-04-24T08:25:36.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7fb57ca00640 1 -- 172.21.15.88:0/3839566813 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5500052a0 con 0x7fb578073aa0 2024-04-24T08:25:36.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d14068b20 con 0x7f5d1406d920 2024-04-24T08:25:36.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f6a84a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a800b91c0 0x7f6a80148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7fbbb2600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbac06d580 0x7fbbac1e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f6a7f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800b49f0 0x7f6a801404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f6a7f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800b49f0 0x7f6a801404e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:56160/0 (socket says 172.21.15.88:56160) 2024-04-24T08:25:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2595863678 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bd009ead0 con 0x7f5bd00ba010 2024-04-24T08:25:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7fbbb2600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbac0b9f40 0x7fbbac1e3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7f6a7f400640 1 -- 172.21.15.88:0/2198230633 learned_addr learned my addr 172.21.15.88:0/2198230633 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7fbbab400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbac06d580 0x7fbbac1e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.054+0000 7fbbab400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbac06d580 0x7fbbac1e32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:44152/0 (socket says 172.21.15.88:44152) 2024-04-24T08:25:36.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a7ea00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a800b91c0 0x7f6a80148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbaaa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbac0b9f40 0x7fbbac1e3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbab400640 1 -- 172.21.15.88:0/529351814 learned_addr learned my addr 172.21.15.88:0/529351814 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:36.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbb2600640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbac143c90 0x7fbbac09aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac1544a0 con 0x7fbbac0b9f40 2024-04-24T08:25:36.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac154320 con 0x7fbbac143c90 2024-04-24T08:25:36.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f5d0a000640 1 -- 172.21.15.88:0/3189195716 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d040c6440 con 0x7f5d1406d920 2024-04-24T08:25:36.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f5bc7400640 1 -- 172.21.15.88:0/2595863678 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5bc80bf020 con 0x7f5bd00ba010 2024-04-24T08:25:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac154620 con 0x7fbbac06d580 2024-04-24T08:25:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbabe00640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbac143c90 0x7fbbac09aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f3247800640 1 Processor -- start 2024-04-24T08:25:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbab400640 1 -- 172.21.15.88:0/529351814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbac143c90 msgr2=0x7fbbac09aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbab400640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbac143c90 0x7fbbac09aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbab400640 1 -- 172.21.15.88:0/529351814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbac0b9f40 msgr2=0x7fbbac1e3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbab400640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbac0b9f40 0x7fbbac1e3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbab400640 1 -- 172.21.15.88:0/529351814 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac0b7420 con 0x7fbbac06d580 2024-04-24T08:25:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbab400640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbac06d580 0x7fbbac1e32e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400c780 tx=0x7fbb9400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f5bc7400640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5bb0068450 0x7f5bb006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a84a00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a801461f0 0x7f6a80141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f5bc7400640 1 -- 172.21.15.88:0/2595863678 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5bc8121920 con 0x7f5bd00ba010 2024-04-24T08:25:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fbbabe00640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbac143c90 0x7fbbac09aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f5d0a000640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5cf4068620 0x7f5cf406aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f5d0a000640 1 -- 172.21.15.88:0/3189195716 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5d04121660 con 0x7f5d1406d920 2024-04-24T08:25:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a84a00640 1 -- 172.21.15.88:0/2198230633 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8014be90 con 0x7f6a800b91c0 2024-04-24T08:25:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a84a00640 1 -- 172.21.15.88:0/2198230633 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6a800b9a50 con 0x7f6a800b49f0 2024-04-24T08:25:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a84a00640 1 -- 172.21.15.88:0/2198230633 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6a800b69c0 con 0x7f6a801461f0 2024-04-24T08:25:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f3247800640 1 -- start start 2024-04-24T08:25:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a7fe00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a801461f0 0x7f6a80141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7fb56e000640 1 -- 172.21.15.88:0/3839566813 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb56400bba0 con 0x7fb578073aa0 2024-04-24T08:25:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f5d11400640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5cf4068620 0x7f5cf406aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a7fe00640 1 -- 172.21.15.88:0/2198230633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800b49f0 msgr2=0x7f6a801404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a7fe00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800b49f0 0x7f6a801404e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f5bcea00640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5bb0068450 0x7f5bb006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f2b4b000640 1 Processor -- start 2024-04-24T08:25:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a7fe00640 1 -- 172.21.15.88:0/2198230633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a800b91c0 msgr2=0x7f6a80148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a7fe00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a800b91c0 0x7f6a80148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a7fe00640 1 -- 172.21.15.88:0/2198230633 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a80143090 con 0x7f6a801461f0 2024-04-24T08:25:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a7ea00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a800b91c0 0x7f6a80148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a7f400640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800b49f0 0x7f6a801404e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f6a7fe00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a801461f0 0x7f6a80141c30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6a780ab000 tx=0x7f6a78019020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f2b4b000640 1 -- start start 2024-04-24T08:25:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.058+0000 7f5bcea00640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5bb0068450 0x7f5bb006a910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0006e90 tx=0x7f5bc0006de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f5d11400640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5cf4068620 0x7f5cf406aae0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5d14074190 tx=0x7f5d00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3247800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32400aaf50 0x7f3240143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3247800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32400ab330 0x7f32400adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7fb56e000640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb558068480 0x7fb55806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3244e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32400aaf50 0x7f3240143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3244e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32400aaf50 0x7f3240143150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34942/0 (socket says 172.21.15.88:34942) 2024-04-24T08:25:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3247800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3240149170 0x7f32400abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3247800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f32401536a0 con 0x7f32400aaf50 2024-04-24T08:25:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3247800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3240153520 con 0x7f32400ab330 2024-04-24T08:25:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3247800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3240153820 con 0x7f3240149170 2024-04-24T08:25:36.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3244e00640 1 -- 172.21.15.88:0/993918514 learned_addr learned my addr 172.21.15.88:0/993918514 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:36.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7fb575400640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb558068480 0x7fb55806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7fb56e000640 1 -- 172.21.15.88:0/3839566813 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb564086f10 con 0x7fb578073aa0 2024-04-24T08:25:36.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f323fe00640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32400ab330 0x7f32400adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b440b1490 0x7f2b44142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4b000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b440b24d0 0x7f2b4414b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4b000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b440b9e10 0x7f2b4414bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7fb575400640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb558068480 0x7fb55806a940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb578144850 tx=0x7fb568009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4b000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4414ae10 con 0x7f2b440b24d0 2024-04-24T08:25:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4b000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4414ac90 con 0x7f2b440b9e10 2024-04-24T08:25:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2b4414af90 con 0x7f2b440b1490 2024-04-24T08:25:36.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3245800640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3240149170 0x7f32400abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b49c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b440b1490 0x7f2b44142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b49c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b440b1490 0x7f2b44142e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:44180/0 (socket says 172.21.15.88:44180) 2024-04-24T08:25:36.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4a600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b440b9e10 0x7f2b4414bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b49c00640 1 -- 172.21.15.88:0/2965647388 learned_addr learned my addr 172.21.15.88:0/2965647388 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7fb56e000640 1 -- 172.21.15.88:0/3839566813 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb564057540 con 0x7fb578073aa0 2024-04-24T08:25:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b49200640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b440b24d0 0x7f2b4414b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3245800640 1 -- 172.21.15.88:0/993918514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32400ab330 msgr2=0x7f32400adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3245800640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32400ab330 0x7f32400adc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3245800640 1 -- 172.21.15.88:0/993918514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32400aaf50 msgr2=0x7f3240143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4a600640 1 -- 172.21.15.88:0/2965647388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b440b1490 msgr2=0x7f2b44142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4a600640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b440b1490 0x7f2b44142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4a600640 1 -- 172.21.15.88:0/2965647388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b440b24d0 msgr2=0x7f2b4414b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4a600640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b440b24d0 0x7f2b4414b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4a600640 1 -- 172.21.15.88:0/2965647388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b44146210 con 0x7f2b440b9e10 2024-04-24T08:25:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3245800640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32400aaf50 0x7f3240143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f3245800640 1 -- 172.21.15.88:0/993918514 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32400ad4a0 con 0x7f3240149170 2024-04-24T08:25:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f323fe00640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32400ab330 0x7f32400adc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f5bc7400640 1 -- 172.21.15.88:0/2595863678 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5bd009ead0 con 0x7f5bd00ba010 2024-04-24T08:25:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4a600640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b440b9e10 0x7f2b4414bd60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00ca40 tx=0x7f2b3c00cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b41600640 1 -- 172.21.15.88:0/2965647388 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c017070 con 0x7f2b440b9e10 2024-04-24T08:25:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b41600640 1 -- 172.21.15.88:0/2965647388 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3c00abf0 con 0x7f2b440b9e10 2024-04-24T08:25:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b41600640 1 -- 172.21.15.88:0/2965647388 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c012400 con 0x7f2b440b9e10 2024-04-24T08:25:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4b000640 1 -- 172.21.15.88:0/2965647388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4414e020 con 0x7f2b440b9e10 2024-04-24T08:25:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.062+0000 7f2b4b000640 1 -- 172.21.15.88:0/2965647388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b44145f30 con 0x7f2b440b9e10 2024-04-24T08:25:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7f3245800640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3240149170 0x7f32400abc70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f322c00c440 tx=0x7f322c00c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7f2b36a00640 1 -- 172.21.15.88:0/2965647388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b4404fe10 con 0x7f2b440b9e10 2024-04-24T08:25:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7f323cc00640 1 -- 172.21.15.88:0/993918514 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c011790 con 0x7f3240149170 2024-04-24T08:25:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7fbba3400640 1 -- 172.21.15.88:0/529351814 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94018070 con 0x7fbbac06d580 2024-04-24T08:25:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7fbba3400640 1 -- 172.21.15.88:0/529351814 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb940072d0 con 0x7fbbac06d580 2024-04-24T08:25:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7fbba3400640 1 -- 172.21.15.88:0/529351814 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94007680 con 0x7fbbac06d580 2024-04-24T08:25:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7f5d0a000640 1 -- 172.21.15.88:0/3189195716 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5d04016150 con 0x7f5d1406d920 2024-04-24T08:25:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7f6a77400640 1 -- 172.21.15.88:0/2198230633 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a780b9020 con 0x7f6a801461f0 2024-04-24T08:25:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7f6a77400640 1 -- 172.21.15.88:0/2198230633 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a780b1040 con 0x7f6a801461f0 2024-04-24T08:25:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7f6a77400640 1 -- 172.21.15.88:0/2198230633 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a780b0050 con 0x7f6a801461f0 2024-04-24T08:25:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7f6a84a00640 1 -- 172.21.15.88:0/2198230633 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a80140b00 con 0x7f6a801461f0 2024-04-24T08:25:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7f3247800640 1 -- 172.21.15.88:0/993918514 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32400ae370 con 0x7f3240149170 2024-04-24T08:25:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7f3247800640 1 -- 172.21.15.88:0/993918514 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32400acf50 con 0x7f3240149170 2024-04-24T08:25:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.066+0000 7f6a84a00640 1 -- 172.21.15.88:0/2198230633 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a800c6ce0 con 0x7f6a801461f0 2024-04-24T08:25:36.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.070+0000 7f323cc00640 1 -- 172.21.15.88:0/993918514 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f322c017070 con 0x7f3240149170 2024-04-24T08:25:36.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.070+0000 7f323cc00640 1 -- 172.21.15.88:0/993918514 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c011b70 con 0x7f3240149170 2024-04-24T08:25:36.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.070+0000 7f2b41600640 1 -- 172.21.15.88:0/2965647388 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2b3c01a070 con 0x7f2b440b9e10 2024-04-24T08:25:36.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.070+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbac0b76c0 con 0x7fbbac06d580 2024-04-24T08:25:36.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.070+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbac09e480 con 0x7fbbac06d580 2024-04-24T08:25:36.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.070+0000 7f3247800640 1 -- 172.21.15.88:0/993918514 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32180052a0 con 0x7f3240149170 2024-04-24T08:25:36.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.070+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbac068b20 con 0x7fbbac06d580 2024-04-24T08:25:36.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.070+0000 7f2b41600640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2b24068380 0x7f2b2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.070+0000 7f2b41600640 1 -- 172.21.15.88:0/2965647388 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2b3c0866c0 con 0x7f2b440b9e10 2024-04-24T08:25:36.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.070+0000 7f323cc00640 1 -- 172.21.15.88:0/993918514 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f322c011d10 con 0x7f3240149170 2024-04-24T08:25:36.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7f6a74c00640 1 -- 172.21.15.88:0/2198230633 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a8004fe10 con 0x7f6a801461f0 2024-04-24T08:25:36.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7f6a77400640 1 -- 172.21.15.88:0/2198230633 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a780bc020 con 0x7f6a801461f0 2024-04-24T08:25:36.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7fbba3400640 1 -- 172.21.15.88:0/529351814 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb9401b070 con 0x7fbbac06d580 2024-04-24T08:25:36.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7f2b49c00640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2b24068380 0x7f2b2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7f323cc00640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3220068380 0x7f322006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7f323cc00640 1 -- 172.21.15.88:0/993918514 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f322c086590 con 0x7f3240149170 2024-04-24T08:25:36.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7f2b49c00640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2b24068380 0x7f2b2406a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b38000c10 tx=0x7f2b380a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7f3244e00640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3220068380 0x7f322006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7fbba3400640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbb88068450 0x7fbb8806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7fbba3400640 1 -- 172.21.15.88:0/529351814 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbb94085da0 con 0x7fbbac06d580 2024-04-24T08:25:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7fbbaaa00640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbb88068450 0x7fbb8806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7f6a77400640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6a60068450 0x7f6a6006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7f2b41600640 1 -- 172.21.15.88:0/2965647388 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2b3c056620 con 0x7f2b440b9e10 2024-04-24T08:25:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.078+0000 7f3244e00640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3220068380 0x7f322006a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3238009e50 tx=0x7f32380a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.078+0000 7fbbaaa00640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbb88068450 0x7fbb8806a910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0b8120 tx=0x7fbb9c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.078+0000 7fbba3400640 1 -- 172.21.15.88:0/529351814 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbb94055d80 con 0x7fbbac06d580 2024-04-24T08:25:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.074+0000 7f6a77400640 1 -- 172.21.15.88:0/2198230633 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6a78120590 con 0x7f6a801461f0 2024-04-24T08:25:36.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.078+0000 7f6a7f400640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6a60068450 0x7f6a6006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.078+0000 7f6a7f400640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6a60068450 0x7f6a6006a910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009a40 tx=0x7f6a7000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.082+0000 7f323cc00640 1 -- 172.21.15.88:0/993918514 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f322c056500 con 0x7f3240149170 2024-04-24T08:25:36.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.086+0000 7f6a77400640 1 -- 172.21.15.88:0/2198230633 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6a78016130 con 0x7f6a801461f0 2024-04-24T08:25:36.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.314+0000 7f7a0e200640 1 -- 172.21.15.88:0/4017967250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7a0814bbd0 con 0x7f7a080b3cf0 2024-04-24T08:25:36.319 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-04-24T08:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.314+0000 7f79ff400640 1 -- 172.21.15.88:0/4017967250 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f79f805a3b0 con 0x7f7a080b3cf0 2024-04-24T08:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.318+0000 7f7a0e200640 1 -- 172.21.15.88:0/4017967250 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f79e4068580 msgr2=0x7f79e406aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.318+0000 7f7a0e200640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f79e4068580 0x7f79e406aa40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7a00000f90 tx=0x7f7a000a7070 comp rx=0 tx=0).stop 2024-04-24T08:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.318+0000 7f7a0e200640 1 -- 172.21.15.88:0/4017967250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a080b3cf0 msgr2=0x7f7a08145170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.318+0000 7f7a0e200640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a080b3cf0 0x7f7a08145170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f79f800b3c0 tx=0x7f79f800b880 comp rx=0 tx=0).stop 2024-04-24T08:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.318+0000 7f7a0e200640 1 -- 172.21.15.88:0/4017967250 shutdown_connections 2024-04-24T08:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.318+0000 7f7a0e200640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f79e4068580 0x7f79e406aa40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.318+0000 7f7a0e200640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08145ad0 0x7f7a08142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.318+0000 7f7a0e200640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a080b3cf0 0x7f7a08145170 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.318+0000 7f7a0e200640 1 --2- 172.21.15.88:0/4017967250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a080b1ed0 0x7f7a0814f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.318+0000 7f7a0e200640 1 -- 172.21.15.88:0/4017967250 >> 172.21.15.88:0/4017967250 conn(0x7f7a080b92f0 msgr2=0x7f7a0814aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.318+0000 7f7a0e200640 1 -- 172.21.15.88:0/4017967250 shutdown_connections 2024-04-24T08:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.318+0000 7f7a0e200640 1 -- 172.21.15.88:0/4017967250 wait complete. 2024-04-24T08:25:36.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-04-24T08:25:36.351 DEBUG:teuthology.parallel:result is None 2024-04-24T08:25:36.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.394+0000 7f6a74c00640 1 -- 172.21.15.88:0/2198230633 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6a801437e0 con 0x7f6a801461f0 2024-04-24T08:25:36.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.394+0000 7f6a77400640 1 -- 172.21.15.88:0/2198230633 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6a780f0bc0 con 0x7f6a801461f0 2024-04-24T08:25:36.394 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-04-24T08:25:36.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.394+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2595863678 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5bd009d570 con 0x7f5bd00ba010 2024-04-24T08:25:36.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.394+0000 7f5bc7400640 1 -- 172.21.15.88:0/2595863678 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5bc80c6030 con 0x7f5bd00ba010 2024-04-24T08:25:36.396 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-04-24T08:25:36.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.394+0000 7f6a74c00640 1 -- 172.21.15.88:0/2198230633 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6a60068450 msgr2=0x7f6a6006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.394+0000 7f6a74c00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6a60068450 0x7f6a6006a910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009a40 tx=0x7f6a7000b040 comp rx=0 tx=0).stop 2024-04-24T08:25:36.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.394+0000 7f6a74c00640 1 -- 172.21.15.88:0/2198230633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a801461f0 msgr2=0x7f6a80141c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.394+0000 7f6a74c00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a801461f0 0x7f6a80141c30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6a780ab000 tx=0x7f6a78019020 comp rx=0 tx=0).stop 2024-04-24T08:25:36.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f6a74c00640 1 -- 172.21.15.88:0/2198230633 shutdown_connections 2024-04-24T08:25:36.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f6a74c00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6a60068450 0x7f6a6006a910 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f6a74c00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a801461f0 0x7f6a80141c30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f6a74c00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a800b91c0 0x7f6a80148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f6a74c00640 1 --2- 172.21.15.88:0/2198230633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800b49f0 0x7f6a801404e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f6a74c00640 1 -- 172.21.15.88:0/2198230633 >> 172.21.15.88:0/2198230633 conn(0x7f6a800b9ff0 msgr2=0x7f6a8014a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f6a74c00640 1 -- 172.21.15.88:0/2198230633 shutdown_connections 2024-04-24T08:25:36.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f6a74c00640 1 -- 172.21.15.88:0/2198230633 wait complete. 2024-04-24T08:25:36.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2595863678 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5bb0068450 msgr2=0x7f5bb006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f5bd4e00640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5bb0068450 0x7f5bb006a910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0006e90 tx=0x7f5bc0006de0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2595863678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd00ba010 msgr2=0x7f5bd009dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f5bd4e00640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd00ba010 0x7f5bd009dca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5bc80af040 tx=0x7f5bc8019710 comp rx=0 tx=0).stop 2024-04-24T08:25:36.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2595863678 shutdown_connections 2024-04-24T08:25:36.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f5bd4e00640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5bb0068450 0x7f5bb006a910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f5bd4e00640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd01e7c50 0x7f5bd01e80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f5bd4e00640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd0144730 0x7f5bd0147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f5bd4e00640 1 --2- 172.21.15.88:0/2595863678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd00ba010 0x7f5bd009dca0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5bc80af040 tx=0x7f5bc8019710 comp rx=0 tx=0).stop 2024-04-24T08:25:36.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2595863678 >> 172.21.15.88:0/2595863678 conn(0x7f5bd009ee70 msgr2=0x7f5bd0074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2595863678 shutdown_connections 2024-04-24T08:25:36.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.398+0000 7f5bd4e00640 1 -- 172.21.15.88:0/2595863678 wait complete. 2024-04-24T08:25:36.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.406+0000 7fb57ca00640 1 -- 172.21.15.88:0/3839566813 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb550005860 con 0x7fb578073aa0 2024-04-24T08:25:36.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.410+0000 7fb56e000640 1 -- 172.21.15.88:0/3839566813 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb564056e40 con 0x7fb578073aa0 2024-04-24T08:25:36.409 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-04-24T08:25:36.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.410+0000 7fb57ca00640 1 -- 172.21.15.88:0/3839566813 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb558068480 msgr2=0x7fb55806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.410+0000 7fb57ca00640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb558068480 0x7fb55806a940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb578144850 tx=0x7fb568009040 comp rx=0 tx=0).stop 2024-04-24T08:25:36.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.410+0000 7fb57ca00640 1 -- 172.21.15.88:0/3839566813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb578073aa0 msgr2=0x7fb5781d70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.410+0000 7fb57ca00640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb578073aa0 0x7fb5781d70c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb56400d620 tx=0x7fb56400dae0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.414+0000 7fb57ca00640 1 -- 172.21.15.88:0/3839566813 shutdown_connections 2024-04-24T08:25:36.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.414+0000 7fb57ca00640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb558068480 0x7fb55806a940 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb578144850 tx=0x7fb568009040 comp rx=0 tx=0).stop 2024-04-24T08:25:36.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.414+0000 7fb57ca00640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5780b2370 0x7fb5781e5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.414+0000 7fb57ca00640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5780b1880 0x7fb5781e4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.414+0000 7fb57ca00640 1 --2- 172.21.15.88:0/3839566813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb578073aa0 0x7fb5781d70c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.414+0000 7fb57ca00640 1 -- 172.21.15.88:0/3839566813 >> 172.21.15.88:0/3839566813 conn(0x7fb5780b92f0 msgr2=0x7fb578145950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.414+0000 7fb57ca00640 1 -- 172.21.15.88:0/3839566813 shutdown_connections 2024-04-24T08:25:36.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.414+0000 7fb57ca00640 1 -- 172.21.15.88:0/3839566813 wait complete. 2024-04-24T08:25:36.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.414+0000 7f2b36a00640 1 -- 172.21.15.88:0/2965647388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2b440b90a0 con 0x7f2b440b9e10 2024-04-24T08:25:36.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.414+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5d14072f00 con 0x7f5d1406d920 2024-04-24T08:25:36.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.414+0000 7f2b41600640 1 -- 172.21.15.88:0/2965647388 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2b3c05a920 con 0x7f2b440b9e10 2024-04-24T08:25:36.417 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2024-04-24T08:25:36.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.414+0000 7f5d0a000640 1 -- 172.21.15.88:0/3189195716 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5d040f1640 con 0x7f5d1406d920 2024-04-24T08:25:36.417 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-04-24T08:25:36.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbbac073fd0 con 0x7fbbac06d580 2024-04-24T08:25:36.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5cf4068620 msgr2=0x7f5cf406aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f5d18c00640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5cf4068620 0x7f5cf406aae0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5d14074190 tx=0x7f5d00009040 comp rx=0 tx=0).stop 2024-04-24T08:25:36.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1406d920 msgr2=0x7f5d14072760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f5d18c00640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1406d920 0x7f5d14072760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5d040ac040 tx=0x7f5d0401ad10 comp rx=0 tx=0).stop 2024-04-24T08:25:36.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f2b36a00640 1 -- 172.21.15.88:0/2965647388 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2b24068380 msgr2=0x7f2b2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f2b36a00640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2b24068380 0x7f2b2406a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b38000c10 tx=0x7f2b380a6000 comp rx=0 tx=0).stop 2024-04-24T08:25:36.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f2b36a00640 1 -- 172.21.15.88:0/2965647388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b440b9e10 msgr2=0x7f2b4414bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f2b36a00640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b440b9e10 0x7f2b4414bd60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00ca40 tx=0x7f2b3c00cf00 comp rx=0 tx=0).stop 2024-04-24T08:25:36.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 shutdown_connections 2024-04-24T08:25:36.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f5d18c00640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5cf4068620 0x7f5cf406aae0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5d14074190 tx=0x7f5d00009040 comp rx=0 tx=0).stop 2024-04-24T08:25:36.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f5d18c00640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d140b5760 0x7f5d141ed6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f5d18c00640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d1409c730 0x7f5d141ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f5d18c00640 1 --2- 172.21.15.88:0/3189195716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d1406d920 0x7f5d14072760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 >> 172.21.15.88:0/3189195716 conn(0x7f5d140b9420 msgr2=0x7f5d140af050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.421 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-04-24T08:25:36.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7fbba3400640 1 -- 172.21.15.88:0/529351814 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbb9405a080 con 0x7fbbac06d580 2024-04-24T08:25:36.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 shutdown_connections 2024-04-24T08:25:36.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f5d18c00640 1 -- 172.21.15.88:0/3189195716 wait complete. 2024-04-24T08:25:36.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f2b36a00640 1 -- 172.21.15.88:0/2965647388 shutdown_connections 2024-04-24T08:25:36.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f2b36a00640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2b24068380 0x7f2b2406a840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f2b36a00640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b440b9e10 0x7f2b4414bd60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f2b36a00640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b440b24d0 0x7f2b4414b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f2b36a00640 1 --2- 172.21.15.88:0/2965647388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b440b1490 0x7f2b44142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.418+0000 7f2b36a00640 1 -- 172.21.15.88:0/2965647388 >> 172.21.15.88:0/2965647388 conn(0x7f2b440b92f0 msgr2=0x7f2b44149890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.422+0000 7f2b36a00640 1 -- 172.21.15.88:0/2965647388 shutdown_connections 2024-04-24T08:25:36.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.422+0000 7f2b36a00640 1 -- 172.21.15.88:0/2965647388 wait complete. 2024-04-24T08:25:36.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-04-24T08:25:36.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.422+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbb88068450 msgr2=0x7fbb8806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.422+0000 7fbbb2600640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbb88068450 0x7fbb8806a910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0b8120 tx=0x7fbb9c009190 comp rx=0 tx=0).stop 2024-04-24T08:25:36.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.422+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbac06d580 msgr2=0x7fbbac1e32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.422+0000 7fbbb2600640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbac06d580 0x7fbbac1e32e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400c780 tx=0x7fbb9400cc40 comp rx=0 tx=0).stop 2024-04-24T08:25:36.425 DEBUG:teuthology.parallel:result is None 2024-04-24T08:25:36.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.426+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 shutdown_connections 2024-04-24T08:25:36.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.426+0000 7fbbb2600640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbb88068450 0x7fbb8806a910 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.426+0000 7fbbb2600640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbac143c90 0x7fbbac09aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.426+0000 7fbbb2600640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbac0b9f40 0x7fbbac1e3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.426+0000 7fbbb2600640 1 --2- 172.21.15.88:0/529351814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbac06d580 0x7fbbac1e32e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.426+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 >> 172.21.15.88:0/529351814 conn(0x7fbbac0b9420 msgr2=0x7fbbac0b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.426+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 shutdown_connections 2024-04-24T08:25:36.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.426+0000 7fbbb2600640 1 -- 172.21.15.88:0/529351814 wait complete. 2024-04-24T08:25:36.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.434+0000 7f3247800640 1 -- 172.21.15.88:0/993918514 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3218005590 con 0x7f3240149170 2024-04-24T08:25:36.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.434+0000 7f323cc00640 1 -- 172.21.15.88:0/993918514 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f322c05a800 con 0x7f3240149170 2024-04-24T08:25:36.435 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-04-24T08:25:36.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-04-24T08:25:36.437 DEBUG:teuthology.parallel:result is None 2024-04-24T08:25:36.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.438+0000 7f3247800640 1 -- 172.21.15.88:0/993918514 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3220068380 msgr2=0x7f322006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.438+0000 7f3247800640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3220068380 0x7f322006a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3238009e50 tx=0x7f32380a7070 comp rx=0 tx=0).stop 2024-04-24T08:25:36.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.438+0000 7f3247800640 1 -- 172.21.15.88:0/993918514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3240149170 msgr2=0x7f32400abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.438+0000 7f3247800640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3240149170 0x7f32400abc70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f322c00c440 tx=0x7f322c00c900 comp rx=0 tx=0).stop 2024-04-24T08:25:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.438+0000 7f3247800640 1 -- 172.21.15.88:0/993918514 shutdown_connections 2024-04-24T08:25:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.438+0000 7f3247800640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3220068380 0x7f322006a840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.438+0000 7f3247800640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3240149170 0x7f32400abc70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.438+0000 7f3247800640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32400ab330 0x7f32400adc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.438+0000 7f3247800640 1 --2- 172.21.15.88:0/993918514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32400aaf50 0x7f3240143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.438+0000 7f3247800640 1 -- 172.21.15.88:0/993918514 >> 172.21.15.88:0/993918514 conn(0x7f32400bb4d0 msgr2=0x7f32400bab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.438+0000 7f3247800640 1 -- 172.21.15.88:0/993918514 shutdown_connections 2024-04-24T08:25:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.438+0000 7f3247800640 1 -- 172.21.15.88:0/993918514 wait complete. 2024-04-24T08:25:36.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-04-24T08:25:36.451 DEBUG:teuthology.parallel:result is None 2024-04-24T08:25:36.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-04-24T08:25:36.456 DEBUG:teuthology.parallel:result is None 2024-04-24T08:25:36.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-04-24T08:25:36.457 DEBUG:teuthology.parallel:result is None 2024-04-24T08:25:36.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-04-24T08:25:36.461 DEBUG:teuthology.parallel:result is None 2024-04-24T08:25:36.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-04-24T08:25:36.462 DEBUG:teuthology.parallel:result is None 2024-04-24T08:25:36.462 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T08:25:36.462 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:25:36.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.642+0000 7f17c9400640 1 Processor -- start 2024-04-24T08:25:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.642+0000 7f17c9400640 1 -- start start 2024-04-24T08:25:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.642+0000 7f17c9400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17c40b44e0 0x7f17c40b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.642+0000 7f17c9400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17c4143bb0 0x7f17c4144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.642+0000 7f17c9400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c40ba170 con 0x7f17c40b9d90 2024-04-24T08:25:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.642+0000 7f17c9400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f17c4145b80 con 0x7f17c40b44e0 2024-04-24T08:25:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.642+0000 7f17c9400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f17c41458a0 con 0x7f17c4143bb0 2024-04-24T08:25:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.642+0000 7f17b9e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17c40b44e0 0x7f17c40b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.642+0000 7f17c2800640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f17c40b9d90 0x7f17c41450e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59654/0 (socket says 172.21.15.88:59654) 2024-04-24T08:25:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.642+0000 7f17c2800640 1 -- 172.21.15.88:0/3192982585 learned_addr learned my addr 172.21.15.88:0/3192982585 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:36.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17c3200640 1 --2- 172.21.15.88:0/3192982585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17c4143bb0 0x7f17c4144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17b9e00640 1 -- 172.21.15.88:0/3192982585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17c4143bb0 msgr2=0x7f17c4144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:36.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17b9e00640 1 --2- 172.21.15.88:0/3192982585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17c4143bb0 0x7f17c4144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17b9e00640 1 -- 172.21.15.88:0/3192982585 >> v1:172.21.15.88:6789/0 conn(0x7f17c40b9d90 legacy=0x7f17c41450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17b9e00640 1 -- 172.21.15.88:0/3192982585 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c40b3fc0 con 0x7f17c40b44e0 2024-04-24T08:25:36.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17b9e00640 1 --2- 172.21.15.88:0/3192982585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c40b44e0 0x7f17c40b4970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0097c0 tx=0x7f17ac01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392929e616578c6a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17c1e00640 1 -- 172.21.15.88:0/3192982585 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0b0070 con 0x7f17c40b44e0 2024-04-24T08:25:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17c1e00640 1 -- 172.21.15.88:0/3192982585 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ac0ab600 con 0x7f17c40b44e0 2024-04-24T08:25:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17c1e00640 1 -- 172.21.15.88:0/3192982585 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0ab9d0 con 0x7f17c40b44e0 2024-04-24T08:25:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17c9400640 1 -- 172.21.15.88:0/3192982585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c40b44e0 msgr2=0x7f17c40b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17c9400640 1 --2- 172.21.15.88:0/3192982585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c40b44e0 0x7f17c40b4970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0097c0 tx=0x7f17ac01c410 comp rx=0 tx=0).stop 2024-04-24T08:25:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17c9400640 1 -- 172.21.15.88:0/3192982585 shutdown_connections 2024-04-24T08:25:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17c9400640 1 --2- 172.21.15.88:0/3192982585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17c4143bb0 0x7f17c4144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17c9400640 1 --2- 172.21.15.88:0/3192982585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c40b44e0 0x7f17c40b4970 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.646+0000 7f17c9400640 1 -- 172.21.15.88:0/3192982585 >> 172.21.15.88:0/3192982585 conn(0x7f17c406c0d0 msgr2=0x7f17c40b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c9400640 1 -- 172.21.15.88:0/3192982585 shutdown_connections 2024-04-24T08:25:36.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c9400640 1 -- 172.21.15.88:0/3192982585 wait complete. 2024-04-24T08:25:36.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c9400640 1 Processor -- start 2024-04-24T08:25:36.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c9400640 1 -- start start 2024-04-24T08:25:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c9400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17c40b44e0 0x7f17c40b8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c9400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c40b9d90 0x7f17c414a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c9400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17c4143bb0 0x7f17c4140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c9400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4152010 con 0x7f17c40b9d90 2024-04-24T08:25:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c9400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4151e90 con 0x7f17c40b44e0 2024-04-24T08:25:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c9400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f17c4152190 con 0x7f17c4143bb0 2024-04-24T08:25:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17b9e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c40b9d90 0x7f17c414a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17b9e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c40b9d90 0x7f17c414a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34956/0 (socket says 172.21.15.88:34956) 2024-04-24T08:25:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17b9e00640 1 -- 172.21.15.88:0/1888999166 learned_addr learned my addr 172.21.15.88:0/1888999166 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c3200640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17c4143bb0 0x7f17c4140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c2800640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17c40b44e0 0x7f17c40b8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17b9e00640 1 -- 172.21.15.88:0/1888999166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17c4143bb0 msgr2=0x7f17c4140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17b9e00640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17c4143bb0 0x7f17c4140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17b9e00640 1 -- 172.21.15.88:0/1888999166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17c40b44e0 msgr2=0x7f17c40b8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17b9e00640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17c40b44e0 0x7f17c40b8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17b9e00640 1 -- 172.21.15.88:0/1888999166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c414a880 con 0x7f17c40b9d90 2024-04-24T08:25:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c3200640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17c4143bb0 0x7f17c4140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c2800640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17c40b44e0 0x7f17c40b8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17b9e00640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c40b9d90 0x7f17c414a340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0ae040 tx=0x7f17ac0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17bb400640 1 -- 172.21.15.88:0/1888999166 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0b8030 con 0x7f17c40b9d90 2024-04-24T08:25:36.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17bb400640 1 -- 172.21.15.88:0/1888999166 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ac0ab400 con 0x7f17c40b9d90 2024-04-24T08:25:36.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c9400640 1 -- 172.21.15.88:0/1888999166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c414bf10 con 0x7f17c40b9d90 2024-04-24T08:25:36.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17bb400640 1 -- 172.21.15.88:0/1888999166 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0b0040 con 0x7f17c40b9d90 2024-04-24T08:25:36.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.650+0000 7f17c9400640 1 -- 172.21.15.88:0/1888999166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c414c4d0 con 0x7f17c40b9d90 2024-04-24T08:25:36.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.654+0000 7f17c9400640 1 -- 172.21.15.88:0/1888999166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c4068b90 con 0x7f17c40b9d90 2024-04-24T08:25:36.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.654+0000 7f17bb400640 1 -- 172.21.15.88:0/1888999166 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f17ac0bb070 con 0x7f17c40b9d90 2024-04-24T08:25:36.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.654+0000 7f17bb400640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f17a0068380 0x7f17a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:36.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.654+0000 7f17bb400640 1 -- 172.21.15.88:0/1888999166 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f17ac120290 con 0x7f17c40b9d90 2024-04-24T08:25:36.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.654+0000 7f17c2800640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f17a0068380 0x7f17a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:36.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.654+0000 7f17c2800640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f17a0068380 0x7f17a006a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f17c41e1c80 tx=0x7f17b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:36.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.658+0000 7f17bb400640 1 -- 172.21.15.88:0/1888999166 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f17ac0c2070 con 0x7f17c40b9d90 2024-04-24T08:25:36.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.814+0000 7f17c9400640 1 -- 172.21.15.88:0/1888999166 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f17c414eac0 con 0x7f17a0068380 2024-04-24T08:25:36.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.818+0000 7f17bb400640 1 -- 172.21.15.88:0/1888999166 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251896 (secure 0 0 0) 0x7f17c414eac0 con 0x7f17a0068380 2024-04-24T08:25:36.822 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:36.823 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:25:36.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.822+0000 7f17c9400640 1 -- 172.21.15.88:0/1888999166 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f17a0068380 msgr2=0x7f17a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.822+0000 7f17c9400640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f17a0068380 0x7f17a006a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f17c41e1c80 tx=0x7f17b4009040 comp rx=0 tx=0).stop 2024-04-24T08:25:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.822+0000 7f17c9400640 1 -- 172.21.15.88:0/1888999166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c40b9d90 msgr2=0x7f17c414a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.822+0000 7f17c9400640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c40b9d90 0x7f17c414a340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0ae040 tx=0x7f17ac0191b0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.822+0000 7f17c9400640 1 -- 172.21.15.88:0/1888999166 shutdown_connections 2024-04-24T08:25:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.822+0000 7f17c9400640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f17a0068380 0x7f17a006a840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.822+0000 7f17c9400640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17c4143bb0 0x7f17c4140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.822+0000 7f17c9400640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c40b9d90 0x7f17c414a340 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.822+0000 7f17c9400640 1 --2- 172.21.15.88:0/1888999166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17c40b44e0 0x7f17c40b8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.822+0000 7f17c9400640 1 -- 172.21.15.88:0/1888999166 >> 172.21.15.88:0/1888999166 conn(0x7f17c406c0d0 msgr2=0x7f17c41430d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.822+0000 7f17c9400640 1 -- 172.21.15.88:0/1888999166 shutdown_connections 2024-04-24T08:25:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:36.822+0000 7f17c9400640 1 -- 172.21.15.88:0/1888999166 wait complete. 2024-04-24T08:25:36.843 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-24T08:25:34.989344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.901399"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487790+0000","last_change":"2024-04-24T08:25:28.122966+0000","last_active":"2024-04-24T08:25:29.487790+0000","last_peered":"2024-04-24T08:25:29.487790+0000","last_clean":"2024-04-24T08:25:29.487790+0000","last_became_active":"2024-04-24T08:25:28.122377+0000","last_became_peered":"2024-04-24T08:25:28.122377+0000","last_unstale":"2024-04-24T08:25:29.487790+0000","last_undegraded":"2024-04-24T08:25:29.487790+0000","last_fullsized":"2024-04-24T08:25:29.487790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:18.049288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116977+0000","last_change":"2024-04-24T08:25:28.107616+0000","last_active":"2024-04-24T08:25:29.116977+0000","last_peered":"2024-04-24T08:25:29.116977+0000","last_clean":"2024-04-24T08:25:29.116977+0000","last_became_active":"2024-04-24T08:25:28.107282+0000","last_became_peered":"2024-04-24T08:25:28.107282+0000","last_unstale":"2024-04-24T08:25:29.116977+0000","last_undegraded":"2024-04-24T08:25:29.116977+0000","last_fullsized":"2024-04-24T08:25:29.116977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125214+0000","last_change":"2024-04-24T08:25:28.107850+0000","last_active":"2024-04-24T08:25:31.125214+0000","last_peered":"2024-04-24T08:25:31.125214+0000","last_clean":"2024-04-24T08:25:31.125214+0000","last_became_active":"2024-04-24T08:25:28.105595+0000","last_became_peered":"2024-04-24T08:25:28.105595+0000","last_unstale":"2024-04-24T08:25:31.125214+0000","last_undegraded":"2024-04-24T08:25:31.125214+0000","last_fullsized":"2024-04-24T08:25:31.125214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:18.585938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118650+0000","last_change":"2024-04-24T08:25:28.131587+0000","last_active":"2024-04-24T08:25:29.118650+0000","last_peered":"2024-04-24T08:25:29.118650+0000","last_clean":"2024-04-24T08:25:29.118650+0000","last_became_active":"2024-04-24T08:25:28.131271+0000","last_became_peered":"2024-04-24T08:25:28.131271+0000","last_unstale":"2024-04-24T08:25:29.118650+0000","last_undegraded":"2024-04-24T08:25:29.118650+0000","last_fullsized":"2024-04-24T08:25:29.118650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:17.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487906+0000","last_change":"2024-04-24T08:25:28.119186+0000","last_active":"2024-04-24T08:25:29.487906+0000","last_peered":"2024-04-24T08:25:29.487906+0000","last_clean":"2024-04-24T08:25:29.487906+0000","last_became_active":"2024-04-24T08:25:28.118470+0000","last_became_peered":"2024-04-24T08:25:28.118470+0000","last_unstale":"2024-04-24T08:25:29.487906+0000","last_undegraded":"2024-04-24T08:25:29.487906+0000","last_fullsized":"2024-04-24T08:25:29.487906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:08:53.886358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118414+0000","last_change":"2024-04-24T08:25:28.110827+0000","last_active":"2024-04-24T08:25:29.118414+0000","last_peered":"2024-04-24T08:25:29.118414+0000","last_clean":"2024-04-24T08:25:29.118414+0000","last_became_active":"2024-04-24T08:25:28.110542+0000","last_became_peered":"2024-04-24T08:25:28.110542+0000","last_unstale":"2024-04-24T08:25:29.118414+0000","last_undegraded":"2024-04-24T08:25:29.118414+0000","last_fullsized":"2024-04-24T08:25:29.118414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487112+0000","last_change":"2024-04-24T08:25:28.122530+0000","last_active":"2024-04-24T08:25:29.487112+0000","last_peered":"2024-04-24T08:25:29.487112+0000","last_clean":"2024-04-24T08:25:29.487112+0000","last_became_active":"2024-04-24T08:25:28.121676+0000","last_became_peered":"2024-04-24T08:25:28.121676+0000","last_unstale":"2024-04-24T08:25:29.487112+0000","last_undegraded":"2024-04-24T08:25:29.487112+0000","last_fullsized":"2024-04-24T08:25:29.487112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:27:07.262422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.051643+0000","last_change":"2024-04-24T08:25:28.133406+0000","last_active":"2024-04-24T08:25:30.051643+0000","last_peered":"2024-04-24T08:25:30.051643+0000","last_clean":"2024-04-24T08:25:30.051643+0000","last_became_active":"2024-04-24T08:25:28.132708+0000","last_became_peered":"2024-04-24T08:25:28.132708+0000","last_unstale":"2024-04-24T08:25:30.051643+0000","last_undegraded":"2024-04-24T08:25:30.051643+0000","last_fullsized":"2024-04-24T08:25:30.051643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:08:11.270207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487778+0000","last_change":"2024-04-24T08:25:28.126548+0000","last_active":"2024-04-24T08:25:29.487778+0000","last_peered":"2024-04-24T08:25:29.487778+0000","last_clean":"2024-04-24T08:25:29.487778+0000","last_became_active":"2024-04-24T08:25:28.126116+0000","last_became_peered":"2024-04-24T08:25:28.126116+0000","last_unstale":"2024-04-24T08:25:29.487778+0000","last_undegraded":"2024-04-24T08:25:29.487778+0000","last_fullsized":"2024-04-24T08:25:29.487778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:09.839576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099516+0000","last_change":"2024-04-24T08:25:28.117731+0000","last_active":"2024-04-24T08:25:30.099516+0000","last_peered":"2024-04-24T08:25:30.099516+0000","last_clean":"2024-04-24T08:25:30.099516+0000","last_became_active":"2024-04-24T08:25:28.116901+0000","last_became_peered":"2024-04-24T08:25:28.116901+0000","last_unstale":"2024-04-24T08:25:30.099516+0000","last_undegraded":"2024-04-24T08:25:30.099516+0000","last_fullsized":"2024-04-24T08:25:30.099516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099299+0000","last_change":"2024-04-24T08:25:28.120314+0000","last_active":"2024-04-24T08:25:30.099299+0000","last_peered":"2024-04-24T08:25:30.099299+0000","last_clean":"2024-04-24T08:25:30.099299+0000","last_became_active":"2024-04-24T08:25:28.118691+0000","last_became_peered":"2024-04-24T08:25:28.118691+0000","last_unstale":"2024-04-24T08:25:30.099299+0000","last_undegraded":"2024-04-24T08:25:30.099299+0000","last_fullsized":"2024-04-24T08:25:30.099299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:59.080477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.120168+0000","last_change":"2024-04-24T08:25:28.126862+0000","last_active":"2024-04-24T08:25:29.120168+0000","last_peered":"2024-04-24T08:25:29.120168+0000","last_clean":"2024-04-24T08:25:29.120168+0000","last_became_active":"2024-04-24T08:25:28.126543+0000","last_became_peered":"2024-04-24T08:25:28.126543+0000","last_unstale":"2024-04-24T08:25:29.120168+0000","last_undegraded":"2024-04-24T08:25:29.120168+0000","last_fullsized":"2024-04-24T08:25:29.120168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:54.349880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052012+0000","last_change":"2024-04-24T08:25:28.127815+0000","last_active":"2024-04-24T08:25:30.052012+0000","last_peered":"2024-04-24T08:25:30.052012+0000","last_clean":"2024-04-24T08:25:30.052012+0000","last_became_active":"2024-04-24T08:25:28.127026+0000","last_became_peered":"2024-04-24T08:25:28.127026+0000","last_unstale":"2024-04-24T08:25:30.052012+0000","last_undegraded":"2024-04-24T08:25:30.052012+0000","last_fullsized":"2024-04-24T08:25:30.052012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.124572+0000","last_change":"2024-04-24T08:25:28.110471+0000","last_active":"2024-04-24T08:25:31.124572+0000","last_peered":"2024-04-24T08:25:31.124572+0000","last_clean":"2024-04-24T08:25:31.124572+0000","last_became_active":"2024-04-24T08:25:28.109175+0000","last_became_peered":"2024-04-24T08:25:28.109175+0000","last_unstale":"2024-04-24T08:25:31.124572+0000","last_undegraded":"2024-04-24T08:25:31.124572+0000","last_fullsized":"2024-04-24T08:25:31.124572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:43:07.823084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116748+0000","last_change":"2024-04-24T08:25:28.115093+0000","last_active":"2024-04-24T08:25:29.116748+0000","last_peered":"2024-04-24T08:25:29.116748+0000","last_clean":"2024-04-24T08:25:29.116748+0000","last_became_active":"2024-04-24T08:25:28.114782+0000","last_became_peered":"2024-04-24T08:25:28.114782+0000","last_unstale":"2024-04-24T08:25:29.116748+0000","last_undegraded":"2024-04-24T08:25:29.116748+0000","last_fullsized":"2024-04-24T08:25:29.116748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:03:04.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118502+0000","last_change":"2024-04-24T08:25:28.108967+0000","last_active":"2024-04-24T08:25:29.118502+0000","last_peered":"2024-04-24T08:25:29.118502+0000","last_clean":"2024-04-24T08:25:29.118502+0000","last_became_active":"2024-04-24T08:25:28.108627+0000","last_became_peered":"2024-04-24T08:25:28.108627+0000","last_unstale":"2024-04-24T08:25:29.118502+0000","last_undegraded":"2024-04-24T08:25:29.118502+0000","last_fullsized":"2024-04-24T08:25:29.118502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:01:48.875146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119667+0000","last_change":"2024-04-24T08:25:28.120983+0000","last_active":"2024-04-24T08:25:29.119667+0000","last_peered":"2024-04-24T08:25:29.119667+0000","last_clean":"2024-04-24T08:25:29.119667+0000","last_became_active":"2024-04-24T08:25:28.120054+0000","last_became_peered":"2024-04-24T08:25:28.120054+0000","last_unstale":"2024-04-24T08:25:29.119667+0000","last_undegraded":"2024-04-24T08:25:29.119667+0000","last_fullsized":"2024-04-24T08:25:29.119667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:09.839576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125424+0000","last_change":"2024-04-24T08:25:28.119368+0000","last_active":"2024-04-24T08:25:31.125424+0000","last_peered":"2024-04-24T08:25:31.125424+0000","last_clean":"2024-04-24T08:25:31.125424+0000","last_became_active":"2024-04-24T08:25:28.118968+0000","last_became_peered":"2024-04-24T08:25:28.118968+0000","last_unstale":"2024-04-24T08:25:31.125424+0000","last_undegraded":"2024-04-24T08:25:31.125424+0000","last_fullsized":"2024-04-24T08:25:31.125424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:46.419388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487555+0000","last_change":"2024-04-24T08:25:28.136211+0000","last_active":"2024-04-24T08:25:29.487555+0000","last_peered":"2024-04-24T08:25:29.487555+0000","last_clean":"2024-04-24T08:25:29.487555+0000","last_became_active":"2024-04-24T08:25:28.135915+0000","last_became_peered":"2024-04-24T08:25:28.135915+0000","last_unstale":"2024-04-24T08:25:29.487555+0000","last_undegraded":"2024-04-24T08:25:29.487555+0000","last_fullsized":"2024-04-24T08:25:29.487555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:05:08.000888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099440+0000","last_change":"2024-04-24T08:25:28.128288+0000","last_active":"2024-04-24T08:25:30.099440+0000","last_peered":"2024-04-24T08:25:30.099440+0000","last_clean":"2024-04-24T08:25:30.099440+0000","last_became_active":"2024-04-24T08:25:28.127975+0000","last_became_peered":"2024-04-24T08:25:28.127975+0000","last_unstale":"2024-04-24T08:25:30.099440+0000","last_undegraded":"2024-04-24T08:25:30.099440+0000","last_fullsized":"2024-04-24T08:25:30.099440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:03:04.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125104+0000","last_change":"2024-04-24T08:25:28.119997+0000","last_active":"2024-04-24T08:25:31.125104+0000","last_peered":"2024-04-24T08:25:31.125104+0000","last_clean":"2024-04-24T08:25:31.125104+0000","last_became_active":"2024-04-24T08:25:28.119394+0000","last_became_peered":"2024-04-24T08:25:28.119394+0000","last_unstale":"2024-04-24T08:25:31.125104+0000","last_undegraded":"2024-04-24T08:25:31.125104+0000","last_fullsized":"2024-04-24T08:25:31.125104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:08:11.270207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118478+0000","last_change":"2024-04-24T08:25:28.115607+0000","last_active":"2024-04-24T08:25:29.118478+0000","last_peered":"2024-04-24T08:25:29.118478+0000","last_clean":"2024-04-24T08:25:29.118478+0000","last_became_active":"2024-04-24T08:25:28.115310+0000","last_became_peered":"2024-04-24T08:25:28.115310+0000","last_unstale":"2024-04-24T08:25:29.118478+0000","last_undegraded":"2024-04-24T08:25:29.118478+0000","last_fullsized":"2024-04-24T08:25:29.118478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.051801+0000","last_change":"2024-04-24T08:25:28.129517+0000","last_active":"2024-04-24T08:25:30.051801+0000","last_peered":"2024-04-24T08:25:30.051801+0000","last_clean":"2024-04-24T08:25:30.051801+0000","last_became_active":"2024-04-24T08:25:28.129258+0000","last_became_peered":"2024-04-24T08:25:28.129258+0000","last_unstale":"2024-04-24T08:25:30.051801+0000","last_undegraded":"2024-04-24T08:25:30.051801+0000","last_fullsized":"2024-04-24T08:25:30.051801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:37:01.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118686+0000","last_change":"2024-04-24T08:25:28.129391+0000","last_active":"2024-04-24T08:25:29.118686+0000","last_peered":"2024-04-24T08:25:29.118686+0000","last_clean":"2024-04-24T08:25:29.118686+0000","last_became_active":"2024-04-24T08:25:28.128991+0000","last_became_peered":"2024-04-24T08:25:28.128991+0000","last_unstale":"2024-04-24T08:25:29.118686+0000","last_undegraded":"2024-04-24T08:25:29.118686+0000","last_fullsized":"2024-04-24T08:25:29.118686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:39.021977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052390+0000","last_change":"2024-04-24T08:25:28.132732+0000","last_active":"2024-04-24T08:25:30.052390+0000","last_peered":"2024-04-24T08:25:30.052390+0000","last_clean":"2024-04-24T08:25:30.052390+0000","last_became_active":"2024-04-24T08:25:28.132493+0000","last_became_peered":"2024-04-24T08:25:28.132493+0000","last_unstale":"2024-04-24T08:25:30.052390+0000","last_undegraded":"2024-04-24T08:25:30.052390+0000","last_fullsized":"2024-04-24T08:25:30.052390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:17.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099597+0000","last_change":"2024-04-24T08:25:28.118797+0000","last_active":"2024-04-24T08:25:30.099597+0000","last_peered":"2024-04-24T08:25:30.099597+0000","last_clean":"2024-04-24T08:25:30.099597+0000","last_became_active":"2024-04-24T08:25:28.118073+0000","last_became_peered":"2024-04-24T08:25:28.118073+0000","last_unstale":"2024-04-24T08:25:30.099597+0000","last_undegraded":"2024-04-24T08:25:30.099597+0000","last_fullsized":"2024-04-24T08:25:30.099597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116765+0000","last_change":"2024-04-24T08:25:28.131235+0000","last_active":"2024-04-24T08:25:29.116765+0000","last_peered":"2024-04-24T08:25:29.116765+0000","last_clean":"2024-04-24T08:25:29.116765+0000","last_became_active":"2024-04-24T08:25:28.130932+0000","last_became_peered":"2024-04-24T08:25:28.130932+0000","last_unstale":"2024-04-24T08:25:29.116765+0000","last_undegraded":"2024-04-24T08:25:29.116765+0000","last_fullsized":"2024-04-24T08:25:29.116765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052262+0000","last_change":"2024-04-24T08:25:28.134992+0000","last_active":"2024-04-24T08:25:30.052262+0000","last_peered":"2024-04-24T08:25:30.052262+0000","last_clean":"2024-04-24T08:25:30.052262+0000","last_became_active":"2024-04-24T08:25:28.134739+0000","last_became_peered":"2024-04-24T08:25:28.134739+0000","last_unstale":"2024-04-24T08:25:30.052262+0000","last_undegraded":"2024-04-24T08:25:30.052262+0000","last_fullsized":"2024-04-24T08:25:30.052262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:01:48.875146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125188+0000","last_change":"2024-04-24T08:25:28.131466+0000","last_active":"2024-04-24T08:25:31.125188+0000","last_peered":"2024-04-24T08:25:31.125188+0000","last_clean":"2024-04-24T08:25:31.125188+0000","last_became_active":"2024-04-24T08:25:28.131050+0000","last_became_peered":"2024-04-24T08:25:28.131050+0000","last_unstale":"2024-04-24T08:25:31.125188+0000","last_undegraded":"2024-04-24T08:25:31.125188+0000","last_fullsized":"2024-04-24T08:25:31.125188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:37:01.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118638+0000","last_change":"2024-04-24T08:25:28.136036+0000","last_active":"2024-04-24T08:25:29.118638+0000","last_peered":"2024-04-24T08:25:29.118638+0000","last_clean":"2024-04-24T08:25:29.118638+0000","last_became_active":"2024-04-24T08:25:28.135525+0000","last_became_peered":"2024-04-24T08:25:28.135525+0000","last_unstale":"2024-04-24T08:25:29.118638+0000","last_undegraded":"2024-04-24T08:25:29.118638+0000","last_fullsized":"2024-04-24T08:25:29.118638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:27:07.262422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.124554+0000","last_change":"2024-04-24T08:25:28.114519+0000","last_active":"2024-04-24T08:25:31.124554+0000","last_peered":"2024-04-24T08:25:31.124554+0000","last_clean":"2024-04-24T08:25:31.124554+0000","last_became_active":"2024-04-24T08:25:28.114247+0000","last_became_peered":"2024-04-24T08:25:28.114247+0000","last_unstale":"2024-04-24T08:25:31.124554+0000","last_undegraded":"2024-04-24T08:25:31.124554+0000","last_fullsized":"2024-04-24T08:25:31.124554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:54.349880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099120+0000","last_change":"2024-04-24T08:25:28.123399+0000","last_active":"2024-04-24T08:25:30.099120+0000","last_peered":"2024-04-24T08:25:30.099120+0000","last_clean":"2024-04-24T08:25:30.099120+0000","last_became_active":"2024-04-24T08:25:28.123078+0000","last_became_peered":"2024-04-24T08:25:28.123078+0000","last_unstale":"2024-04-24T08:25:30.099120+0000","last_undegraded":"2024-04-24T08:25:30.099120+0000","last_fullsized":"2024-04-24T08:25:30.099120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:08:11.270207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119086+0000","last_change":"2024-04-24T08:25:28.106959+0000","last_active":"2024-04-24T08:25:29.119086+0000","last_peered":"2024-04-24T08:25:29.119086+0000","last_clean":"2024-04-24T08:25:29.119086+0000","last_became_active":"2024-04-24T08:25:28.106686+0000","last_became_peered":"2024-04-24T08:25:28.106686+0000","last_unstale":"2024-04-24T08:25:29.119086+0000","last_undegraded":"2024-04-24T08:25:29.119086+0000","last_fullsized":"2024-04-24T08:25:29.119086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:07.862635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052088+0000","last_change":"2024-04-24T08:25:27.115877+0000","last_active":"2024-04-24T08:25:30.052088+0000","last_peered":"2024-04-24T08:25:30.052088+0000","last_clean":"2024-04-24T08:25:30.052088+0000","last_became_active":"2024-04-24T08:25:27.115544+0000","last_became_peered":"2024-04-24T08:25:27.115544+0000","last_unstale":"2024-04-24T08:25:30.052088+0000","last_undegraded":"2024-04-24T08:25:30.052088+0000","last_fullsized":"2024-04-24T08:25:30.052088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:24.009056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125309+0000","last_change":"2024-04-24T08:25:28.120172+0000","last_active":"2024-04-24T08:25:31.125309+0000","last_peered":"2024-04-24T08:25:31.125309+0000","last_clean":"2024-04-24T08:25:31.125309+0000","last_became_active":"2024-04-24T08:25:28.119756+0000","last_became_peered":"2024-04-24T08:25:28.119756+0000","last_unstale":"2024-04-24T08:25:31.125309+0000","last_undegraded":"2024-04-24T08:25:31.125309+0000","last_fullsized":"2024-04-24T08:25:31.125309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:59.080477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099195+0000","last_change":"2024-04-24T08:25:27.123186+0000","last_active":"2024-04-24T08:25:30.099195+0000","last_peered":"2024-04-24T08:25:30.099195+0000","last_clean":"2024-04-24T08:25:30.099195+0000","last_became_active":"2024-04-24T08:25:27.122910+0000","last_became_peered":"2024-04-24T08:25:27.122910+0000","last_unstale":"2024-04-24T08:25:30.099195+0000","last_undegraded":"2024-04-24T08:25:30.099195+0000","last_fullsized":"2024-04-24T08:25:30.099195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.051885+0000","last_change":"2024-04-24T08:25:27.120630+0000","last_active":"2024-04-24T08:25:30.051885+0000","last_peered":"2024-04-24T08:25:30.051885+0000","last_clean":"2024-04-24T08:25:30.051885+0000","last_became_active":"2024-04-24T08:25:27.119902+0000","last_became_peered":"2024-04-24T08:25:27.119902+0000","last_unstale":"2024-04-24T08:25:30.051885+0000","last_undegraded":"2024-04-24T08:25:30.051885+0000","last_fullsized":"2024-04-24T08:25:30.051885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:59:36.122581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.051826+0000","last_change":"2024-04-24T08:25:28.131546+0000","last_active":"2024-04-24T08:25:30.051826+0000","last_peered":"2024-04-24T08:25:30.051826+0000","last_clean":"2024-04-24T08:25:30.051826+0000","last_became_active":"2024-04-24T08:25:28.131273+0000","last_became_peered":"2024-04-24T08:25:28.131273+0000","last_unstale":"2024-04-24T08:25:30.051826+0000","last_undegraded":"2024-04-24T08:25:30.051826+0000","last_fullsized":"2024-04-24T08:25:30.051826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:18.585938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118787+0000","last_change":"2024-04-24T08:25:27.107828+0000","last_active":"2024-04-24T08:25:29.118787+0000","last_peered":"2024-04-24T08:25:29.118787+0000","last_clean":"2024-04-24T08:25:29.118787+0000","last_became_active":"2024-04-24T08:25:27.107464+0000","last_became_peered":"2024-04-24T08:25:27.107464+0000","last_unstale":"2024-04-24T08:25:29.118787+0000","last_undegraded":"2024-04-24T08:25:29.118787+0000","last_fullsized":"2024-04-24T08:25:29.118787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:56.317954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116595+0000","last_change":"2024-04-24T08:25:28.129575+0000","last_active":"2024-04-24T08:25:29.116595+0000","last_peered":"2024-04-24T08:25:29.116595+0000","last_clean":"2024-04-24T08:25:29.116595+0000","last_became_active":"2024-04-24T08:25:28.129273+0000","last_became_peered":"2024-04-24T08:25:28.129273+0000","last_unstale":"2024-04-24T08:25:29.116595+0000","last_undegraded":"2024-04-24T08:25:29.116595+0000","last_fullsized":"2024-04-24T08:25:29.116595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:18.585938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099414+0000","last_change":"2024-04-24T08:25:27.119751+0000","last_active":"2024-04-24T08:25:30.099414+0000","last_peered":"2024-04-24T08:25:30.099414+0000","last_clean":"2024-04-24T08:25:30.099414+0000","last_became_active":"2024-04-24T08:25:27.117532+0000","last_became_peered":"2024-04-24T08:25:27.117532+0000","last_unstale":"2024-04-24T08:25:30.099414+0000","last_undegraded":"2024-04-24T08:25:30.099414+0000","last_fullsized":"2024-04-24T08:25:30.099414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119157+0000","last_change":"2024-04-24T08:25:28.114763+0000","last_active":"2024-04-24T08:25:29.119157+0000","last_peered":"2024-04-24T08:25:29.119157+0000","last_clean":"2024-04-24T08:25:29.119157+0000","last_became_active":"2024-04-24T08:25:28.114494+0000","last_became_peered":"2024-04-24T08:25:28.114494+0000","last_unstale":"2024-04-24T08:25:29.119157+0000","last_undegraded":"2024-04-24T08:25:29.119157+0000","last_fullsized":"2024-04-24T08:25:29.119157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:19:25.270847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119337+0000","last_change":"2024-04-24T08:25:27.119512+0000","last_active":"2024-04-24T08:25:29.119337+0000","last_peered":"2024-04-24T08:25:29.119337+0000","last_clean":"2024-04-24T08:25:29.119337+0000","last_became_active":"2024-04-24T08:25:27.119197+0000","last_became_peered":"2024-04-24T08:25:27.119197+0000","last_unstale":"2024-04-24T08:25:29.119337+0000","last_undegraded":"2024-04-24T08:25:29.119337+0000","last_fullsized":"2024-04-24T08:25:29.119337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125520+0000","last_change":"2024-04-24T08:25:28.122927+0000","last_active":"2024-04-24T08:25:31.125520+0000","last_peered":"2024-04-24T08:25:31.125520+0000","last_clean":"2024-04-24T08:25:31.125520+0000","last_became_active":"2024-04-24T08:25:28.122632+0000","last_became_peered":"2024-04-24T08:25:28.122632+0000","last_unstale":"2024-04-24T08:25:31.125520+0000","last_undegraded":"2024-04-24T08:25:31.125520+0000","last_fullsized":"2024-04-24T08:25:31.125520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116822+0000","last_change":"2024-04-24T08:25:27.112537+0000","last_active":"2024-04-24T08:25:29.116822+0000","last_peered":"2024-04-24T08:25:29.116822+0000","last_clean":"2024-04-24T08:25:29.116822+0000","last_became_active":"2024-04-24T08:25:27.112233+0000","last_became_peered":"2024-04-24T08:25:27.112233+0000","last_unstale":"2024-04-24T08:25:29.116822+0000","last_undegraded":"2024-04-24T08:25:29.116822+0000","last_fullsized":"2024-04-24T08:25:29.116822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:45.411953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.120273+0000","last_change":"2024-04-24T08:25:28.125754+0000","last_active":"2024-04-24T08:25:29.120273+0000","last_peered":"2024-04-24T08:25:29.120273+0000","last_clean":"2024-04-24T08:25:29.120273+0000","last_became_active":"2024-04-24T08:25:28.116361+0000","last_became_peered":"2024-04-24T08:25:28.116361+0000","last_unstale":"2024-04-24T08:25:29.120273+0000","last_undegraded":"2024-04-24T08:25:29.120273+0000","last_fullsized":"2024-04-24T08:25:29.120273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:46.419388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099448+0000","last_change":"2024-04-24T08:25:27.118005+0000","last_active":"2024-04-24T08:25:30.099448+0000","last_peered":"2024-04-24T08:25:30.099448+0000","last_clean":"2024-04-24T08:25:30.099448+0000","last_became_active":"2024-04-24T08:25:27.117674+0000","last_became_peered":"2024-04-24T08:25:27.117674+0000","last_unstale":"2024-04-24T08:25:30.099448+0000","last_undegraded":"2024-04-24T08:25:30.099448+0000","last_fullsized":"2024-04-24T08:25:30.099448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:56.317954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487306+0000","last_change":"2024-04-24T08:25:28.133556+0000","last_active":"2024-04-24T08:25:29.487306+0000","last_peered":"2024-04-24T08:25:29.487306+0000","last_clean":"2024-04-24T08:25:29.487306+0000","last_became_active":"2024-04-24T08:25:28.133321+0000","last_became_peered":"2024-04-24T08:25:28.133321+0000","last_unstale":"2024-04-24T08:25:29.487306+0000","last_undegraded":"2024-04-24T08:25:29.487306+0000","last_fullsized":"2024-04-24T08:25:29.487306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:39.021977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125297+0000","last_change":"2024-04-24T08:25:27.112624+0000","last_active":"2024-04-24T08:25:31.125297+0000","last_peered":"2024-04-24T08:25:31.125297+0000","last_clean":"2024-04-24T08:25:31.125297+0000","last_became_active":"2024-04-24T08:25:27.112371+0000","last_became_peered":"2024-04-24T08:25:27.112371+0000","last_unstale":"2024-04-24T08:25:31.125297+0000","last_undegraded":"2024-04-24T08:25:31.125297+0000","last_fullsized":"2024-04-24T08:25:31.125297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:59:36.122581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.124701+0000","last_change":"2024-04-24T08:25:28.121857+0000","last_active":"2024-04-24T08:25:31.124701+0000","last_peered":"2024-04-24T08:25:31.124701+0000","last_clean":"2024-04-24T08:25:31.124701+0000","last_became_active":"2024-04-24T08:25:28.120874+0000","last_became_peered":"2024-04-24T08:25:28.120874+0000","last_unstale":"2024-04-24T08:25:31.124701+0000","last_undegraded":"2024-04-24T08:25:31.124701+0000","last_fullsized":"2024-04-24T08:25:31.124701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:13.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118754+0000","last_change":"2024-04-24T08:25:27.112099+0000","last_active":"2024-04-24T08:25:29.118754+0000","last_peered":"2024-04-24T08:25:29.118754+0000","last_clean":"2024-04-24T08:25:29.118754+0000","last_became_active":"2024-04-24T08:25:27.110637+0000","last_became_peered":"2024-04-24T08:25:27.110637+0000","last_unstale":"2024-04-24T08:25:29.118754+0000","last_undegraded":"2024-04-24T08:25:29.118754+0000","last_fullsized":"2024-04-24T08:25:29.118754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487531+0000","last_change":"2024-04-24T08:25:28.132620+0000","last_active":"2024-04-24T08:25:29.487531+0000","last_peered":"2024-04-24T08:25:29.487531+0000","last_clean":"2024-04-24T08:25:29.487531+0000","last_became_active":"2024-04-24T08:25:28.129548+0000","last_became_peered":"2024-04-24T08:25:28.129548+0000","last_unstale":"2024-04-24T08:25:29.487531+0000","last_undegraded":"2024-04-24T08:25:29.487531+0000","last_fullsized":"2024-04-24T08:25:29.487531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:19:25.270847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099038+0000","last_change":"2024-04-24T08:25:27.118817+0000","last_active":"2024-04-24T08:25:30.099038+0000","last_peered":"2024-04-24T08:25:30.099038+0000","last_clean":"2024-04-24T08:25:30.099038+0000","last_became_active":"2024-04-24T08:25:27.118507+0000","last_became_peered":"2024-04-24T08:25:27.118507+0000","last_unstale":"2024-04-24T08:25:30.099038+0000","last_undegraded":"2024-04-24T08:25:30.099038+0000","last_fullsized":"2024-04-24T08:25:30.099038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:49.812612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099122+0000","last_change":"2024-04-24T08:25:28.123679+0000","last_active":"2024-04-24T08:25:30.099122+0000","last_peered":"2024-04-24T08:25:30.099122+0000","last_clean":"2024-04-24T08:25:30.099122+0000","last_became_active":"2024-04-24T08:25:28.123217+0000","last_became_peered":"2024-04-24T08:25:28.123217+0000","last_unstale":"2024-04-24T08:25:30.099122+0000","last_undegraded":"2024-04-24T08:25:30.099122+0000","last_fullsized":"2024-04-24T08:25:30.099122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:37:01.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.124395+0000","last_change":"2024-04-24T08:25:27.109716+0000","last_active":"2024-04-24T08:25:31.124395+0000","last_peered":"2024-04-24T08:25:31.124395+0000","last_clean":"2024-04-24T08:25:31.124395+0000","last_became_active":"2024-04-24T08:25:27.108346+0000","last_became_peered":"2024-04-24T08:25:27.108346+0000","last_unstale":"2024-04-24T08:25:31.124395+0000","last_undegraded":"2024-04-24T08:25:31.124395+0000","last_fullsized":"2024-04-24T08:25:31.124395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:49.812612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487078+0000","last_change":"2024-04-24T08:25:28.127900+0000","last_active":"2024-04-24T08:25:29.487078+0000","last_peered":"2024-04-24T08:25:29.487078+0000","last_clean":"2024-04-24T08:25:29.487078+0000","last_became_active":"2024-04-24T08:25:28.127563+0000","last_became_peered":"2024-04-24T08:25:28.127563+0000","last_unstale":"2024-04-24T08:25:29.487078+0000","last_undegraded":"2024-04-24T08:25:29.487078+0000","last_fullsized":"2024-04-24T08:25:29.487078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:01:48.875146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119944+0000","last_change":"2024-04-24T08:25:27.114104+0000","last_active":"2024-04-24T08:25:29.119944+0000","last_peered":"2024-04-24T08:25:29.119944+0000","last_clean":"2024-04-24T08:25:29.119944+0000","last_became_active":"2024-04-24T08:25:27.113819+0000","last_became_peered":"2024-04-24T08:25:27.113819+0000","last_unstale":"2024-04-24T08:25:29.119944+0000","last_undegraded":"2024-04-24T08:25:29.119944+0000","last_fullsized":"2024-04-24T08:25:29.119944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:18:10.642911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487665+0000","last_change":"2024-04-24T08:25:28.128545+0000","last_active":"2024-04-24T08:25:29.487665+0000","last_peered":"2024-04-24T08:25:29.487665+0000","last_clean":"2024-04-24T08:25:29.487665+0000","last_became_active":"2024-04-24T08:25:28.126907+0000","last_became_peered":"2024-04-24T08:25:28.126907+0000","last_unstale":"2024-04-24T08:25:29.487665+0000","last_undegraded":"2024-04-24T08:25:29.487665+0000","last_fullsized":"2024-04-24T08:25:29.487665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:55:06.802484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125511+0000","last_change":"2024-04-24T08:25:27.106510+0000","last_active":"2024-04-24T08:25:31.125511+0000","last_peered":"2024-04-24T08:25:31.125511+0000","last_clean":"2024-04-24T08:25:31.125511+0000","last_became_active":"2024-04-24T08:25:27.106199+0000","last_became_peered":"2024-04-24T08:25:27.106199+0000","last_unstale":"2024-04-24T08:25:31.125511+0000","last_undegraded":"2024-04-24T08:25:31.125511+0000","last_fullsized":"2024-04-24T08:25:31.125511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487887+0000","last_change":"2024-04-24T08:25:28.133331+0000","last_active":"2024-04-24T08:25:29.487887+0000","last_peered":"2024-04-24T08:25:29.487887+0000","last_clean":"2024-04-24T08:25:29.487887+0000","last_became_active":"2024-04-24T08:25:28.133026+0000","last_became_peered":"2024-04-24T08:25:28.133026+0000","last_unstale":"2024-04-24T08:25:29.487887+0000","last_undegraded":"2024-04-24T08:25:29.487887+0000","last_fullsized":"2024-04-24T08:25:29.487887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:10:04.737380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116877+0000","last_change":"2024-04-24T08:25:27.106170+0000","last_active":"2024-04-24T08:25:29.116877+0000","last_peered":"2024-04-24T08:25:29.116877+0000","last_clean":"2024-04-24T08:25:29.116877+0000","last_became_active":"2024-04-24T08:25:27.105883+0000","last_became_peered":"2024-04-24T08:25:27.105883+0000","last_unstale":"2024-04-24T08:25:29.116877+0000","last_undegraded":"2024-04-24T08:25:29.116877+0000","last_fullsized":"2024-04-24T08:25:29.116877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:06:07.045350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119611+0000","last_change":"2024-04-24T08:25:28.130670+0000","last_active":"2024-04-24T08:25:29.119611+0000","last_peered":"2024-04-24T08:25:29.119611+0000","last_clean":"2024-04-24T08:25:29.119611+0000","last_became_active":"2024-04-24T08:25:28.130405+0000","last_became_peered":"2024-04-24T08:25:28.130405+0000","last_unstale":"2024-04-24T08:25:29.119611+0000","last_undegraded":"2024-04-24T08:25:29.119611+0000","last_fullsized":"2024-04-24T08:25:29.119611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:55:06.802484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125151+0000","last_change":"2024-04-24T08:25:27.108774+0000","last_active":"2024-04-24T08:25:31.125151+0000","last_peered":"2024-04-24T08:25:31.125151+0000","last_clean":"2024-04-24T08:25:31.125151+0000","last_became_active":"2024-04-24T08:25:27.108368+0000","last_became_peered":"2024-04-24T08:25:27.108368+0000","last_unstale":"2024-04-24T08:25:31.125151+0000","last_undegraded":"2024-04-24T08:25:31.125151+0000","last_fullsized":"2024-04-24T08:25:31.125151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:49.837612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487247+0000","last_change":"2024-04-24T08:25:28.121303+0000","last_active":"2024-04-24T08:25:29.487247+0000","last_peered":"2024-04-24T08:25:29.487247+0000","last_clean":"2024-04-24T08:25:29.487247+0000","last_became_active":"2024-04-24T08:25:28.119922+0000","last_became_peered":"2024-04-24T08:25:28.119922+0000","last_unstale":"2024-04-24T08:25:29.487247+0000","last_undegraded":"2024-04-24T08:25:29.487247+0000","last_fullsized":"2024-04-24T08:25:29.487247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:17.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487067+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:25:29.487067+0000","last_peered":"2024-04-24T08:25:29.487067+0000","last_clean":"2024-04-24T08:25:29.487067+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:25:29.487067+0000","last_undegraded":"2024-04-24T08:25:29.487067+0000","last_fullsized":"2024-04-24T08:25:29.487067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118347+0000","last_change":"2024-04-24T08:25:27.105508+0000","last_active":"2024-04-24T08:25:29.118347+0000","last_peered":"2024-04-24T08:25:29.118347+0000","last_clean":"2024-04-24T08:25:29.118347+0000","last_became_active":"2024-04-24T08:25:27.105128+0000","last_became_peered":"2024-04-24T08:25:27.105128+0000","last_unstale":"2024-04-24T08:25:29.118347+0000","last_undegraded":"2024-04-24T08:25:29.118347+0000","last_fullsized":"2024-04-24T08:25:29.118347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:49.812612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.051951+0000","last_change":"2024-04-24T08:25:28.129776+0000","last_active":"2024-04-24T08:25:30.051951+0000","last_peered":"2024-04-24T08:25:30.051951+0000","last_clean":"2024-04-24T08:25:30.051951+0000","last_became_active":"2024-04-24T08:25:28.127249+0000","last_became_peered":"2024-04-24T08:25:28.127249+0000","last_unstale":"2024-04-24T08:25:30.051951+0000","last_undegraded":"2024-04-24T08:25:30.051951+0000","last_fullsized":"2024-04-24T08:25:30.051951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:03:04.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.486974+0000","last_change":"2024-04-24T08:25:27.118013+0000","last_active":"2024-04-24T08:25:29.486974+0000","last_peered":"2024-04-24T08:25:29.486974+0000","last_clean":"2024-04-24T08:25:29.486974+0000","last_became_active":"2024-04-24T08:25:27.117768+0000","last_became_peered":"2024-04-24T08:25:27.117768+0000","last_unstale":"2024-04-24T08:25:29.486974+0000","last_undegraded":"2024-04-24T08:25:29.486974+0000","last_fullsized":"2024-04-24T08:25:29.486974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.124727+0000","last_change":"2024-04-24T08:25:28.118575+0000","last_active":"2024-04-24T08:25:31.124727+0000","last_peered":"2024-04-24T08:25:31.124727+0000","last_clean":"2024-04-24T08:25:31.124727+0000","last_became_active":"2024-04-24T08:25:28.110833+0000","last_became_peered":"2024-04-24T08:25:28.110833+0000","last_unstale":"2024-04-24T08:25:31.124727+0000","last_undegraded":"2024-04-24T08:25:31.124727+0000","last_fullsized":"2024-04-24T08:25:31.124727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:20:03.401225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.124656+0000","last_change":"2024-04-24T08:25:27.103860+0000","last_active":"2024-04-24T08:25:31.124656+0000","last_peered":"2024-04-24T08:25:31.124656+0000","last_clean":"2024-04-24T08:25:31.124656+0000","last_became_active":"2024-04-24T08:25:27.103309+0000","last_became_peered":"2024-04-24T08:25:27.103309+0000","last_unstale":"2024-04-24T08:25:31.124656+0000","last_undegraded":"2024-04-24T08:25:31.124656+0000","last_fullsized":"2024-04-24T08:25:31.124656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:24.009056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116596+0000","last_change":"2024-04-24T08:25:28.116005+0000","last_active":"2024-04-24T08:25:29.116596+0000","last_peered":"2024-04-24T08:25:29.116596+0000","last_clean":"2024-04-24T08:25:29.116596+0000","last_became_active":"2024-04-24T08:25:28.115091+0000","last_became_peered":"2024-04-24T08:25:28.115091+0000","last_unstale":"2024-04-24T08:25:29.116596+0000","last_undegraded":"2024-04-24T08:25:29.116596+0000","last_fullsized":"2024-04-24T08:25:29.116596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:37:01.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118855+0000","last_change":"2024-04-24T08:25:27.112835+0000","last_active":"2024-04-24T08:25:29.118855+0000","last_peered":"2024-04-24T08:25:29.118855+0000","last_clean":"2024-04-24T08:25:29.118855+0000","last_became_active":"2024-04-24T08:25:27.112540+0000","last_became_peered":"2024-04-24T08:25:27.112540+0000","last_unstale":"2024-04-24T08:25:29.118855+0000","last_undegraded":"2024-04-24T08:25:29.118855+0000","last_fullsized":"2024-04-24T08:25:29.118855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119417+0000","last_change":"2024-04-24T08:25:28.110825+0000","last_active":"2024-04-24T08:25:29.119417+0000","last_peered":"2024-04-24T08:25:29.119417+0000","last_clean":"2024-04-24T08:25:29.119417+0000","last_became_active":"2024-04-24T08:25:28.110558+0000","last_became_peered":"2024-04-24T08:25:28.110558+0000","last_unstale":"2024-04-24T08:25:29.119417+0000","last_undegraded":"2024-04-24T08:25:29.119417+0000","last_fullsized":"2024-04-24T08:25:29.119417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:55.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116724+0000","last_change":"2024-04-24T08:25:27.119554+0000","last_active":"2024-04-24T08:25:29.116724+0000","last_peered":"2024-04-24T08:25:29.116724+0000","last_clean":"2024-04-24T08:25:29.116724+0000","last_became_active":"2024-04-24T08:25:27.119265+0000","last_became_peered":"2024-04-24T08:25:27.119265+0000","last_unstale":"2024-04-24T08:25:29.116724+0000","last_undegraded":"2024-04-24T08:25:29.116724+0000","last_fullsized":"2024-04-24T08:25:29.116724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:53.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119700+0000","last_change":"2024-04-24T08:25:28.129338+0000","last_active":"2024-04-24T08:25:29.119700+0000","last_peered":"2024-04-24T08:25:29.119700+0000","last_clean":"2024-04-24T08:25:29.119700+0000","last_became_active":"2024-04-24T08:25:28.129089+0000","last_became_peered":"2024-04-24T08:25:28.129089+0000","last_unstale":"2024-04-24T08:25:29.119700+0000","last_undegraded":"2024-04-24T08:25:29.119700+0000","last_fullsized":"2024-04-24T08:25:29.119700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:18.049288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487566+0000","last_change":"2024-04-24T08:25:27.122158+0000","last_active":"2024-04-24T08:25:29.487566+0000","last_peered":"2024-04-24T08:25:29.487566+0000","last_clean":"2024-04-24T08:25:29.487566+0000","last_became_active":"2024-04-24T08:25:27.121891+0000","last_became_peered":"2024-04-24T08:25:27.121891+0000","last_unstale":"2024-04-24T08:25:29.487566+0000","last_undegraded":"2024-04-24T08:25:29.487566+0000","last_fullsized":"2024-04-24T08:25:29.487566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:45.411953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116628+0000","last_change":"2024-04-24T08:25:28.105914+0000","last_active":"2024-04-24T08:25:29.116628+0000","last_peered":"2024-04-24T08:25:29.116628+0000","last_clean":"2024-04-24T08:25:29.116628+0000","last_became_active":"2024-04-24T08:25:28.105628+0000","last_became_peered":"2024-04-24T08:25:28.105628+0000","last_unstale":"2024-04-24T08:25:29.116628+0000","last_undegraded":"2024-04-24T08:25:29.116628+0000","last_fullsized":"2024-04-24T08:25:29.116628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:59.080477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.028927+0000","last_change":"2024-04-24T08:25:27.120111+0000","last_active":"2024-04-24T08:25:30.028927+0000","last_peered":"2024-04-24T08:25:30.028927+0000","last_clean":"2024-04-24T08:25:30.028927+0000","last_became_active":"2024-04-24T08:25:27.119555+0000","last_became_peered":"2024-04-24T08:25:27.119555+0000","last_unstale":"2024-04-24T08:25:30.028927+0000","last_undegraded":"2024-04-24T08:25:30.028927+0000","last_fullsized":"2024-04-24T08:25:30.028927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052406+0000","last_change":"2024-04-24T08:25:28.128255+0000","last_active":"2024-04-24T08:25:30.052406+0000","last_peered":"2024-04-24T08:25:30.052406+0000","last_clean":"2024-04-24T08:25:30.052406+0000","last_became_active":"2024-04-24T08:25:28.128005+0000","last_became_peered":"2024-04-24T08:25:28.128005+0000","last_unstale":"2024-04-24T08:25:30.052406+0000","last_undegraded":"2024-04-24T08:25:30.052406+0000","last_fullsized":"2024-04-24T08:25:30.052406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:39.021977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099463+0000","last_change":"2024-04-24T08:25:27.119402+0000","last_active":"2024-04-24T08:25:30.099463+0000","last_peered":"2024-04-24T08:25:30.099463+0000","last_clean":"2024-04-24T08:25:30.099463+0000","last_became_active":"2024-04-24T08:25:27.119087+0000","last_became_peered":"2024-04-24T08:25:27.119087+0000","last_unstale":"2024-04-24T08:25:30.099463+0000","last_undegraded":"2024-04-24T08:25:30.099463+0000","last_fullsized":"2024-04-24T08:25:30.099463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125400+0000","last_change":"2024-04-24T08:25:28.113889+0000","last_active":"2024-04-24T08:25:31.125400+0000","last_peered":"2024-04-24T08:25:31.125400+0000","last_clean":"2024-04-24T08:25:31.125400+0000","last_became_active":"2024-04-24T08:25:28.113629+0000","last_became_peered":"2024-04-24T08:25:28.113629+0000","last_unstale":"2024-04-24T08:25:31.125400+0000","last_undegraded":"2024-04-24T08:25:31.125400+0000","last_fullsized":"2024-04-24T08:25:31.125400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:03:04.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.486955+0000","last_change":"2024-04-24T08:25:27.121672+0000","last_active":"2024-04-24T08:25:29.486955+0000","last_peered":"2024-04-24T08:25:29.486955+0000","last_clean":"2024-04-24T08:25:29.486955+0000","last_became_active":"2024-04-24T08:25:27.121369+0000","last_became_peered":"2024-04-24T08:25:27.121369+0000","last_unstale":"2024-04-24T08:25:29.486955+0000","last_undegraded":"2024-04-24T08:25:29.486955+0000","last_fullsized":"2024-04-24T08:25:29.486955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:56.317954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118783+0000","last_change":"2024-04-24T08:25:28.106699+0000","last_active":"2024-04-24T08:25:29.118783+0000","last_peered":"2024-04-24T08:25:29.118783+0000","last_clean":"2024-04-24T08:25:29.118783+0000","last_became_active":"2024-04-24T08:25:28.106354+0000","last_became_peered":"2024-04-24T08:25:28.106354+0000","last_unstale":"2024-04-24T08:25:29.118783+0000","last_undegraded":"2024-04-24T08:25:29.118783+0000","last_fullsized":"2024-04-24T08:25:29.118783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:57.325390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116843+0000","last_change":"2024-04-24T08:25:27.111525+0000","last_active":"2024-04-24T08:25:29.116843+0000","last_peered":"2024-04-24T08:25:29.116843+0000","last_clean":"2024-04-24T08:25:29.116843+0000","last_became_active":"2024-04-24T08:25:27.111231+0000","last_became_peered":"2024-04-24T08:25:27.111231+0000","last_unstale":"2024-04-24T08:25:29.116843+0000","last_undegraded":"2024-04-24T08:25:29.116843+0000","last_fullsized":"2024-04-24T08:25:29.116843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.051856+0000","last_change":"2024-04-24T08:25:28.129308+0000","last_active":"2024-04-24T08:25:30.051856+0000","last_peered":"2024-04-24T08:25:30.051856+0000","last_clean":"2024-04-24T08:25:30.051856+0000","last_became_active":"2024-04-24T08:25:28.128986+0000","last_became_peered":"2024-04-24T08:25:28.128986+0000","last_unstale":"2024-04-24T08:25:30.051856+0000","last_undegraded":"2024-04-24T08:25:30.051856+0000","last_fullsized":"2024-04-24T08:25:30.051856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:59.080477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116745+0000","last_change":"2024-04-24T08:25:27.109613+0000","last_active":"2024-04-24T08:25:29.116745+0000","last_peered":"2024-04-24T08:25:29.116745+0000","last_clean":"2024-04-24T08:25:29.116745+0000","last_became_active":"2024-04-24T08:25:27.107506+0000","last_became_peered":"2024-04-24T08:25:27.107506+0000","last_unstale":"2024-04-24T08:25:29.116745+0000","last_undegraded":"2024-04-24T08:25:29.116745+0000","last_fullsized":"2024-04-24T08:25:29.116745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:29.798274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052040+0000","last_change":"2024-04-24T08:25:28.128233+0000","last_active":"2024-04-24T08:25:30.052040+0000","last_peered":"2024-04-24T08:25:30.052040+0000","last_clean":"2024-04-24T08:25:30.052040+0000","last_became_active":"2024-04-24T08:25:28.127913+0000","last_became_peered":"2024-04-24T08:25:28.127913+0000","last_unstale":"2024-04-24T08:25:30.052040+0000","last_undegraded":"2024-04-24T08:25:30.052040+0000","last_fullsized":"2024-04-24T08:25:30.052040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487966+0000","last_change":"2024-04-24T08:25:27.121377+0000","last_active":"2024-04-24T08:25:29.487966+0000","last_peered":"2024-04-24T08:25:29.487966+0000","last_clean":"2024-04-24T08:25:29.487966+0000","last_became_active":"2024-04-24T08:25:27.121049+0000","last_became_peered":"2024-04-24T08:25:27.121049+0000","last_unstale":"2024-04-24T08:25:29.487966+0000","last_undegraded":"2024-04-24T08:25:29.487966+0000","last_fullsized":"2024-04-24T08:25:29.487966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099150+0000","last_change":"2024-04-24T08:25:28.127139+0000","last_active":"2024-04-24T08:25:30.099150+0000","last_peered":"2024-04-24T08:25:30.099150+0000","last_clean":"2024-04-24T08:25:30.099150+0000","last_became_active":"2024-04-24T08:25:28.126833+0000","last_became_peered":"2024-04-24T08:25:28.126833+0000","last_unstale":"2024-04-24T08:25:30.099150+0000","last_undegraded":"2024-04-24T08:25:30.099150+0000","last_fullsized":"2024-04-24T08:25:30.099150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:18.585938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119528+0000","last_change":"2024-04-24T08:25:28.113682+0000","last_active":"2024-04-24T08:25:29.119528+0000","last_peered":"2024-04-24T08:25:29.119528+0000","last_clean":"2024-04-24T08:25:29.119528+0000","last_became_active":"2024-04-24T08:25:28.113390+0000","last_became_peered":"2024-04-24T08:25:28.113390+0000","last_unstale":"2024-04-24T08:25:29.119528+0000","last_undegraded":"2024-04-24T08:25:29.119528+0000","last_fullsized":"2024-04-24T08:25:29.119528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:05:08.000888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487266+0000","last_change":"2024-04-24T08:25:27.121448+0000","last_active":"2024-04-24T08:25:29.487266+0000","last_peered":"2024-04-24T08:25:29.487266+0000","last_clean":"2024-04-24T08:25:29.487266+0000","last_became_active":"2024-04-24T08:25:27.121179+0000","last_became_peered":"2024-04-24T08:25:27.121179+0000","last_unstale":"2024-04-24T08:25:29.487266+0000","last_undegraded":"2024-04-24T08:25:29.487266+0000","last_fullsized":"2024-04-24T08:25:29.487266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119084+0000","last_change":"2024-04-24T08:25:28.113033+0000","last_active":"2024-04-24T08:25:29.119084+0000","last_peered":"2024-04-24T08:25:29.119084+0000","last_clean":"2024-04-24T08:25:29.119084+0000","last_became_active":"2024-04-24T08:25:28.112690+0000","last_became_peered":"2024-04-24T08:25:28.112690+0000","last_unstale":"2024-04-24T08:25:29.119084+0000","last_undegraded":"2024-04-24T08:25:29.119084+0000","last_fullsized":"2024-04-24T08:25:29.119084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:08:53.886358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487430+0000","last_change":"2024-04-24T08:25:27.123655+0000","last_active":"2024-04-24T08:25:29.487430+0000","last_peered":"2024-04-24T08:25:29.487430+0000","last_clean":"2024-04-24T08:25:29.487430+0000","last_became_active":"2024-04-24T08:25:27.123349+0000","last_became_peered":"2024-04-24T08:25:27.123349+0000","last_unstale":"2024-04-24T08:25:29.487430+0000","last_undegraded":"2024-04-24T08:25:29.487430+0000","last_fullsized":"2024-04-24T08:25:29.487430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:53.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125409+0000","last_change":"2024-04-24T08:25:28.108443+0000","last_active":"2024-04-24T08:25:31.125409+0000","last_peered":"2024-04-24T08:25:31.125409+0000","last_clean":"2024-04-24T08:25:31.125409+0000","last_became_active":"2024-04-24T08:25:28.108128+0000","last_became_peered":"2024-04-24T08:25:28.108128+0000","last_unstale":"2024-04-24T08:25:31.125409+0000","last_undegraded":"2024-04-24T08:25:31.125409+0000","last_fullsized":"2024-04-24T08:25:31.125409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052423+0000","last_change":"2024-04-24T08:25:27.114010+0000","last_active":"2024-04-24T08:25:30.052423+0000","last_peered":"2024-04-24T08:25:30.052423+0000","last_clean":"2024-04-24T08:25:30.052423+0000","last_became_active":"2024-04-24T08:25:27.113724+0000","last_became_peered":"2024-04-24T08:25:27.113724+0000","last_unstale":"2024-04-24T08:25:30.052423+0000","last_undegraded":"2024-04-24T08:25:30.052423+0000","last_fullsized":"2024-04-24T08:25:30.052423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:49.837612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052336+0000","last_change":"2024-04-24T08:25:28.130070+0000","last_active":"2024-04-24T08:25:30.052336+0000","last_peered":"2024-04-24T08:25:30.052336+0000","last_clean":"2024-04-24T08:25:30.052336+0000","last_became_active":"2024-04-24T08:25:28.129768+0000","last_became_peered":"2024-04-24T08:25:28.129768+0000","last_unstale":"2024-04-24T08:25:30.052336+0000","last_undegraded":"2024-04-24T08:25:30.052336+0000","last_fullsized":"2024-04-24T08:25:30.052336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:27:07.262422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125630+0000","last_change":"2024-04-24T08:25:27.112094+0000","last_active":"2024-04-24T08:25:31.125630+0000","last_peered":"2024-04-24T08:25:31.125630+0000","last_clean":"2024-04-24T08:25:31.125630+0000","last_became_active":"2024-04-24T08:25:27.111795+0000","last_became_peered":"2024-04-24T08:25:27.111795+0000","last_unstale":"2024-04-24T08:25:31.125630+0000","last_undegraded":"2024-04-24T08:25:31.125630+0000","last_fullsized":"2024-04-24T08:25:31.125630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:24.009056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:25:36.850 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:25:37.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.018+0000 7fa5c9a00640 1 Processor -- start 2024-04-24T08:25:37.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.018+0000 7fa5c9a00640 1 -- start start 2024-04-24T08:25:37.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c9a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5c406bd30 0x7fa5c40b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c9a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5c4071370 0x7fa5c4141e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c9a00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c406c110 con 0x7fa5c40735c0 2024-04-24T08:25:37.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c9a00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c4072e50 con 0x7fa5c406bd30 2024-04-24T08:25:37.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c9a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c4071a80 con 0x7fa5c4071370 2024-04-24T08:25:37.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c3400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa5c40735c0 0x7fa5c4141750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59664/0 (socket says 172.21.15.88:59664) 2024-04-24T08:25:37.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c3400640 1 -- 172.21.15.88:0/4025627834 learned_addr learned my addr 172.21.15.88:0/4025627834 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:37.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c3e00640 1 --2- 172.21.15.88:0/4025627834 >> v2:172.21.15.88:3300/0 conn(0x7fa5c406bd30 0x7fa5c40b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c3e00640 1 -- 172.21.15.88:0/4025627834 >> v2:172.21.15.142:3300/0 conn(0x7fa5c4071370 msgr2=0x7fa5c4141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c3e00640 1 --2- 172.21.15.88:0/4025627834 >> v2:172.21.15.142:3300/0 conn(0x7fa5c4071370 0x7fa5c4141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c3e00640 1 -- 172.21.15.88:0/4025627834 >> v1:172.21.15.88:6789/0 conn(0x7fa5c40735c0 legacy=0x7fa5c4141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c3e00640 1 -- 172.21.15.88:0/4025627834 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c4071d60 con 0x7fa5c406bd30 2024-04-24T08:25:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.022+0000 7fa5c2a00640 1 -- 172.21.15.88:0/4025627834 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484925185 0 0) 0x7fa5c406c110 con 0x7fa5c40735c0 2024-04-24T08:25:37.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c3e00640 1 --2- 172.21.15.88:0/4025627834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5c406bd30 0x7fa5c40b0ed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40734a0 tx=0x7fa5b401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7431cb64917af7fb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:37.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c2a00640 1 -- 172.21.15.88:0/4025627834 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40b1070 con 0x7fa5c406bd30 2024-04-24T08:25:37.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c2a00640 1 -- 172.21.15.88:0/4025627834 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b40ac5f0 con 0x7fa5c406bd30 2024-04-24T08:25:37.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c2a00640 1 -- 172.21.15.88:0/4025627834 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40ac9c0 con 0x7fa5c406bd30 2024-04-24T08:25:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 -- 172.21.15.88:0/4025627834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5c406bd30 msgr2=0x7fa5c40b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 --2- 172.21.15.88:0/4025627834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5c406bd30 0x7fa5c40b0ed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40734a0 tx=0x7fa5b401c480 comp rx=0 tx=0).stop 2024-04-24T08:25:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 -- 172.21.15.88:0/4025627834 shutdown_connections 2024-04-24T08:25:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 --2- 172.21.15.88:0/4025627834 >> v2:172.21.15.142:3300/0 conn(0x7fa5c4071370 0x7fa5c4141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 --2- 172.21.15.88:0/4025627834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5c406bd30 0x7fa5c40b0ed0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 -- 172.21.15.88:0/4025627834 >> 172.21.15.88:0/4025627834 conn(0x7fa5c40ba300 msgr2=0x7fa5c40ba710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 -- 172.21.15.88:0/4025627834 shutdown_connections 2024-04-24T08:25:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 -- 172.21.15.88:0/4025627834 wait complete. 2024-04-24T08:25:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 Processor -- start 2024-04-24T08:25:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 -- start start 2024-04-24T08:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5c406bd30 0x7fa5c41e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5c4071370 0x7fa5c413b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c40735c0 0x7fa5c413b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c40b6930 con 0x7fa5c406bd30 2024-04-24T08:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c40b67b0 con 0x7fa5c40735c0 2024-04-24T08:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c9a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c4154c50 con 0x7fa5c4071370 2024-04-24T08:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.026+0000 7fa5c3e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5c406bd30 0x7fa5c41e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c3e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5c406bd30 0x7fa5c41e35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34970/0 (socket says 172.21.15.88:34970) 2024-04-24T08:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c3e00640 1 -- 172.21.15.88:0/2604433601 learned_addr learned my addr 172.21.15.88:0/2604433601 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c3400640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5c4071370 0x7fa5c413b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c9000640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c40735c0 0x7fa5c413b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c3e00640 1 -- 172.21.15.88:0/2604433601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5c4071370 msgr2=0x7fa5c413b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c3e00640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5c4071370 0x7fa5c413b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c3e00640 1 -- 172.21.15.88:0/2604433601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c40735c0 msgr2=0x7fa5c413b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c3e00640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c40735c0 0x7fa5c413b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c3e00640 1 -- 172.21.15.88:0/2604433601 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c40b19a0 con 0x7fa5c406bd30 2024-04-24T08:25:37.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c3e00640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5c406bd30 0x7fa5c41e35c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa5b401c960 tx=0x7fa5b4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:37.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5bbe00640 1 -- 172.21.15.88:0/2604433601 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40b9020 con 0x7fa5c406bd30 2024-04-24T08:25:37.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5bbe00640 1 -- 172.21.15.88:0/2604433601 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b40b5410 con 0x7fa5c406bd30 2024-04-24T08:25:37.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5bbe00640 1 -- 172.21.15.88:0/2604433601 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40b1040 con 0x7fa5c406bd30 2024-04-24T08:25:37.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c9a00640 1 -- 172.21.15.88:0/2604433601 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c413a900 con 0x7fa5c406bd30 2024-04-24T08:25:37.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c9a00640 1 -- 172.21.15.88:0/2604433601 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c413ab80 con 0x7fa5c406bd30 2024-04-24T08:25:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5c9a00640 1 -- 172.21.15.88:0/2604433601 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c4069230 con 0x7fa5c406bd30 2024-04-24T08:25:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.030+0000 7fa5bbe00640 1 -- 172.21.15.88:0/2604433601 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa5b40bc020 con 0x7fa5c406bd30 2024-04-24T08:25:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.034+0000 7fa5bbe00640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa5a4068380 0x7fa5a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.034+0000 7fa5bbe00640 1 -- 172.21.15.88:0/2604433601 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa5b41206a0 con 0x7fa5c406bd30 2024-04-24T08:25:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.034+0000 7fa5c3400640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa5a4068380 0x7fa5a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.034+0000 7fa5c3400640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa5a4068380 0x7fa5a406a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa5c413c1e0 tx=0x7fa5b0007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.038+0000 7fa5bbe00640 1 -- 172.21.15.88:0/2604433601 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa5b40c3030 con 0x7fa5c406bd30 2024-04-24T08:25:37.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.190+0000 7fa5c9a00640 1 -- 172.21.15.88:0/2604433601 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa5c40b5310 con 0x7fa5a4068380 2024-04-24T08:25:37.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.198+0000 7fa5bbe00640 1 -- 172.21.15.88:0/2604433601 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fa5c40b5310 con 0x7fa5a4068380 2024-04-24T08:25:37.200 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:37.201 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:25:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.198+0000 7fa5c9a00640 1 -- 172.21.15.88:0/2604433601 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa5a4068380 msgr2=0x7fa5a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.198+0000 7fa5c9a00640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa5a4068380 0x7fa5a406a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa5c413c1e0 tx=0x7fa5b0007c10 comp rx=0 tx=0).stop 2024-04-24T08:25:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.198+0000 7fa5c9a00640 1 -- 172.21.15.88:0/2604433601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5c406bd30 msgr2=0x7fa5c41e35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.198+0000 7fa5c9a00640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5c406bd30 0x7fa5c41e35c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa5b401c960 tx=0x7fa5b4019220 comp rx=0 tx=0).stop 2024-04-24T08:25:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.202+0000 7fa5c9a00640 1 -- 172.21.15.88:0/2604433601 shutdown_connections 2024-04-24T08:25:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.202+0000 7fa5c9a00640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa5a4068380 0x7fa5a406a840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.202+0000 7fa5c9a00640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c40735c0 0x7fa5c413b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.202+0000 7fa5c9a00640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5c4071370 0x7fa5c413b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.202+0000 7fa5c9a00640 1 --2- 172.21.15.88:0/2604433601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5c406bd30 0x7fa5c41e35c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.202+0000 7fa5c9a00640 1 -- 172.21.15.88:0/2604433601 >> 172.21.15.88:0/2604433601 conn(0x7fa5c40ba300 msgr2=0x7fa5c4074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.202+0000 7fa5c9a00640 1 -- 172.21.15.88:0/2604433601 shutdown_connections 2024-04-24T08:25:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.202+0000 7fa5c9a00640 1 -- 172.21.15.88:0/2604433601 wait complete. 2024-04-24T08:25:37.221 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-24T08:25:36.989804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.897130"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487790+0000","last_change":"2024-04-24T08:25:28.122966+0000","last_active":"2024-04-24T08:25:29.487790+0000","last_peered":"2024-04-24T08:25:29.487790+0000","last_clean":"2024-04-24T08:25:29.487790+0000","last_became_active":"2024-04-24T08:25:28.122377+0000","last_became_peered":"2024-04-24T08:25:28.122377+0000","last_unstale":"2024-04-24T08:25:29.487790+0000","last_undegraded":"2024-04-24T08:25:29.487790+0000","last_fullsized":"2024-04-24T08:25:29.487790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:18.049288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116977+0000","last_change":"2024-04-24T08:25:28.107616+0000","last_active":"2024-04-24T08:25:29.116977+0000","last_peered":"2024-04-24T08:25:29.116977+0000","last_clean":"2024-04-24T08:25:29.116977+0000","last_became_active":"2024-04-24T08:25:28.107282+0000","last_became_peered":"2024-04-24T08:25:28.107282+0000","last_unstale":"2024-04-24T08:25:29.116977+0000","last_undegraded":"2024-04-24T08:25:29.116977+0000","last_fullsized":"2024-04-24T08:25:29.116977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125214+0000","last_change":"2024-04-24T08:25:28.107850+0000","last_active":"2024-04-24T08:25:31.125214+0000","last_peered":"2024-04-24T08:25:31.125214+0000","last_clean":"2024-04-24T08:25:31.125214+0000","last_became_active":"2024-04-24T08:25:28.105595+0000","last_became_peered":"2024-04-24T08:25:28.105595+0000","last_unstale":"2024-04-24T08:25:31.125214+0000","last_undegraded":"2024-04-24T08:25:31.125214+0000","last_fullsized":"2024-04-24T08:25:31.125214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:18.585938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118650+0000","last_change":"2024-04-24T08:25:28.131587+0000","last_active":"2024-04-24T08:25:29.118650+0000","last_peered":"2024-04-24T08:25:29.118650+0000","last_clean":"2024-04-24T08:25:29.118650+0000","last_became_active":"2024-04-24T08:25:28.131271+0000","last_became_peered":"2024-04-24T08:25:28.131271+0000","last_unstale":"2024-04-24T08:25:29.118650+0000","last_undegraded":"2024-04-24T08:25:29.118650+0000","last_fullsized":"2024-04-24T08:25:29.118650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:17.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487906+0000","last_change":"2024-04-24T08:25:28.119186+0000","last_active":"2024-04-24T08:25:29.487906+0000","last_peered":"2024-04-24T08:25:29.487906+0000","last_clean":"2024-04-24T08:25:29.487906+0000","last_became_active":"2024-04-24T08:25:28.118470+0000","last_became_peered":"2024-04-24T08:25:28.118470+0000","last_unstale":"2024-04-24T08:25:29.487906+0000","last_undegraded":"2024-04-24T08:25:29.487906+0000","last_fullsized":"2024-04-24T08:25:29.487906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:08:53.886358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118414+0000","last_change":"2024-04-24T08:25:28.110827+0000","last_active":"2024-04-24T08:25:29.118414+0000","last_peered":"2024-04-24T08:25:29.118414+0000","last_clean":"2024-04-24T08:25:29.118414+0000","last_became_active":"2024-04-24T08:25:28.110542+0000","last_became_peered":"2024-04-24T08:25:28.110542+0000","last_unstale":"2024-04-24T08:25:29.118414+0000","last_undegraded":"2024-04-24T08:25:29.118414+0000","last_fullsized":"2024-04-24T08:25:29.118414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487112+0000","last_change":"2024-04-24T08:25:28.122530+0000","last_active":"2024-04-24T08:25:29.487112+0000","last_peered":"2024-04-24T08:25:29.487112+0000","last_clean":"2024-04-24T08:25:29.487112+0000","last_became_active":"2024-04-24T08:25:28.121676+0000","last_became_peered":"2024-04-24T08:25:28.121676+0000","last_unstale":"2024-04-24T08:25:29.487112+0000","last_undegraded":"2024-04-24T08:25:29.487112+0000","last_fullsized":"2024-04-24T08:25:29.487112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:27:07.262422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.051643+0000","last_change":"2024-04-24T08:25:28.133406+0000","last_active":"2024-04-24T08:25:30.051643+0000","last_peered":"2024-04-24T08:25:30.051643+0000","last_clean":"2024-04-24T08:25:30.051643+0000","last_became_active":"2024-04-24T08:25:28.132708+0000","last_became_peered":"2024-04-24T08:25:28.132708+0000","last_unstale":"2024-04-24T08:25:30.051643+0000","last_undegraded":"2024-04-24T08:25:30.051643+0000","last_fullsized":"2024-04-24T08:25:30.051643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:08:11.270207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487778+0000","last_change":"2024-04-24T08:25:28.126548+0000","last_active":"2024-04-24T08:25:29.487778+0000","last_peered":"2024-04-24T08:25:29.487778+0000","last_clean":"2024-04-24T08:25:29.487778+0000","last_became_active":"2024-04-24T08:25:28.126116+0000","last_became_peered":"2024-04-24T08:25:28.126116+0000","last_unstale":"2024-04-24T08:25:29.487778+0000","last_undegraded":"2024-04-24T08:25:29.487778+0000","last_fullsized":"2024-04-24T08:25:29.487778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:09.839576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099516+0000","last_change":"2024-04-24T08:25:28.117731+0000","last_active":"2024-04-24T08:25:30.099516+0000","last_peered":"2024-04-24T08:25:30.099516+0000","last_clean":"2024-04-24T08:25:30.099516+0000","last_became_active":"2024-04-24T08:25:28.116901+0000","last_became_peered":"2024-04-24T08:25:28.116901+0000","last_unstale":"2024-04-24T08:25:30.099516+0000","last_undegraded":"2024-04-24T08:25:30.099516+0000","last_fullsized":"2024-04-24T08:25:30.099516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099299+0000","last_change":"2024-04-24T08:25:28.120314+0000","last_active":"2024-04-24T08:25:30.099299+0000","last_peered":"2024-04-24T08:25:30.099299+0000","last_clean":"2024-04-24T08:25:30.099299+0000","last_became_active":"2024-04-24T08:25:28.118691+0000","last_became_peered":"2024-04-24T08:25:28.118691+0000","last_unstale":"2024-04-24T08:25:30.099299+0000","last_undegraded":"2024-04-24T08:25:30.099299+0000","last_fullsized":"2024-04-24T08:25:30.099299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:59.080477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.120168+0000","last_change":"2024-04-24T08:25:28.126862+0000","last_active":"2024-04-24T08:25:29.120168+0000","last_peered":"2024-04-24T08:25:29.120168+0000","last_clean":"2024-04-24T08:25:29.120168+0000","last_became_active":"2024-04-24T08:25:28.126543+0000","last_became_peered":"2024-04-24T08:25:28.126543+0000","last_unstale":"2024-04-24T08:25:29.120168+0000","last_undegraded":"2024-04-24T08:25:29.120168+0000","last_fullsized":"2024-04-24T08:25:29.120168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:54.349880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052012+0000","last_change":"2024-04-24T08:25:28.127815+0000","last_active":"2024-04-24T08:25:30.052012+0000","last_peered":"2024-04-24T08:25:30.052012+0000","last_clean":"2024-04-24T08:25:30.052012+0000","last_became_active":"2024-04-24T08:25:28.127026+0000","last_became_peered":"2024-04-24T08:25:28.127026+0000","last_unstale":"2024-04-24T08:25:30.052012+0000","last_undegraded":"2024-04-24T08:25:30.052012+0000","last_fullsized":"2024-04-24T08:25:30.052012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.124572+0000","last_change":"2024-04-24T08:25:28.110471+0000","last_active":"2024-04-24T08:25:31.124572+0000","last_peered":"2024-04-24T08:25:31.124572+0000","last_clean":"2024-04-24T08:25:31.124572+0000","last_became_active":"2024-04-24T08:25:28.109175+0000","last_became_peered":"2024-04-24T08:25:28.109175+0000","last_unstale":"2024-04-24T08:25:31.124572+0000","last_undegraded":"2024-04-24T08:25:31.124572+0000","last_fullsized":"2024-04-24T08:25:31.124572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:43:07.823084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116748+0000","last_change":"2024-04-24T08:25:28.115093+0000","last_active":"2024-04-24T08:25:29.116748+0000","last_peered":"2024-04-24T08:25:29.116748+0000","last_clean":"2024-04-24T08:25:29.116748+0000","last_became_active":"2024-04-24T08:25:28.114782+0000","last_became_peered":"2024-04-24T08:25:28.114782+0000","last_unstale":"2024-04-24T08:25:29.116748+0000","last_undegraded":"2024-04-24T08:25:29.116748+0000","last_fullsized":"2024-04-24T08:25:29.116748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:03:04.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118502+0000","last_change":"2024-04-24T08:25:28.108967+0000","last_active":"2024-04-24T08:25:29.118502+0000","last_peered":"2024-04-24T08:25:29.118502+0000","last_clean":"2024-04-24T08:25:29.118502+0000","last_became_active":"2024-04-24T08:25:28.108627+0000","last_became_peered":"2024-04-24T08:25:28.108627+0000","last_unstale":"2024-04-24T08:25:29.118502+0000","last_undegraded":"2024-04-24T08:25:29.118502+0000","last_fullsized":"2024-04-24T08:25:29.118502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:01:48.875146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119667+0000","last_change":"2024-04-24T08:25:28.120983+0000","last_active":"2024-04-24T08:25:29.119667+0000","last_peered":"2024-04-24T08:25:29.119667+0000","last_clean":"2024-04-24T08:25:29.119667+0000","last_became_active":"2024-04-24T08:25:28.120054+0000","last_became_peered":"2024-04-24T08:25:28.120054+0000","last_unstale":"2024-04-24T08:25:29.119667+0000","last_undegraded":"2024-04-24T08:25:29.119667+0000","last_fullsized":"2024-04-24T08:25:29.119667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:09.839576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125424+0000","last_change":"2024-04-24T08:25:28.119368+0000","last_active":"2024-04-24T08:25:31.125424+0000","last_peered":"2024-04-24T08:25:31.125424+0000","last_clean":"2024-04-24T08:25:31.125424+0000","last_became_active":"2024-04-24T08:25:28.118968+0000","last_became_peered":"2024-04-24T08:25:28.118968+0000","last_unstale":"2024-04-24T08:25:31.125424+0000","last_undegraded":"2024-04-24T08:25:31.125424+0000","last_fullsized":"2024-04-24T08:25:31.125424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:46.419388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487555+0000","last_change":"2024-04-24T08:25:28.136211+0000","last_active":"2024-04-24T08:25:29.487555+0000","last_peered":"2024-04-24T08:25:29.487555+0000","last_clean":"2024-04-24T08:25:29.487555+0000","last_became_active":"2024-04-24T08:25:28.135915+0000","last_became_peered":"2024-04-24T08:25:28.135915+0000","last_unstale":"2024-04-24T08:25:29.487555+0000","last_undegraded":"2024-04-24T08:25:29.487555+0000","last_fullsized":"2024-04-24T08:25:29.487555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:05:08.000888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099440+0000","last_change":"2024-04-24T08:25:28.128288+0000","last_active":"2024-04-24T08:25:30.099440+0000","last_peered":"2024-04-24T08:25:30.099440+0000","last_clean":"2024-04-24T08:25:30.099440+0000","last_became_active":"2024-04-24T08:25:28.127975+0000","last_became_peered":"2024-04-24T08:25:28.127975+0000","last_unstale":"2024-04-24T08:25:30.099440+0000","last_undegraded":"2024-04-24T08:25:30.099440+0000","last_fullsized":"2024-04-24T08:25:30.099440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:03:04.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125104+0000","last_change":"2024-04-24T08:25:28.119997+0000","last_active":"2024-04-24T08:25:31.125104+0000","last_peered":"2024-04-24T08:25:31.125104+0000","last_clean":"2024-04-24T08:25:31.125104+0000","last_became_active":"2024-04-24T08:25:28.119394+0000","last_became_peered":"2024-04-24T08:25:28.119394+0000","last_unstale":"2024-04-24T08:25:31.125104+0000","last_undegraded":"2024-04-24T08:25:31.125104+0000","last_fullsized":"2024-04-24T08:25:31.125104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:08:11.270207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118478+0000","last_change":"2024-04-24T08:25:28.115607+0000","last_active":"2024-04-24T08:25:29.118478+0000","last_peered":"2024-04-24T08:25:29.118478+0000","last_clean":"2024-04-24T08:25:29.118478+0000","last_became_active":"2024-04-24T08:25:28.115310+0000","last_became_peered":"2024-04-24T08:25:28.115310+0000","last_unstale":"2024-04-24T08:25:29.118478+0000","last_undegraded":"2024-04-24T08:25:29.118478+0000","last_fullsized":"2024-04-24T08:25:29.118478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.051801+0000","last_change":"2024-04-24T08:25:28.129517+0000","last_active":"2024-04-24T08:25:30.051801+0000","last_peered":"2024-04-24T08:25:30.051801+0000","last_clean":"2024-04-24T08:25:30.051801+0000","last_became_active":"2024-04-24T08:25:28.129258+0000","last_became_peered":"2024-04-24T08:25:28.129258+0000","last_unstale":"2024-04-24T08:25:30.051801+0000","last_undegraded":"2024-04-24T08:25:30.051801+0000","last_fullsized":"2024-04-24T08:25:30.051801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:37:01.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118686+0000","last_change":"2024-04-24T08:25:28.129391+0000","last_active":"2024-04-24T08:25:29.118686+0000","last_peered":"2024-04-24T08:25:29.118686+0000","last_clean":"2024-04-24T08:25:29.118686+0000","last_became_active":"2024-04-24T08:25:28.128991+0000","last_became_peered":"2024-04-24T08:25:28.128991+0000","last_unstale":"2024-04-24T08:25:29.118686+0000","last_undegraded":"2024-04-24T08:25:29.118686+0000","last_fullsized":"2024-04-24T08:25:29.118686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:39.021977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052390+0000","last_change":"2024-04-24T08:25:28.132732+0000","last_active":"2024-04-24T08:25:30.052390+0000","last_peered":"2024-04-24T08:25:30.052390+0000","last_clean":"2024-04-24T08:25:30.052390+0000","last_became_active":"2024-04-24T08:25:28.132493+0000","last_became_peered":"2024-04-24T08:25:28.132493+0000","last_unstale":"2024-04-24T08:25:30.052390+0000","last_undegraded":"2024-04-24T08:25:30.052390+0000","last_fullsized":"2024-04-24T08:25:30.052390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:17.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099597+0000","last_change":"2024-04-24T08:25:28.118797+0000","last_active":"2024-04-24T08:25:30.099597+0000","last_peered":"2024-04-24T08:25:30.099597+0000","last_clean":"2024-04-24T08:25:30.099597+0000","last_became_active":"2024-04-24T08:25:28.118073+0000","last_became_peered":"2024-04-24T08:25:28.118073+0000","last_unstale":"2024-04-24T08:25:30.099597+0000","last_undegraded":"2024-04-24T08:25:30.099597+0000","last_fullsized":"2024-04-24T08:25:30.099597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116765+0000","last_change":"2024-04-24T08:25:28.131235+0000","last_active":"2024-04-24T08:25:29.116765+0000","last_peered":"2024-04-24T08:25:29.116765+0000","last_clean":"2024-04-24T08:25:29.116765+0000","last_became_active":"2024-04-24T08:25:28.130932+0000","last_became_peered":"2024-04-24T08:25:28.130932+0000","last_unstale":"2024-04-24T08:25:29.116765+0000","last_undegraded":"2024-04-24T08:25:29.116765+0000","last_fullsized":"2024-04-24T08:25:29.116765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052262+0000","last_change":"2024-04-24T08:25:28.134992+0000","last_active":"2024-04-24T08:25:30.052262+0000","last_peered":"2024-04-24T08:25:30.052262+0000","last_clean":"2024-04-24T08:25:30.052262+0000","last_became_active":"2024-04-24T08:25:28.134739+0000","last_became_peered":"2024-04-24T08:25:28.134739+0000","last_unstale":"2024-04-24T08:25:30.052262+0000","last_undegraded":"2024-04-24T08:25:30.052262+0000","last_fullsized":"2024-04-24T08:25:30.052262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:01:48.875146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125188+0000","last_change":"2024-04-24T08:25:28.131466+0000","last_active":"2024-04-24T08:25:31.125188+0000","last_peered":"2024-04-24T08:25:31.125188+0000","last_clean":"2024-04-24T08:25:31.125188+0000","last_became_active":"2024-04-24T08:25:28.131050+0000","last_became_peered":"2024-04-24T08:25:28.131050+0000","last_unstale":"2024-04-24T08:25:31.125188+0000","last_undegraded":"2024-04-24T08:25:31.125188+0000","last_fullsized":"2024-04-24T08:25:31.125188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:37:01.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118638+0000","last_change":"2024-04-24T08:25:28.136036+0000","last_active":"2024-04-24T08:25:29.118638+0000","last_peered":"2024-04-24T08:25:29.118638+0000","last_clean":"2024-04-24T08:25:29.118638+0000","last_became_active":"2024-04-24T08:25:28.135525+0000","last_became_peered":"2024-04-24T08:25:28.135525+0000","last_unstale":"2024-04-24T08:25:29.118638+0000","last_undegraded":"2024-04-24T08:25:29.118638+0000","last_fullsized":"2024-04-24T08:25:29.118638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:27:07.262422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.124554+0000","last_change":"2024-04-24T08:25:28.114519+0000","last_active":"2024-04-24T08:25:31.124554+0000","last_peered":"2024-04-24T08:25:31.124554+0000","last_clean":"2024-04-24T08:25:31.124554+0000","last_became_active":"2024-04-24T08:25:28.114247+0000","last_became_peered":"2024-04-24T08:25:28.114247+0000","last_unstale":"2024-04-24T08:25:31.124554+0000","last_undegraded":"2024-04-24T08:25:31.124554+0000","last_fullsized":"2024-04-24T08:25:31.124554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:54.349880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099120+0000","last_change":"2024-04-24T08:25:28.123399+0000","last_active":"2024-04-24T08:25:30.099120+0000","last_peered":"2024-04-24T08:25:30.099120+0000","last_clean":"2024-04-24T08:25:30.099120+0000","last_became_active":"2024-04-24T08:25:28.123078+0000","last_became_peered":"2024-04-24T08:25:28.123078+0000","last_unstale":"2024-04-24T08:25:30.099120+0000","last_undegraded":"2024-04-24T08:25:30.099120+0000","last_fullsized":"2024-04-24T08:25:30.099120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:08:11.270207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119086+0000","last_change":"2024-04-24T08:25:28.106959+0000","last_active":"2024-04-24T08:25:29.119086+0000","last_peered":"2024-04-24T08:25:29.119086+0000","last_clean":"2024-04-24T08:25:29.119086+0000","last_became_active":"2024-04-24T08:25:28.106686+0000","last_became_peered":"2024-04-24T08:25:28.106686+0000","last_unstale":"2024-04-24T08:25:29.119086+0000","last_undegraded":"2024-04-24T08:25:29.119086+0000","last_fullsized":"2024-04-24T08:25:29.119086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:07.862635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052088+0000","last_change":"2024-04-24T08:25:27.115877+0000","last_active":"2024-04-24T08:25:30.052088+0000","last_peered":"2024-04-24T08:25:30.052088+0000","last_clean":"2024-04-24T08:25:30.052088+0000","last_became_active":"2024-04-24T08:25:27.115544+0000","last_became_peered":"2024-04-24T08:25:27.115544+0000","last_unstale":"2024-04-24T08:25:30.052088+0000","last_undegraded":"2024-04-24T08:25:30.052088+0000","last_fullsized":"2024-04-24T08:25:30.052088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:24.009056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125309+0000","last_change":"2024-04-24T08:25:28.120172+0000","last_active":"2024-04-24T08:25:31.125309+0000","last_peered":"2024-04-24T08:25:31.125309+0000","last_clean":"2024-04-24T08:25:31.125309+0000","last_became_active":"2024-04-24T08:25:28.119756+0000","last_became_peered":"2024-04-24T08:25:28.119756+0000","last_unstale":"2024-04-24T08:25:31.125309+0000","last_undegraded":"2024-04-24T08:25:31.125309+0000","last_fullsized":"2024-04-24T08:25:31.125309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:59.080477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099195+0000","last_change":"2024-04-24T08:25:27.123186+0000","last_active":"2024-04-24T08:25:30.099195+0000","last_peered":"2024-04-24T08:25:30.099195+0000","last_clean":"2024-04-24T08:25:30.099195+0000","last_became_active":"2024-04-24T08:25:27.122910+0000","last_became_peered":"2024-04-24T08:25:27.122910+0000","last_unstale":"2024-04-24T08:25:30.099195+0000","last_undegraded":"2024-04-24T08:25:30.099195+0000","last_fullsized":"2024-04-24T08:25:30.099195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.051885+0000","last_change":"2024-04-24T08:25:27.120630+0000","last_active":"2024-04-24T08:25:30.051885+0000","last_peered":"2024-04-24T08:25:30.051885+0000","last_clean":"2024-04-24T08:25:30.051885+0000","last_became_active":"2024-04-24T08:25:27.119902+0000","last_became_peered":"2024-04-24T08:25:27.119902+0000","last_unstale":"2024-04-24T08:25:30.051885+0000","last_undegraded":"2024-04-24T08:25:30.051885+0000","last_fullsized":"2024-04-24T08:25:30.051885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:59:36.122581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.051826+0000","last_change":"2024-04-24T08:25:28.131546+0000","last_active":"2024-04-24T08:25:30.051826+0000","last_peered":"2024-04-24T08:25:30.051826+0000","last_clean":"2024-04-24T08:25:30.051826+0000","last_became_active":"2024-04-24T08:25:28.131273+0000","last_became_peered":"2024-04-24T08:25:28.131273+0000","last_unstale":"2024-04-24T08:25:30.051826+0000","last_undegraded":"2024-04-24T08:25:30.051826+0000","last_fullsized":"2024-04-24T08:25:30.051826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:18.585938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118787+0000","last_change":"2024-04-24T08:25:27.107828+0000","last_active":"2024-04-24T08:25:29.118787+0000","last_peered":"2024-04-24T08:25:29.118787+0000","last_clean":"2024-04-24T08:25:29.118787+0000","last_became_active":"2024-04-24T08:25:27.107464+0000","last_became_peered":"2024-04-24T08:25:27.107464+0000","last_unstale":"2024-04-24T08:25:29.118787+0000","last_undegraded":"2024-04-24T08:25:29.118787+0000","last_fullsized":"2024-04-24T08:25:29.118787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:56.317954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116595+0000","last_change":"2024-04-24T08:25:28.129575+0000","last_active":"2024-04-24T08:25:29.116595+0000","last_peered":"2024-04-24T08:25:29.116595+0000","last_clean":"2024-04-24T08:25:29.116595+0000","last_became_active":"2024-04-24T08:25:28.129273+0000","last_became_peered":"2024-04-24T08:25:28.129273+0000","last_unstale":"2024-04-24T08:25:29.116595+0000","last_undegraded":"2024-04-24T08:25:29.116595+0000","last_fullsized":"2024-04-24T08:25:29.116595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:18.585938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099414+0000","last_change":"2024-04-24T08:25:27.119751+0000","last_active":"2024-04-24T08:25:30.099414+0000","last_peered":"2024-04-24T08:25:30.099414+0000","last_clean":"2024-04-24T08:25:30.099414+0000","last_became_active":"2024-04-24T08:25:27.117532+0000","last_became_peered":"2024-04-24T08:25:27.117532+0000","last_unstale":"2024-04-24T08:25:30.099414+0000","last_undegraded":"2024-04-24T08:25:30.099414+0000","last_fullsized":"2024-04-24T08:25:30.099414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119157+0000","last_change":"2024-04-24T08:25:28.114763+0000","last_active":"2024-04-24T08:25:29.119157+0000","last_peered":"2024-04-24T08:25:29.119157+0000","last_clean":"2024-04-24T08:25:29.119157+0000","last_became_active":"2024-04-24T08:25:28.114494+0000","last_became_peered":"2024-04-24T08:25:28.114494+0000","last_unstale":"2024-04-24T08:25:29.119157+0000","last_undegraded":"2024-04-24T08:25:29.119157+0000","last_fullsized":"2024-04-24T08:25:29.119157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:19:25.270847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119337+0000","last_change":"2024-04-24T08:25:27.119512+0000","last_active":"2024-04-24T08:25:29.119337+0000","last_peered":"2024-04-24T08:25:29.119337+0000","last_clean":"2024-04-24T08:25:29.119337+0000","last_became_active":"2024-04-24T08:25:27.119197+0000","last_became_peered":"2024-04-24T08:25:27.119197+0000","last_unstale":"2024-04-24T08:25:29.119337+0000","last_undegraded":"2024-04-24T08:25:29.119337+0000","last_fullsized":"2024-04-24T08:25:29.119337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125520+0000","last_change":"2024-04-24T08:25:28.122927+0000","last_active":"2024-04-24T08:25:31.125520+0000","last_peered":"2024-04-24T08:25:31.125520+0000","last_clean":"2024-04-24T08:25:31.125520+0000","last_became_active":"2024-04-24T08:25:28.122632+0000","last_became_peered":"2024-04-24T08:25:28.122632+0000","last_unstale":"2024-04-24T08:25:31.125520+0000","last_undegraded":"2024-04-24T08:25:31.125520+0000","last_fullsized":"2024-04-24T08:25:31.125520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116822+0000","last_change":"2024-04-24T08:25:27.112537+0000","last_active":"2024-04-24T08:25:29.116822+0000","last_peered":"2024-04-24T08:25:29.116822+0000","last_clean":"2024-04-24T08:25:29.116822+0000","last_became_active":"2024-04-24T08:25:27.112233+0000","last_became_peered":"2024-04-24T08:25:27.112233+0000","last_unstale":"2024-04-24T08:25:29.116822+0000","last_undegraded":"2024-04-24T08:25:29.116822+0000","last_fullsized":"2024-04-24T08:25:29.116822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:45.411953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.120273+0000","last_change":"2024-04-24T08:25:28.125754+0000","last_active":"2024-04-24T08:25:29.120273+0000","last_peered":"2024-04-24T08:25:29.120273+0000","last_clean":"2024-04-24T08:25:29.120273+0000","last_became_active":"2024-04-24T08:25:28.116361+0000","last_became_peered":"2024-04-24T08:25:28.116361+0000","last_unstale":"2024-04-24T08:25:29.120273+0000","last_undegraded":"2024-04-24T08:25:29.120273+0000","last_fullsized":"2024-04-24T08:25:29.120273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:46.419388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099448+0000","last_change":"2024-04-24T08:25:27.118005+0000","last_active":"2024-04-24T08:25:30.099448+0000","last_peered":"2024-04-24T08:25:30.099448+0000","last_clean":"2024-04-24T08:25:30.099448+0000","last_became_active":"2024-04-24T08:25:27.117674+0000","last_became_peered":"2024-04-24T08:25:27.117674+0000","last_unstale":"2024-04-24T08:25:30.099448+0000","last_undegraded":"2024-04-24T08:25:30.099448+0000","last_fullsized":"2024-04-24T08:25:30.099448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:56.317954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487306+0000","last_change":"2024-04-24T08:25:28.133556+0000","last_active":"2024-04-24T08:25:29.487306+0000","last_peered":"2024-04-24T08:25:29.487306+0000","last_clean":"2024-04-24T08:25:29.487306+0000","last_became_active":"2024-04-24T08:25:28.133321+0000","last_became_peered":"2024-04-24T08:25:28.133321+0000","last_unstale":"2024-04-24T08:25:29.487306+0000","last_undegraded":"2024-04-24T08:25:29.487306+0000","last_fullsized":"2024-04-24T08:25:29.487306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:39.021977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125297+0000","last_change":"2024-04-24T08:25:27.112624+0000","last_active":"2024-04-24T08:25:31.125297+0000","last_peered":"2024-04-24T08:25:31.125297+0000","last_clean":"2024-04-24T08:25:31.125297+0000","last_became_active":"2024-04-24T08:25:27.112371+0000","last_became_peered":"2024-04-24T08:25:27.112371+0000","last_unstale":"2024-04-24T08:25:31.125297+0000","last_undegraded":"2024-04-24T08:25:31.125297+0000","last_fullsized":"2024-04-24T08:25:31.125297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:59:36.122581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.124701+0000","last_change":"2024-04-24T08:25:28.121857+0000","last_active":"2024-04-24T08:25:31.124701+0000","last_peered":"2024-04-24T08:25:31.124701+0000","last_clean":"2024-04-24T08:25:31.124701+0000","last_became_active":"2024-04-24T08:25:28.120874+0000","last_became_peered":"2024-04-24T08:25:28.120874+0000","last_unstale":"2024-04-24T08:25:31.124701+0000","last_undegraded":"2024-04-24T08:25:31.124701+0000","last_fullsized":"2024-04-24T08:25:31.124701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:13.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118754+0000","last_change":"2024-04-24T08:25:27.112099+0000","last_active":"2024-04-24T08:25:29.118754+0000","last_peered":"2024-04-24T08:25:29.118754+0000","last_clean":"2024-04-24T08:25:29.118754+0000","last_became_active":"2024-04-24T08:25:27.110637+0000","last_became_peered":"2024-04-24T08:25:27.110637+0000","last_unstale":"2024-04-24T08:25:29.118754+0000","last_undegraded":"2024-04-24T08:25:29.118754+0000","last_fullsized":"2024-04-24T08:25:29.118754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487531+0000","last_change":"2024-04-24T08:25:28.132620+0000","last_active":"2024-04-24T08:25:29.487531+0000","last_peered":"2024-04-24T08:25:29.487531+0000","last_clean":"2024-04-24T08:25:29.487531+0000","last_became_active":"2024-04-24T08:25:28.129548+0000","last_became_peered":"2024-04-24T08:25:28.129548+0000","last_unstale":"2024-04-24T08:25:29.487531+0000","last_undegraded":"2024-04-24T08:25:29.487531+0000","last_fullsized":"2024-04-24T08:25:29.487531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:19:25.270847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099038+0000","last_change":"2024-04-24T08:25:27.118817+0000","last_active":"2024-04-24T08:25:30.099038+0000","last_peered":"2024-04-24T08:25:30.099038+0000","last_clean":"2024-04-24T08:25:30.099038+0000","last_became_active":"2024-04-24T08:25:27.118507+0000","last_became_peered":"2024-04-24T08:25:27.118507+0000","last_unstale":"2024-04-24T08:25:30.099038+0000","last_undegraded":"2024-04-24T08:25:30.099038+0000","last_fullsized":"2024-04-24T08:25:30.099038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:49.812612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099122+0000","last_change":"2024-04-24T08:25:28.123679+0000","last_active":"2024-04-24T08:25:30.099122+0000","last_peered":"2024-04-24T08:25:30.099122+0000","last_clean":"2024-04-24T08:25:30.099122+0000","last_became_active":"2024-04-24T08:25:28.123217+0000","last_became_peered":"2024-04-24T08:25:28.123217+0000","last_unstale":"2024-04-24T08:25:30.099122+0000","last_undegraded":"2024-04-24T08:25:30.099122+0000","last_fullsized":"2024-04-24T08:25:30.099122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:37:01.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.124395+0000","last_change":"2024-04-24T08:25:27.109716+0000","last_active":"2024-04-24T08:25:31.124395+0000","last_peered":"2024-04-24T08:25:31.124395+0000","last_clean":"2024-04-24T08:25:31.124395+0000","last_became_active":"2024-04-24T08:25:27.108346+0000","last_became_peered":"2024-04-24T08:25:27.108346+0000","last_unstale":"2024-04-24T08:25:31.124395+0000","last_undegraded":"2024-04-24T08:25:31.124395+0000","last_fullsized":"2024-04-24T08:25:31.124395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:49.812612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487078+0000","last_change":"2024-04-24T08:25:28.127900+0000","last_active":"2024-04-24T08:25:29.487078+0000","last_peered":"2024-04-24T08:25:29.487078+0000","last_clean":"2024-04-24T08:25:29.487078+0000","last_became_active":"2024-04-24T08:25:28.127563+0000","last_became_peered":"2024-04-24T08:25:28.127563+0000","last_unstale":"2024-04-24T08:25:29.487078+0000","last_undegraded":"2024-04-24T08:25:29.487078+0000","last_fullsized":"2024-04-24T08:25:29.487078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:01:48.875146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119944+0000","last_change":"2024-04-24T08:25:27.114104+0000","last_active":"2024-04-24T08:25:29.119944+0000","last_peered":"2024-04-24T08:25:29.119944+0000","last_clean":"2024-04-24T08:25:29.119944+0000","last_became_active":"2024-04-24T08:25:27.113819+0000","last_became_peered":"2024-04-24T08:25:27.113819+0000","last_unstale":"2024-04-24T08:25:29.119944+0000","last_undegraded":"2024-04-24T08:25:29.119944+0000","last_fullsized":"2024-04-24T08:25:29.119944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:18:10.642911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487665+0000","last_change":"2024-04-24T08:25:28.128545+0000","last_active":"2024-04-24T08:25:29.487665+0000","last_peered":"2024-04-24T08:25:29.487665+0000","last_clean":"2024-04-24T08:25:29.487665+0000","last_became_active":"2024-04-24T08:25:28.126907+0000","last_became_peered":"2024-04-24T08:25:28.126907+0000","last_unstale":"2024-04-24T08:25:29.487665+0000","last_undegraded":"2024-04-24T08:25:29.487665+0000","last_fullsized":"2024-04-24T08:25:29.487665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:55:06.802484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125511+0000","last_change":"2024-04-24T08:25:27.106510+0000","last_active":"2024-04-24T08:25:31.125511+0000","last_peered":"2024-04-24T08:25:31.125511+0000","last_clean":"2024-04-24T08:25:31.125511+0000","last_became_active":"2024-04-24T08:25:27.106199+0000","last_became_peered":"2024-04-24T08:25:27.106199+0000","last_unstale":"2024-04-24T08:25:31.125511+0000","last_undegraded":"2024-04-24T08:25:31.125511+0000","last_fullsized":"2024-04-24T08:25:31.125511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487887+0000","last_change":"2024-04-24T08:25:28.133331+0000","last_active":"2024-04-24T08:25:29.487887+0000","last_peered":"2024-04-24T08:25:29.487887+0000","last_clean":"2024-04-24T08:25:29.487887+0000","last_became_active":"2024-04-24T08:25:28.133026+0000","last_became_peered":"2024-04-24T08:25:28.133026+0000","last_unstale":"2024-04-24T08:25:29.487887+0000","last_undegraded":"2024-04-24T08:25:29.487887+0000","last_fullsized":"2024-04-24T08:25:29.487887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:10:04.737380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116877+0000","last_change":"2024-04-24T08:25:27.106170+0000","last_active":"2024-04-24T08:25:29.116877+0000","last_peered":"2024-04-24T08:25:29.116877+0000","last_clean":"2024-04-24T08:25:29.116877+0000","last_became_active":"2024-04-24T08:25:27.105883+0000","last_became_peered":"2024-04-24T08:25:27.105883+0000","last_unstale":"2024-04-24T08:25:29.116877+0000","last_undegraded":"2024-04-24T08:25:29.116877+0000","last_fullsized":"2024-04-24T08:25:29.116877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:06:07.045350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119611+0000","last_change":"2024-04-24T08:25:28.130670+0000","last_active":"2024-04-24T08:25:29.119611+0000","last_peered":"2024-04-24T08:25:29.119611+0000","last_clean":"2024-04-24T08:25:29.119611+0000","last_became_active":"2024-04-24T08:25:28.130405+0000","last_became_peered":"2024-04-24T08:25:28.130405+0000","last_unstale":"2024-04-24T08:25:29.119611+0000","last_undegraded":"2024-04-24T08:25:29.119611+0000","last_fullsized":"2024-04-24T08:25:29.119611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:55:06.802484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125151+0000","last_change":"2024-04-24T08:25:27.108774+0000","last_active":"2024-04-24T08:25:31.125151+0000","last_peered":"2024-04-24T08:25:31.125151+0000","last_clean":"2024-04-24T08:25:31.125151+0000","last_became_active":"2024-04-24T08:25:27.108368+0000","last_became_peered":"2024-04-24T08:25:27.108368+0000","last_unstale":"2024-04-24T08:25:31.125151+0000","last_undegraded":"2024-04-24T08:25:31.125151+0000","last_fullsized":"2024-04-24T08:25:31.125151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:49.837612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487247+0000","last_change":"2024-04-24T08:25:28.121303+0000","last_active":"2024-04-24T08:25:29.487247+0000","last_peered":"2024-04-24T08:25:29.487247+0000","last_clean":"2024-04-24T08:25:29.487247+0000","last_became_active":"2024-04-24T08:25:28.119922+0000","last_became_peered":"2024-04-24T08:25:28.119922+0000","last_unstale":"2024-04-24T08:25:29.487247+0000","last_undegraded":"2024-04-24T08:25:29.487247+0000","last_fullsized":"2024-04-24T08:25:29.487247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:17.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487067+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:25:29.487067+0000","last_peered":"2024-04-24T08:25:29.487067+0000","last_clean":"2024-04-24T08:25:29.487067+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:25:29.487067+0000","last_undegraded":"2024-04-24T08:25:29.487067+0000","last_fullsized":"2024-04-24T08:25:29.487067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118347+0000","last_change":"2024-04-24T08:25:27.105508+0000","last_active":"2024-04-24T08:25:29.118347+0000","last_peered":"2024-04-24T08:25:29.118347+0000","last_clean":"2024-04-24T08:25:29.118347+0000","last_became_active":"2024-04-24T08:25:27.105128+0000","last_became_peered":"2024-04-24T08:25:27.105128+0000","last_unstale":"2024-04-24T08:25:29.118347+0000","last_undegraded":"2024-04-24T08:25:29.118347+0000","last_fullsized":"2024-04-24T08:25:29.118347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:49.812612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.051951+0000","last_change":"2024-04-24T08:25:28.129776+0000","last_active":"2024-04-24T08:25:30.051951+0000","last_peered":"2024-04-24T08:25:30.051951+0000","last_clean":"2024-04-24T08:25:30.051951+0000","last_became_active":"2024-04-24T08:25:28.127249+0000","last_became_peered":"2024-04-24T08:25:28.127249+0000","last_unstale":"2024-04-24T08:25:30.051951+0000","last_undegraded":"2024-04-24T08:25:30.051951+0000","last_fullsized":"2024-04-24T08:25:30.051951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:03:04.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.486974+0000","last_change":"2024-04-24T08:25:27.118013+0000","last_active":"2024-04-24T08:25:29.486974+0000","last_peered":"2024-04-24T08:25:29.486974+0000","last_clean":"2024-04-24T08:25:29.486974+0000","last_became_active":"2024-04-24T08:25:27.117768+0000","last_became_peered":"2024-04-24T08:25:27.117768+0000","last_unstale":"2024-04-24T08:25:29.486974+0000","last_undegraded":"2024-04-24T08:25:29.486974+0000","last_fullsized":"2024-04-24T08:25:29.486974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.124727+0000","last_change":"2024-04-24T08:25:28.118575+0000","last_active":"2024-04-24T08:25:31.124727+0000","last_peered":"2024-04-24T08:25:31.124727+0000","last_clean":"2024-04-24T08:25:31.124727+0000","last_became_active":"2024-04-24T08:25:28.110833+0000","last_became_peered":"2024-04-24T08:25:28.110833+0000","last_unstale":"2024-04-24T08:25:31.124727+0000","last_undegraded":"2024-04-24T08:25:31.124727+0000","last_fullsized":"2024-04-24T08:25:31.124727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:20:03.401225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.124656+0000","last_change":"2024-04-24T08:25:27.103860+0000","last_active":"2024-04-24T08:25:31.124656+0000","last_peered":"2024-04-24T08:25:31.124656+0000","last_clean":"2024-04-24T08:25:31.124656+0000","last_became_active":"2024-04-24T08:25:27.103309+0000","last_became_peered":"2024-04-24T08:25:27.103309+0000","last_unstale":"2024-04-24T08:25:31.124656+0000","last_undegraded":"2024-04-24T08:25:31.124656+0000","last_fullsized":"2024-04-24T08:25:31.124656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:24.009056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116596+0000","last_change":"2024-04-24T08:25:28.116005+0000","last_active":"2024-04-24T08:25:29.116596+0000","last_peered":"2024-04-24T08:25:29.116596+0000","last_clean":"2024-04-24T08:25:29.116596+0000","last_became_active":"2024-04-24T08:25:28.115091+0000","last_became_peered":"2024-04-24T08:25:28.115091+0000","last_unstale":"2024-04-24T08:25:29.116596+0000","last_undegraded":"2024-04-24T08:25:29.116596+0000","last_fullsized":"2024-04-24T08:25:29.116596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:37:01.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118855+0000","last_change":"2024-04-24T08:25:27.112835+0000","last_active":"2024-04-24T08:25:29.118855+0000","last_peered":"2024-04-24T08:25:29.118855+0000","last_clean":"2024-04-24T08:25:29.118855+0000","last_became_active":"2024-04-24T08:25:27.112540+0000","last_became_peered":"2024-04-24T08:25:27.112540+0000","last_unstale":"2024-04-24T08:25:29.118855+0000","last_undegraded":"2024-04-24T08:25:29.118855+0000","last_fullsized":"2024-04-24T08:25:29.118855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119417+0000","last_change":"2024-04-24T08:25:28.110825+0000","last_active":"2024-04-24T08:25:29.119417+0000","last_peered":"2024-04-24T08:25:29.119417+0000","last_clean":"2024-04-24T08:25:29.119417+0000","last_became_active":"2024-04-24T08:25:28.110558+0000","last_became_peered":"2024-04-24T08:25:28.110558+0000","last_unstale":"2024-04-24T08:25:29.119417+0000","last_undegraded":"2024-04-24T08:25:29.119417+0000","last_fullsized":"2024-04-24T08:25:29.119417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:55.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116724+0000","last_change":"2024-04-24T08:25:27.119554+0000","last_active":"2024-04-24T08:25:29.116724+0000","last_peered":"2024-04-24T08:25:29.116724+0000","last_clean":"2024-04-24T08:25:29.116724+0000","last_became_active":"2024-04-24T08:25:27.119265+0000","last_became_peered":"2024-04-24T08:25:27.119265+0000","last_unstale":"2024-04-24T08:25:29.116724+0000","last_undegraded":"2024-04-24T08:25:29.116724+0000","last_fullsized":"2024-04-24T08:25:29.116724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:53.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119700+0000","last_change":"2024-04-24T08:25:28.129338+0000","last_active":"2024-04-24T08:25:29.119700+0000","last_peered":"2024-04-24T08:25:29.119700+0000","last_clean":"2024-04-24T08:25:29.119700+0000","last_became_active":"2024-04-24T08:25:28.129089+0000","last_became_peered":"2024-04-24T08:25:28.129089+0000","last_unstale":"2024-04-24T08:25:29.119700+0000","last_undegraded":"2024-04-24T08:25:29.119700+0000","last_fullsized":"2024-04-24T08:25:29.119700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:18.049288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487566+0000","last_change":"2024-04-24T08:25:27.122158+0000","last_active":"2024-04-24T08:25:29.487566+0000","last_peered":"2024-04-24T08:25:29.487566+0000","last_clean":"2024-04-24T08:25:29.487566+0000","last_became_active":"2024-04-24T08:25:27.121891+0000","last_became_peered":"2024-04-24T08:25:27.121891+0000","last_unstale":"2024-04-24T08:25:29.487566+0000","last_undegraded":"2024-04-24T08:25:29.487566+0000","last_fullsized":"2024-04-24T08:25:29.487566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:45.411953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116628+0000","last_change":"2024-04-24T08:25:28.105914+0000","last_active":"2024-04-24T08:25:29.116628+0000","last_peered":"2024-04-24T08:25:29.116628+0000","last_clean":"2024-04-24T08:25:29.116628+0000","last_became_active":"2024-04-24T08:25:28.105628+0000","last_became_peered":"2024-04-24T08:25:28.105628+0000","last_unstale":"2024-04-24T08:25:29.116628+0000","last_undegraded":"2024-04-24T08:25:29.116628+0000","last_fullsized":"2024-04-24T08:25:29.116628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:59.080477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.028927+0000","last_change":"2024-04-24T08:25:27.120111+0000","last_active":"2024-04-24T08:25:30.028927+0000","last_peered":"2024-04-24T08:25:30.028927+0000","last_clean":"2024-04-24T08:25:30.028927+0000","last_became_active":"2024-04-24T08:25:27.119555+0000","last_became_peered":"2024-04-24T08:25:27.119555+0000","last_unstale":"2024-04-24T08:25:30.028927+0000","last_undegraded":"2024-04-24T08:25:30.028927+0000","last_fullsized":"2024-04-24T08:25:30.028927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052406+0000","last_change":"2024-04-24T08:25:28.128255+0000","last_active":"2024-04-24T08:25:30.052406+0000","last_peered":"2024-04-24T08:25:30.052406+0000","last_clean":"2024-04-24T08:25:30.052406+0000","last_became_active":"2024-04-24T08:25:28.128005+0000","last_became_peered":"2024-04-24T08:25:28.128005+0000","last_unstale":"2024-04-24T08:25:30.052406+0000","last_undegraded":"2024-04-24T08:25:30.052406+0000","last_fullsized":"2024-04-24T08:25:30.052406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:39.021977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099463+0000","last_change":"2024-04-24T08:25:27.119402+0000","last_active":"2024-04-24T08:25:30.099463+0000","last_peered":"2024-04-24T08:25:30.099463+0000","last_clean":"2024-04-24T08:25:30.099463+0000","last_became_active":"2024-04-24T08:25:27.119087+0000","last_became_peered":"2024-04-24T08:25:27.119087+0000","last_unstale":"2024-04-24T08:25:30.099463+0000","last_undegraded":"2024-04-24T08:25:30.099463+0000","last_fullsized":"2024-04-24T08:25:30.099463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125400+0000","last_change":"2024-04-24T08:25:28.113889+0000","last_active":"2024-04-24T08:25:31.125400+0000","last_peered":"2024-04-24T08:25:31.125400+0000","last_clean":"2024-04-24T08:25:31.125400+0000","last_became_active":"2024-04-24T08:25:28.113629+0000","last_became_peered":"2024-04-24T08:25:28.113629+0000","last_unstale":"2024-04-24T08:25:31.125400+0000","last_undegraded":"2024-04-24T08:25:31.125400+0000","last_fullsized":"2024-04-24T08:25:31.125400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:03:04.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.486955+0000","last_change":"2024-04-24T08:25:27.121672+0000","last_active":"2024-04-24T08:25:29.486955+0000","last_peered":"2024-04-24T08:25:29.486955+0000","last_clean":"2024-04-24T08:25:29.486955+0000","last_became_active":"2024-04-24T08:25:27.121369+0000","last_became_peered":"2024-04-24T08:25:27.121369+0000","last_unstale":"2024-04-24T08:25:29.486955+0000","last_undegraded":"2024-04-24T08:25:29.486955+0000","last_fullsized":"2024-04-24T08:25:29.486955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:56.317954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.118783+0000","last_change":"2024-04-24T08:25:28.106699+0000","last_active":"2024-04-24T08:25:29.118783+0000","last_peered":"2024-04-24T08:25:29.118783+0000","last_clean":"2024-04-24T08:25:29.118783+0000","last_became_active":"2024-04-24T08:25:28.106354+0000","last_became_peered":"2024-04-24T08:25:28.106354+0000","last_unstale":"2024-04-24T08:25:29.118783+0000","last_undegraded":"2024-04-24T08:25:29.118783+0000","last_fullsized":"2024-04-24T08:25:29.118783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:57.325390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116843+0000","last_change":"2024-04-24T08:25:27.111525+0000","last_active":"2024-04-24T08:25:29.116843+0000","last_peered":"2024-04-24T08:25:29.116843+0000","last_clean":"2024-04-24T08:25:29.116843+0000","last_became_active":"2024-04-24T08:25:27.111231+0000","last_became_peered":"2024-04-24T08:25:27.111231+0000","last_unstale":"2024-04-24T08:25:29.116843+0000","last_undegraded":"2024-04-24T08:25:29.116843+0000","last_fullsized":"2024-04-24T08:25:29.116843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:06.855199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.051856+0000","last_change":"2024-04-24T08:25:28.129308+0000","last_active":"2024-04-24T08:25:30.051856+0000","last_peered":"2024-04-24T08:25:30.051856+0000","last_clean":"2024-04-24T08:25:30.051856+0000","last_became_active":"2024-04-24T08:25:28.128986+0000","last_became_peered":"2024-04-24T08:25:28.128986+0000","last_unstale":"2024-04-24T08:25:30.051856+0000","last_undegraded":"2024-04-24T08:25:30.051856+0000","last_fullsized":"2024-04-24T08:25:30.051856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:59.080477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.116745+0000","last_change":"2024-04-24T08:25:27.109613+0000","last_active":"2024-04-24T08:25:29.116745+0000","last_peered":"2024-04-24T08:25:29.116745+0000","last_clean":"2024-04-24T08:25:29.116745+0000","last_became_active":"2024-04-24T08:25:27.107506+0000","last_became_peered":"2024-04-24T08:25:27.107506+0000","last_unstale":"2024-04-24T08:25:29.116745+0000","last_undegraded":"2024-04-24T08:25:29.116745+0000","last_fullsized":"2024-04-24T08:25:29.116745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:29.798274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052040+0000","last_change":"2024-04-24T08:25:28.128233+0000","last_active":"2024-04-24T08:25:30.052040+0000","last_peered":"2024-04-24T08:25:30.052040+0000","last_clean":"2024-04-24T08:25:30.052040+0000","last_became_active":"2024-04-24T08:25:28.127913+0000","last_became_peered":"2024-04-24T08:25:28.127913+0000","last_unstale":"2024-04-24T08:25:30.052040+0000","last_undegraded":"2024-04-24T08:25:30.052040+0000","last_fullsized":"2024-04-24T08:25:30.052040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:23.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487966+0000","last_change":"2024-04-24T08:25:27.121377+0000","last_active":"2024-04-24T08:25:29.487966+0000","last_peered":"2024-04-24T08:25:29.487966+0000","last_clean":"2024-04-24T08:25:29.487966+0000","last_became_active":"2024-04-24T08:25:27.121049+0000","last_became_peered":"2024-04-24T08:25:27.121049+0000","last_unstale":"2024-04-24T08:25:29.487966+0000","last_undegraded":"2024-04-24T08:25:29.487966+0000","last_fullsized":"2024-04-24T08:25:29.487966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:29.850918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.099150+0000","last_change":"2024-04-24T08:25:28.127139+0000","last_active":"2024-04-24T08:25:30.099150+0000","last_peered":"2024-04-24T08:25:30.099150+0000","last_clean":"2024-04-24T08:25:30.099150+0000","last_became_active":"2024-04-24T08:25:28.126833+0000","last_became_peered":"2024-04-24T08:25:28.126833+0000","last_unstale":"2024-04-24T08:25:30.099150+0000","last_undegraded":"2024-04-24T08:25:30.099150+0000","last_fullsized":"2024-04-24T08:25:30.099150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:18.585938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119528+0000","last_change":"2024-04-24T08:25:28.113682+0000","last_active":"2024-04-24T08:25:29.119528+0000","last_peered":"2024-04-24T08:25:29.119528+0000","last_clean":"2024-04-24T08:25:29.119528+0000","last_became_active":"2024-04-24T08:25:28.113390+0000","last_became_peered":"2024-04-24T08:25:28.113390+0000","last_unstale":"2024-04-24T08:25:29.119528+0000","last_undegraded":"2024-04-24T08:25:29.119528+0000","last_fullsized":"2024-04-24T08:25:29.119528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:05:08.000888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487266+0000","last_change":"2024-04-24T08:25:27.121448+0000","last_active":"2024-04-24T08:25:29.487266+0000","last_peered":"2024-04-24T08:25:29.487266+0000","last_clean":"2024-04-24T08:25:29.487266+0000","last_became_active":"2024-04-24T08:25:27.121179+0000","last_became_peered":"2024-04-24T08:25:27.121179+0000","last_unstale":"2024-04-24T08:25:29.487266+0000","last_undegraded":"2024-04-24T08:25:29.487266+0000","last_fullsized":"2024-04-24T08:25:29.487266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:24:54.461533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.119084+0000","last_change":"2024-04-24T08:25:28.113033+0000","last_active":"2024-04-24T08:25:29.119084+0000","last_peered":"2024-04-24T08:25:29.119084+0000","last_clean":"2024-04-24T08:25:29.119084+0000","last_became_active":"2024-04-24T08:25:28.112690+0000","last_became_peered":"2024-04-24T08:25:28.112690+0000","last_unstale":"2024-04-24T08:25:29.119084+0000","last_undegraded":"2024-04-24T08:25:29.119084+0000","last_fullsized":"2024-04-24T08:25:29.119084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:08:53.886358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:29.487430+0000","last_change":"2024-04-24T08:25:27.123655+0000","last_active":"2024-04-24T08:25:29.487430+0000","last_peered":"2024-04-24T08:25:29.487430+0000","last_clean":"2024-04-24T08:25:29.487430+0000","last_became_active":"2024-04-24T08:25:27.123349+0000","last_became_peered":"2024-04-24T08:25:27.123349+0000","last_unstale":"2024-04-24T08:25:29.487430+0000","last_undegraded":"2024-04-24T08:25:29.487430+0000","last_fullsized":"2024-04-24T08:25:29.487430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:33:53.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125409+0000","last_change":"2024-04-24T08:25:28.108443+0000","last_active":"2024-04-24T08:25:31.125409+0000","last_peered":"2024-04-24T08:25:31.125409+0000","last_clean":"2024-04-24T08:25:31.125409+0000","last_became_active":"2024-04-24T08:25:28.108128+0000","last_became_peered":"2024-04-24T08:25:28.108128+0000","last_unstale":"2024-04-24T08:25:31.125409+0000","last_undegraded":"2024-04-24T08:25:31.125409+0000","last_fullsized":"2024-04-24T08:25:31.125409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:22:00.604367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052423+0000","last_change":"2024-04-24T08:25:27.114010+0000","last_active":"2024-04-24T08:25:30.052423+0000","last_peered":"2024-04-24T08:25:30.052423+0000","last_clean":"2024-04-24T08:25:30.052423+0000","last_became_active":"2024-04-24T08:25:27.113724+0000","last_became_peered":"2024-04-24T08:25:27.113724+0000","last_unstale":"2024-04-24T08:25:30.052423+0000","last_undegraded":"2024-04-24T08:25:30.052423+0000","last_fullsized":"2024-04-24T08:25:30.052423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:49.837612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:30.052336+0000","last_change":"2024-04-24T08:25:28.130070+0000","last_active":"2024-04-24T08:25:30.052336+0000","last_peered":"2024-04-24T08:25:30.052336+0000","last_clean":"2024-04-24T08:25:30.052336+0000","last_became_active":"2024-04-24T08:25:28.129768+0000","last_became_peered":"2024-04-24T08:25:28.129768+0000","last_unstale":"2024-04-24T08:25:30.052336+0000","last_undegraded":"2024-04-24T08:25:30.052336+0000","last_fullsized":"2024-04-24T08:25:30.052336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:27.081596+0000","last_clean_scrub_stamp":"2024-04-24T08:25:27.081596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:27:07.262422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-24T08:25:31.125630+0000","last_change":"2024-04-24T08:25:27.112094+0000","last_active":"2024-04-24T08:25:31.125630+0000","last_peered":"2024-04-24T08:25:31.125630+0000","last_clean":"2024-04-24T08:25:31.125630+0000","last_became_active":"2024-04-24T08:25:27.111795+0000","last_became_peered":"2024-04-24T08:25:27.111795+0000","last_unstale":"2024-04-24T08:25:31.125630+0000","last_undegraded":"2024-04-24T08:25:31.125630+0000","last_fullsized":"2024-04-24T08:25:31.125630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:26.074161+0000","last_clean_scrub_stamp":"2024-04-24T08:25:26.074161+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:24.009056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:25:37.225 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T08:25:37.225 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-24T08:25:37.225 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-24T08:25:37.225 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-24T08:25:37.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5960a00640 1 Processor -- start 2024-04-24T08:25:37.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5960a00640 1 -- start start 2024-04-24T08:25:37.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5960a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f595c0b9d90 0x7f595c1450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5960a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f595c0b44e0 0x7f595c0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5960a00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595c145620 con 0x7f595c148130 2024-04-24T08:25:37.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5960a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f595c145b80 con 0x7f595c0b9d90 2024-04-24T08:25:37.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5960a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f595c0ba170 con 0x7f595c0b44e0 2024-04-24T08:25:37.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f595a800640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f595c148130 0x7f595c1485c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59680/0 (socket says 172.21.15.88:59680) 2024-04-24T08:25:37.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f595a800640 1 -- 172.21.15.88:0/2710466068 learned_addr learned my addr 172.21.15.88:0/2710466068 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:37.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5959400640 1 --2- 172.21.15.88:0/2710466068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f595c0b44e0 0x7f595c0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5959e00640 1 --2- 172.21.15.88:0/2710466068 >> v2:172.21.15.142:3300/0 conn(0x7f595c0b9d90 0x7f595c1450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5958a00640 1 -- 172.21.15.88:0/2710466068 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2787965185 0 0) 0x7f59540014a0 con 0x7f595c148130 2024-04-24T08:25:37.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5958a00640 1 -- 172.21.15.88:0/2710466068 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5940005740 con 0x7f595c148130 2024-04-24T08:25:37.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5959e00640 1 -- 172.21.15.88:0/2710466068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f595c0b44e0 msgr2=0x7f595c0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:37.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5959e00640 1 --2- 172.21.15.88:0/2710466068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f595c0b44e0 0x7f595c0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5959e00640 1 -- 172.21.15.88:0/2710466068 >> v1:172.21.15.88:6789/0 conn(0x7f595c148130 legacy=0x7f595c1485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5959e00640 1 -- 172.21.15.88:0/2710466068 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c1458a0 con 0x7f595c0b9d90 2024-04-24T08:25:37.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.402+0000 7f5959400640 1 --2- 172.21.15.88:0/2710466068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f595c0b44e0 0x7f595c0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:37.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.406+0000 7f5959e00640 1 --2- 172.21.15.88:0/2710466068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f595c0b9d90 0x7f595c1450e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f594c0097c0 tx=0x7f594c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5493d53098d4cedf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:37.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.406+0000 7f5958a00640 1 -- 172.21.15.88:0/2710466068 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c0b0070 con 0x7f595c0b9d90 2024-04-24T08:25:37.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.406+0000 7f5958a00640 1 -- 172.21.15.88:0/2710466068 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f594c0ab600 con 0x7f595c0b9d90 2024-04-24T08:25:37.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.406+0000 7f5958a00640 1 -- 172.21.15.88:0/2710466068 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c0ab9d0 con 0x7f595c0b9d90 2024-04-24T08:25:37.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.406+0000 7f5960a00640 1 -- 172.21.15.88:0/2710466068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f595c0b9d90 msgr2=0x7f595c1450e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.406+0000 7f5960a00640 1 --2- 172.21.15.88:0/2710466068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f595c0b9d90 0x7f595c1450e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f594c0097c0 tx=0x7f594c01c4a0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.406+0000 7f5960a00640 1 -- 172.21.15.88:0/2710466068 shutdown_connections 2024-04-24T08:25:37.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.406+0000 7f5960a00640 1 --2- 172.21.15.88:0/2710466068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f595c0b44e0 0x7f595c0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.406+0000 7f5960a00640 1 --2- 172.21.15.88:0/2710466068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f595c0b9d90 0x7f595c1450e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.406+0000 7f5960a00640 1 -- 172.21.15.88:0/2710466068 >> 172.21.15.88:0/2710466068 conn(0x7f595c06c0d0 msgr2=0x7f595c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:37.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.406+0000 7f5960a00640 1 -- 172.21.15.88:0/2710466068 shutdown_connections 2024-04-24T08:25:37.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.406+0000 7f5960a00640 1 -- 172.21.15.88:0/2710466068 wait complete. 2024-04-24T08:25:37.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5960a00640 1 Processor -- start 2024-04-24T08:25:37.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5960a00640 1 -- start start 2024-04-24T08:25:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5960a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c0b44e0 0x7f595c0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5960a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f595c0b9d90 0x7f595c1e11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5960a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f595c148130 0x7f595c1433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5960a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f595c06dba0 con 0x7f595c0b44e0 2024-04-24T08:25:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5960a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f595c06da20 con 0x7f595c148130 2024-04-24T08:25:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5960a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f595c06dd20 con 0x7f595c0b9d90 2024-04-24T08:25:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5959e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c0b44e0 0x7f595c0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5959e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c0b44e0 0x7f595c0b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34980/0 (socket says 172.21.15.88:34980) 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5959e00640 1 -- 172.21.15.88:0/67367283 learned_addr learned my addr 172.21.15.88:0/67367283 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f595a800640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f595c148130 0x7f595c1433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5959400640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f595c0b9d90 0x7f595c1e11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5959e00640 1 -- 172.21.15.88:0/67367283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f595c0b9d90 msgr2=0x7f595c1e11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5959e00640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f595c0b9d90 0x7f595c1e11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5959e00640 1 -- 172.21.15.88:0/67367283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f595c148130 msgr2=0x7f595c1433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5959e00640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f595c148130 0x7f595c1433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5959e00640 1 -- 172.21.15.88:0/67367283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c08cfa0 con 0x7f595c0b44e0 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5959400640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f595c0b9d90 0x7f595c1e11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f595a800640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f595c148130 0x7f595c1433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5959e00640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c0b44e0 0x7f595c0b2c50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f594c0097c0 tx=0x7f594c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5952000640 1 -- 172.21.15.88:0/67367283 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c0b0050 con 0x7f595c0b44e0 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5952000640 1 -- 172.21.15.88:0/67367283 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f594c0bc070 con 0x7f595c0b44e0 2024-04-24T08:25:37.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5960a00640 1 -- 172.21.15.88:0/67367283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595c1e1700 con 0x7f595c0b44e0 2024-04-24T08:25:37.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5952000640 1 -- 172.21.15.88:0/67367283 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c006e20 con 0x7f595c0b44e0 2024-04-24T08:25:37.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.410+0000 7f5960a00640 1 -- 172.21.15.88:0/67367283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f595c1e0ca0 con 0x7f595c0b44e0 2024-04-24T08:25:37.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.414+0000 7f5960a00640 1 -- 172.21.15.88:0/67367283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f595c068b90 con 0x7f595c0b44e0 2024-04-24T08:25:37.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.414+0000 7f5952000640 1 -- 172.21.15.88:0/67367283 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f594c0b5830 con 0x7f595c0b44e0 2024-04-24T08:25:37.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.414+0000 7f5952000640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f593c068380 0x7f593c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.414+0000 7f5952000640 1 -- 172.21.15.88:0/67367283 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f594c1211a0 con 0x7f595c0b44e0 2024-04-24T08:25:37.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.414+0000 7f5959400640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f593c068380 0x7f593c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.414+0000 7f5959400640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f593c068380 0x7f593c06a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f595c09d5f0 tx=0x7f5948008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:37.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.418+0000 7f5952000640 1 -- 172.21.15.88:0/67367283 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f594c016090 con 0x7f595c0b44e0 2024-04-24T08:25:37.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.610+0000 7f5960a00640 1 -- 172.21.15.88:0/67367283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f595c1449a0 con 0x7f595c0b44e0 2024-04-24T08:25:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.610+0000 7f5952000640 1 -- 172.21.15.88:0/67367283 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f594c0f1870 con 0x7f595c0b44e0 2024-04-24T08:25:37.611 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:37.611 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-24T08:25:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.610+0000 7f5960a00640 1 -- 172.21.15.88:0/67367283 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f593c068380 msgr2=0x7f593c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.610+0000 7f5960a00640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f593c068380 0x7f593c06a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f595c09d5f0 tx=0x7f5948008040 comp rx=0 tx=0).stop 2024-04-24T08:25:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.610+0000 7f5960a00640 1 -- 172.21.15.88:0/67367283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c0b44e0 msgr2=0x7f595c0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.610+0000 7f5960a00640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c0b44e0 0x7f595c0b2c50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f594c0097c0 tx=0x7f594c01ace0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.614+0000 7f5960a00640 1 -- 172.21.15.88:0/67367283 shutdown_connections 2024-04-24T08:25:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.614+0000 7f5960a00640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f593c068380 0x7f593c06a840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.614+0000 7f5960a00640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f595c148130 0x7f595c1433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.614+0000 7f5960a00640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f595c0b9d90 0x7f595c1e11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.614+0000 7f5960a00640 1 --2- 172.21.15.88:0/67367283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c0b44e0 0x7f595c0b2c50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.614+0000 7f5960a00640 1 -- 172.21.15.88:0/67367283 >> 172.21.15.88:0/67367283 conn(0x7f595c06c0d0 msgr2=0x7f595c0b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.614+0000 7f5960a00640 1 -- 172.21.15.88:0/67367283 shutdown_connections 2024-04-24T08:25:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.614+0000 7f5960a00640 1 -- 172.21.15.88:0/67367283 wait complete. 2024-04-24T08:25:37.631 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-24T08:25:37.632 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:37.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d95000640 1 Processor -- start 2024-04-24T08:25:37.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d95000640 1 -- start start 2024-04-24T08:25:37.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d95000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d900b44e0 0x7f0d900b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d95000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d900ba170 con 0x7f0d900b9d90 2024-04-24T08:25:37.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d95000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d901458a0 con 0x7f0d90143bb0 2024-04-24T08:25:37.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d95000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0d90145b80 con 0x7f0d900b44e0 2024-04-24T08:25:37.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8de00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0d900b9d90 0x7f0d901450e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59682/0 (socket says 172.21.15.88:59682) 2024-04-24T08:25:37.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8de00640 1 -- 172.21.15.88:0/1734064688 learned_addr learned my addr 172.21.15.88:0/1734064688 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:37.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d85400640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d900b44e0 0x7f0d900b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115152899 0 0) 0x7f0d900ba170 con 0x7f0d900b9d90 2024-04-24T08:25:37.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d74003530 con 0x7f0d900b9d90 2024-04-24T08:25:37.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3272953451 0 0) 0x7f0d901458a0 con 0x7f0d90143bb0 2024-04-24T08:25:37.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d900ba170 con 0x7f0d90143bb0 2024-04-24T08:25:37.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1271051424 0 0) 0x7f0d74003530 con 0x7f0d900b9d90 2024-04-24T08:25:37.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d900b44e0 msgr2=0x7f0d900b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:37.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d900b44e0 0x7f0d900b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 >> v1:172.21.15.142:6789/0 conn(0x7f0d90143bb0 legacy=0x7f0d90144040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d900b3fc0 con 0x7f0d900b9d90 2024-04-24T08:25:37.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f0d80001600 con 0x7f0d900b9d90 2024-04-24T08:25:37.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 >> v1:172.21.15.88:6789/0 conn(0x7f0d900b9d90 legacy=0x7f0d901450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d74003b80 0x7f0d74003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d900b44e0 0x7f0d74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d74004d50 0x7f0d740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0d90145b80 con 0x7f0d74003b80 2024-04-24T08:25:37.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7400dda0 con 0x7f0d74004d50 2024-04-24T08:25:37.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0d7400dfa0 con 0x7f0d900b44e0 2024-04-24T08:25:37.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8de00640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d74003b80 0x7f0d74003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d85400640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d900b44e0 0x7f0d74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.766+0000 7f0d8e800640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d74004d50 0x7f0d740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d8de00640 1 -- 172.21.15.88:0/1734064688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d900b44e0 msgr2=0x7f0d74004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:37.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d8de00640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d900b44e0 0x7f0d74004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d8de00640 1 -- 172.21.15.88:0/1734064688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d74004d50 msgr2=0x7f0d740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:37.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d8de00640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d74004d50 0x7f0d740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d8de00640 1 -- 172.21.15.88:0/1734064688 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d74003530 con 0x7f0d74003b80 2024-04-24T08:25:37.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d8e800640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d74004d50 0x7f0d740051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:37.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d8de00640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d74003b80 0x7f0d74003f80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0d80007f50 tx=0x7f0d8001cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953e274b721562f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:37.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80007b70 con 0x7f0d74003b80 2024-04-24T08:25:37.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d80005bc0 con 0x7f0d74003b80 2024-04-24T08:25:37.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d8d400640 1 -- 172.21.15.88:0/1734064688 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80007070 con 0x7f0d74003b80 2024-04-24T08:25:37.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d95000640 1 -- 172.21.15.88:0/1734064688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d74003b80 msgr2=0x7f0d74003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d95000640 1 --2- 172.21.15.88:0/1734064688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d74003b80 0x7f0d74003f80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0d80007f50 tx=0x7f0d8001cac0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d8e800640 1 -- 172.21.15.88:0/1734064688 reap_dead start 2024-04-24T08:25:37.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d95000640 1 -- 172.21.15.88:0/1734064688 shutdown_connections 2024-04-24T08:25:37.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d95000640 1 -- 172.21.15.88:0/1734064688 >> 172.21.15.88:0/1734064688 conn(0x7f0d9006c0d0 msgr2=0x7f0d900b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:37.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d95000640 1 -- 172.21.15.88:0/1734064688 shutdown_connections 2024-04-24T08:25:37.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.770+0000 7f0d95000640 1 -- 172.21.15.88:0/1734064688 wait complete. 2024-04-24T08:25:37.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d95000640 1 Processor -- start 2024-04-24T08:25:37.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d95000640 1 -- start start 2024-04-24T08:25:37.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d95000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d74003b80 0x7f0d90094cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d95000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d901e5480 0x7f0d901e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d95000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d901e8760 0x7f0d901e8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d95000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9006ddb0 con 0x7f0d74003b80 2024-04-24T08:25:37.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d95000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9006dc30 con 0x7f0d901e8760 2024-04-24T08:25:37.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d95000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9006df30 con 0x7f0d901e5480 2024-04-24T08:25:37.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d8de00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d74003b80 0x7f0d90094cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d8de00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d74003b80 0x7f0d90094cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49552/0 (socket says 172.21.15.88:49552) 2024-04-24T08:25:37.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d8de00640 1 -- 172.21.15.88:0/3126274341 learned_addr learned my addr 172.21.15.88:0/3126274341 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:37.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d8e800640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d901e8760 0x7f0d901e8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d85400640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d901e5480 0x7f0d901e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d8de00640 1 -- 172.21.15.88:0/3126274341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d901e5480 msgr2=0x7f0d901e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d8de00640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d901e5480 0x7f0d901e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d8de00640 1 -- 172.21.15.88:0/3126274341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d901e8760 msgr2=0x7f0d901e8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d8de00640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d901e8760 0x7f0d901e8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d8de00640 1 -- 172.21.15.88:0/3126274341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d900b0d10 con 0x7f0d74003b80 2024-04-24T08:25:37.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d85400640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d901e5480 0x7f0d901e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:37.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d8de00640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d74003b80 0x7f0d90094cd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d8001c530 tx=0x7f0d74005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:37.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d86a00640 1 -- 172.21.15.88:0/3126274341 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80001ab0 con 0x7f0d74003b80 2024-04-24T08:25:37.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d86a00640 1 -- 172.21.15.88:0/3126274341 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d800059a0 con 0x7f0d74003b80 2024-04-24T08:25:37.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d86a00640 1 -- 172.21.15.88:0/3126274341 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80001400 con 0x7f0d74003b80 2024-04-24T08:25:37.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d95000640 1 -- 172.21.15.88:0/3126274341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9014a4d0 con 0x7f0d74003b80 2024-04-24T08:25:37.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.774+0000 7f0d95000640 1 -- 172.21.15.88:0/3126274341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d901e5e40 con 0x7f0d74003b80 2024-04-24T08:25:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.778+0000 7f0d95000640 1 -- 172.21.15.88:0/3126274341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d90068b90 con 0x7f0d74003b80 2024-04-24T08:25:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.778+0000 7f0d86a00640 1 -- 172.21.15.88:0/3126274341 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0d80007040 con 0x7f0d74003b80 2024-04-24T08:25:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.778+0000 7f0d86a00640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0d6c068380 0x7f0d6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.778+0000 7f0d86a00640 1 -- 172.21.15.88:0/3126274341 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0d8011fd80 con 0x7f0d74003b80 2024-04-24T08:25:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.778+0000 7f0d85400640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0d6c068380 0x7f0d6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.778+0000 7f0d85400640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0d6c068380 0x7f0d6c06a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d90148f90 tx=0x7f0d78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:37.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.782+0000 7f0d86a00640 1 -- 172.21.15.88:0/3126274341 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0d800bf060 con 0x7f0d74003b80 2024-04-24T08:25:37.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.938+0000 7f0d95000640 1 -- 172.21.15.88:0/3126274341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d900b8230 con 0x7f0d74003b80 2024-04-24T08:25:37.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.938+0000 7f0d86a00640 1 -- 172.21.15.88:0/3126274341 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f0d800aa020 con 0x7f0d74003b80 2024-04-24T08:25:37.941 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:37.941 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:37.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.942+0000 7f0d95000640 1 -- 172.21.15.88:0/3126274341 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0d6c068380 msgr2=0x7f0d6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.942+0000 7f0d95000640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0d6c068380 0x7f0d6c06a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d90148f90 tx=0x7f0d78008040 comp rx=0 tx=0).stop 2024-04-24T08:25:37.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.942+0000 7f0d95000640 1 -- 172.21.15.88:0/3126274341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d74003b80 msgr2=0x7f0d90094cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:37.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.942+0000 7f0d95000640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d74003b80 0x7f0d90094cd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d8001c530 tx=0x7f0d74005840 comp rx=0 tx=0).stop 2024-04-24T08:25:37.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.942+0000 7f0d95000640 1 -- 172.21.15.88:0/3126274341 shutdown_connections 2024-04-24T08:25:37.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.942+0000 7f0d95000640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0d6c068380 0x7f0d6c06a840 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.942+0000 7f0d95000640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d901e8760 0x7f0d901e8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.942+0000 7f0d95000640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d901e5480 0x7f0d901e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.942+0000 7f0d95000640 1 --2- 172.21.15.88:0/3126274341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d74003b80 0x7f0d90094cd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:37.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.942+0000 7f0d95000640 1 -- 172.21.15.88:0/3126274341 >> 172.21.15.88:0/3126274341 conn(0x7f0d9006c0d0 msgr2=0x7f0d900af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:37.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.942+0000 7f0d95000640 1 -- 172.21.15.88:0/3126274341 shutdown_connections 2024-04-24T08:25:37.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:37.942+0000 7f0d95000640 1 -- 172.21.15.88:0/3126274341 wait complete. 2024-04-24T08:25:37.962 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T08:25:25.116395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T08:25:26.444475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:25:37.963 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:25:38.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc137400640 1 Processor -- start 2024-04-24T08:25:38.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc137400640 1 -- start start 2024-04-24T08:25:38.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc137400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1300b2b40 0x7fc130142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc137400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc1300b7be0 0x7fc1301431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc137400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1300b4c40 con 0x7fc1300bbfb0 2024-04-24T08:25:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc137400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc1300bc390 con 0x7fc1300b7be0 2024-04-24T08:25:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc137400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc1300b6400 con 0x7fc1300b2b40 2024-04-24T08:25:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc12fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1300b2b40 0x7fc130142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc135400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc1300b7be0 0x7fc1301431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc12fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1300b2b40 0x7fc130142cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:33580/0 (socket says 172.21.15.88:33580) 2024-04-24T08:25:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc135400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc1300b7be0 0x7fc1301431f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:52156/0 (socket says 172.21.15.88:52156) 2024-04-24T08:25:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc12fe00640 1 -- 172.21.15.88:0/2003514583 learned_addr learned my addr 172.21.15.88:0/2003514583 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc12fe00640 1 -- 172.21.15.88:0/2003514583 >> v2:172.21.15.142:3300/0 conn(0x7fc1300b7be0 msgr2=0x7fc1301431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc12fe00640 1 --2- 172.21.15.88:0/2003514583 >> v2:172.21.15.142:3300/0 conn(0x7fc1300b7be0 0x7fc1301431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc12fe00640 1 -- 172.21.15.88:0/2003514583 >> v1:172.21.15.142:6789/0 conn(0x7fc1300bbfb0 legacy=0x7fc1300b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc12fe00640 1 -- 172.21.15.88:0/2003514583 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1300b66e0 con 0x7fc1300b2b40 2024-04-24T08:25:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.102+0000 7fc135400640 1 --2- 172.21.15.88:0/2003514583 >> v2:172.21.15.142:3300/0 conn(0x7fc1300b7be0 0x7fc1301431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:38.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.106+0000 7fc12fe00640 1 --2- 172.21.15.88:0/2003514583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1300b2b40 0x7fc130142cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009870 tx=0x7fc11c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3c282d8ff31a34e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:38.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.106+0000 7fc12f400640 1 -- 172.21.15.88:0/2003514583 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0b0070 con 0x7fc1300b2b40 2024-04-24T08:25:38.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.106+0000 7fc12f400640 1 -- 172.21.15.88:0/2003514583 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11c0ab600 con 0x7fc1300b2b40 2024-04-24T08:25:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.106+0000 7fc12f400640 1 -- 172.21.15.88:0/2003514583 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0ab9d0 con 0x7fc1300b2b40 2024-04-24T08:25:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.106+0000 7fc137400640 1 -- 172.21.15.88:0/2003514583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1300b2b40 msgr2=0x7fc130142cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.106+0000 7fc137400640 1 --2- 172.21.15.88:0/2003514583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1300b2b40 0x7fc130142cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009870 tx=0x7fc11c01c440 comp rx=0 tx=0).stop 2024-04-24T08:25:38.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.106+0000 7fc137400640 1 -- 172.21.15.88:0/2003514583 shutdown_connections 2024-04-24T08:25:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.106+0000 7fc137400640 1 --2- 172.21.15.88:0/2003514583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1300b2b40 0x7fc130142cb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.106+0000 7fc137400640 1 --2- 172.21.15.88:0/2003514583 >> v2:172.21.15.142:3300/0 conn(0x7fc1300b7be0 0x7fc1301431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.106+0000 7fc137400640 1 -- 172.21.15.88:0/2003514583 >> 172.21.15.88:0/2003514583 conn(0x7fc130067e40 msgr2=0x7fc1300bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.106+0000 7fc137400640 1 -- 172.21.15.88:0/2003514583 shutdown_connections 2024-04-24T08:25:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.106+0000 7fc137400640 1 -- 172.21.15.88:0/2003514583 wait complete. 2024-04-24T08:25:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc137400640 1 Processor -- start 2024-04-24T08:25:38.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc137400640 1 -- start start 2024-04-24T08:25:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc137400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1300b2b40 0x7fc130143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc137400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1300b7be0 0x7fc1301e0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc137400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1300bbfb0 0x7fc1301e0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc137400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc130152e60 con 0x7fc1300bbfb0 2024-04-24T08:25:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc137400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc1300b7550 con 0x7fc1300b7be0 2024-04-24T08:25:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc137400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc130152fe0 con 0x7fc1300b2b40 2024-04-24T08:25:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc135400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1300bbfb0 0x7fc1301e0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc135400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1300bbfb0 0x7fc1301e0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49554/0 (socket says 172.21.15.88:49554) 2024-04-24T08:25:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc135400640 1 -- 172.21.15.88:0/3647509775 learned_addr learned my addr 172.21.15.88:0/3647509775 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc12fe00640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1300b7be0 0x7fc1301e0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc134a00640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1300b2b40 0x7fc130143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc135400640 1 -- 172.21.15.88:0/3647509775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1300b2b40 msgr2=0x7fc130143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc135400640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1300b2b40 0x7fc130143c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc135400640 1 -- 172.21.15.88:0/3647509775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1300b7be0 msgr2=0x7fc1301e0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc135400640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1300b7be0 0x7fc1301e0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc135400640 1 -- 172.21.15.88:0/3647509775 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1300b2760 con 0x7fc1300bbfb0 2024-04-24T08:25:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc135400640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1300bbfb0 0x7fc1301e0a40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc128009f00 tx=0x7fc12800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc12cc00640 1 -- 172.21.15.88:0/3647509775 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128018030 con 0x7fc1300bbfb0 2024-04-24T08:25:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc12cc00640 1 -- 172.21.15.88:0/3647509775 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12800ce50 con 0x7fc1300bbfb0 2024-04-24T08:25:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc12cc00640 1 -- 172.21.15.88:0/3647509775 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128003bc0 con 0x7fc1300bbfb0 2024-04-24T08:25:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc137400640 1 -- 172.21.15.88:0/3647509775 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13006db80 con 0x7fc1300bbfb0 2024-04-24T08:25:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.110+0000 7fc137400640 1 -- 172.21.15.88:0/3647509775 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13006e140 con 0x7fc1300bbfb0 2024-04-24T08:25:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.114+0000 7fc137400640 1 -- 172.21.15.88:0/3647509775 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc130068c00 con 0x7fc1300bbfb0 2024-04-24T08:25:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.114+0000 7fc12cc00640 1 -- 172.21.15.88:0/3647509775 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc12801b070 con 0x7fc1300bbfb0 2024-04-24T08:25:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.114+0000 7fc12cc00640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc1100683b0 0x7fc11006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.114+0000 7fc12cc00640 1 -- 172.21.15.88:0/3647509775 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc128087200 con 0x7fc1300bbfb0 2024-04-24T08:25:38.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.114+0000 7fc134a00640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc1100683b0 0x7fc11006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.114+0000 7fc134a00640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc1100683b0 0x7fc11006a870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc124007fd0 tx=0x7fc124009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:38.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.118+0000 7fc12cc00640 1 -- 172.21.15.88:0/3647509775 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc128010040 con 0x7fc1300bbfb0 2024-04-24T08:25:38.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.270+0000 7fc137400640 1 -- 172.21.15.88:0/3647509775 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc13013c960 con 0x7fc1300bbfb0 2024-04-24T08:25:38.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc12cc00640 1 -- 172.21.15.88:0/3647509775 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc1280571e0 con 0x7fc1300bbfb0 2024-04-24T08:25:38.273 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:25:38.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc137400640 1 -- 172.21.15.88:0/3647509775 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc1100683b0 msgr2=0x7fc11006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc137400640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc1100683b0 0x7fc11006a870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc124007fd0 tx=0x7fc124009040 comp rx=0 tx=0).stop 2024-04-24T08:25:38.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc137400640 1 -- 172.21.15.88:0/3647509775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1300bbfb0 msgr2=0x7fc1301e0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc137400640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1300bbfb0 0x7fc1301e0a40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc128009f00 tx=0x7fc12800c490 comp rx=0 tx=0).stop 2024-04-24T08:25:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc137400640 1 -- 172.21.15.88:0/3647509775 shutdown_connections 2024-04-24T08:25:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc137400640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc1100683b0 0x7fc11006a870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc137400640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1300bbfb0 0x7fc1301e0a40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc137400640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1300b7be0 0x7fc1301e0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc137400640 1 --2- 172.21.15.88:0/3647509775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1300b2b40 0x7fc130143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc137400640 1 -- 172.21.15.88:0/3647509775 >> 172.21.15.88:0/3647509775 conn(0x7fc130067e40 msgr2=0x7fc1300b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc137400640 1 -- 172.21.15.88:0/3647509775 shutdown_connections 2024-04-24T08:25:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.274+0000 7fc137400640 1 -- 172.21.15.88:0/3647509775 wait complete. 2024-04-24T08:25:38.295 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T08:25:38.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc448400640 1 Processor -- start 2024-04-24T08:25:38.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc448400640 1 -- start start 2024-04-24T08:25:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc448400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc4400b01a0 0x7fc44006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc448400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4400ae4e0 0x7fc44013e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc448400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4400737c0 0x7fc44013eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc448400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc4400b0580 con 0x7fc4400ae4e0 2024-04-24T08:25:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc448400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc4400b59d0 con 0x7fc4400b01a0 2024-04-24T08:25:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc448400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc4400ae970 con 0x7fc4400737c0 2024-04-24T08:25:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc445000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4400ae4e0 0x7fc44013e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc445000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4400ae4e0 0x7fc44013e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49568/0 (socket says 172.21.15.88:49568) 2024-04-24T08:25:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc445000640 1 -- 172.21.15.88:0/3221914781 learned_addr learned my addr 172.21.15.88:0/3221914781 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc445a00640 1 --2- 172.21.15.88:0/3221914781 >> v2:172.21.15.142:3300/0 conn(0x7fc4400b01a0 0x7fc44006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc446400640 1 --2- 172.21.15.88:0/3221914781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4400737c0 0x7fc44013eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc445000640 1 -- 172.21.15.88:0/3221914781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4400737c0 msgr2=0x7fc44013eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:38.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc445000640 1 --2- 172.21.15.88:0/3221914781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4400737c0 0x7fc44013eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc445000640 1 -- 172.21.15.88:0/3221914781 >> v2:172.21.15.142:3300/0 conn(0x7fc4400b01a0 msgr2=0x7fc44006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:38.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc445000640 1 --2- 172.21.15.88:0/3221914781 >> v2:172.21.15.142:3300/0 conn(0x7fc4400b01a0 0x7fc44006d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.434+0000 7fc445000640 1 -- 172.21.15.88:0/3221914781 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4400b53a0 con 0x7fc4400ae4e0 2024-04-24T08:25:38.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc445000640 1 --2- 172.21.15.88:0/3221914781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4400ae4e0 0x7fc44013e980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc44006ee20 tx=0x7fc42c01ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923a064175fbb4f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:38.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc43fe00640 1 -- 172.21.15.88:0/3221914781 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0b4070 con 0x7fc4400ae4e0 2024-04-24T08:25:38.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc43fe00640 1 -- 172.21.15.88:0/3221914781 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42c0a7a70 con 0x7fc4400ae4e0 2024-04-24T08:25:38.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc43fe00640 1 -- 172.21.15.88:0/3221914781 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0a7e40 con 0x7fc4400ae4e0 2024-04-24T08:25:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc448400640 1 -- 172.21.15.88:0/3221914781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4400ae4e0 msgr2=0x7fc44013e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc448400640 1 --2- 172.21.15.88:0/3221914781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4400ae4e0 0x7fc44013e980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc44006ee20 tx=0x7fc42c01ead0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc448400640 1 -- 172.21.15.88:0/3221914781 shutdown_connections 2024-04-24T08:25:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc448400640 1 --2- 172.21.15.88:0/3221914781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4400737c0 0x7fc44013eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc448400640 1 --2- 172.21.15.88:0/3221914781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4400ae4e0 0x7fc44013e980 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc448400640 1 --2- 172.21.15.88:0/3221914781 >> v2:172.21.15.142:3300/0 conn(0x7fc4400b01a0 0x7fc44006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc448400640 1 -- 172.21.15.88:0/3221914781 >> 172.21.15.88:0/3221914781 conn(0x7fc4400b9690 msgr2=0x7fc4400b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc448400640 1 -- 172.21.15.88:0/3221914781 shutdown_connections 2024-04-24T08:25:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.438+0000 7fc448400640 1 -- 172.21.15.88:0/3221914781 wait complete. 2024-04-24T08:25:38.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc448400640 1 Processor -- start 2024-04-24T08:25:38.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc448400640 1 -- start start 2024-04-24T08:25:38.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc448400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4400737c0 0x7fc4401e3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc448400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4400b01a0 0x7fc440143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc448400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4401437d0 0x7fc440137650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc448400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc440148a90 con 0x7fc4401437d0 2024-04-24T08:25:38.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc448400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc440148910 con 0x7fc4400b01a0 2024-04-24T08:25:38.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc448400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc440148c10 con 0x7fc4400737c0 2024-04-24T08:25:38.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc446400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4401437d0 0x7fc440137650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc446400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4401437d0 0x7fc440137650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49570/0 (socket says 172.21.15.88:49570) 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc446400640 1 -- 172.21.15.88:0/1918148866 learned_addr learned my addr 172.21.15.88:0/1918148866 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc445a00640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4400737c0 0x7fc4401e3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc445000640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4400b01a0 0x7fc440143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc446400640 1 -- 172.21.15.88:0/1918148866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4400737c0 msgr2=0x7fc4401e3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc446400640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4400737c0 0x7fc4401e3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc446400640 1 -- 172.21.15.88:0/1918148866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4400b01a0 msgr2=0x7fc440143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc446400640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4400b01a0 0x7fc440143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc446400640 1 -- 172.21.15.88:0/1918148866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4401e4780 con 0x7fc4401437d0 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc446400640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4401437d0 0x7fc440137650 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc438007e60 tx=0x7fc43800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc43d600640 1 -- 172.21.15.88:0/1918148866 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438014620 con 0x7fc4401437d0 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc43d600640 1 -- 172.21.15.88:0/1918148866 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc438019070 con 0x7fc4401437d0 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc43d600640 1 -- 172.21.15.88:0/1918148866 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438014a20 con 0x7fc4401437d0 2024-04-24T08:25:38.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc448400640 1 -- 172.21.15.88:0/1918148866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44013be20 con 0x7fc4401437d0 2024-04-24T08:25:38.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc448400640 1 -- 172.21.15.88:0/1918148866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44013c900 con 0x7fc4401437d0 2024-04-24T08:25:38.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.442+0000 7fc448400640 1 -- 172.21.15.88:0/1918148866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc440068c00 con 0x7fc4401437d0 2024-04-24T08:25:38.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.446+0000 7fc43d600640 1 -- 172.21.15.88:0/1918148866 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc438014bc0 con 0x7fc4401437d0 2024-04-24T08:25:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.446+0000 7fc43d600640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc420068380 0x7fc42006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.446+0000 7fc43d600640 1 -- 172.21.15.88:0/1918148866 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc438087180 con 0x7fc4401437d0 2024-04-24T08:25:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.446+0000 7fc445a00640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc420068380 0x7fc42006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.446+0000 7fc445a00640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc420068380 0x7fc42006a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc4340079c0 tx=0x7fc434008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.450+0000 7fc43d600640 1 -- 172.21.15.88:0/1918148866 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc438057050 con 0x7fc4401437d0 2024-04-24T08:25:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.606+0000 7fc448400640 1 -- 172.21.15.88:0/1918148866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc44013bff0 con 0x7fc4401437d0 2024-04-24T08:25:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.606+0000 7fc43d600640 1 -- 172.21.15.88:0/1918148866 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fc43805b350 con 0x7fc4401437d0 2024-04-24T08:25:38.607 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-24T08:25:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.606+0000 7fc448400640 1 -- 172.21.15.88:0/1918148866 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc420068380 msgr2=0x7fc42006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.606+0000 7fc448400640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc420068380 0x7fc42006a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc4340079c0 tx=0x7fc434008040 comp rx=0 tx=0).stop 2024-04-24T08:25:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.606+0000 7fc448400640 1 -- 172.21.15.88:0/1918148866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4401437d0 msgr2=0x7fc440137650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.606+0000 7fc448400640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4401437d0 0x7fc440137650 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc438007e60 tx=0x7fc43800e4b0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.610+0000 7fc448400640 1 -- 172.21.15.88:0/1918148866 shutdown_connections 2024-04-24T08:25:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.610+0000 7fc448400640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc420068380 0x7fc42006a840 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.610+0000 7fc448400640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4401437d0 0x7fc440137650 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.610+0000 7fc448400640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4400b01a0 0x7fc440143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.610+0000 7fc448400640 1 --2- 172.21.15.88:0/1918148866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4400737c0 0x7fc4401e3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.610+0000 7fc448400640 1 -- 172.21.15.88:0/1918148866 >> 172.21.15.88:0/1918148866 conn(0x7fc4400b9690 msgr2=0x7fc44013dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.610+0000 7fc448400640 1 -- 172.21.15.88:0/1918148866 shutdown_connections 2024-04-24T08:25:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.610+0000 7fc448400640 1 -- 172.21.15.88:0/1918148866 wait complete. 2024-04-24T08:25:38.628 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T08:25:38.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3cc200640 1 Processor -- start 2024-04-24T08:25:38.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3cc200640 1 -- start start 2024-04-24T08:25:38.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3cc200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff3c406cbe0 0x7ff3c40b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3cc200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3c4142060 0x7ff3c41525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3cc200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c40bc390 con 0x7ff3c40bbfb0 2024-04-24T08:25:38.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3cc200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c406e640 con 0x7ff3c406cbe0 2024-04-24T08:25:38.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3cc200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c406e920 con 0x7ff3c4142060 2024-04-24T08:25:38.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3c8e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff3c406cbe0 0x7ff3c40b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3ca200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3c4142060 0x7ff3c41525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3c8e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff3c406cbe0 0x7ff3c40b7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:52194/0 (socket says 172.21.15.88:52194) 2024-04-24T08:25:38.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3c9800640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff3c40bbfb0 0x7ff3c4141950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:35616/0 (socket says 172.21.15.88:35616) 2024-04-24T08:25:38.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3c9800640 1 -- 172.21.15.88:0/3201149742 learned_addr learned my addr 172.21.15.88:0/3201149742 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:38.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3ca200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3c4142060 0x7ff3c41525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:33612/0 (socket says 172.21.15.88:33612) 2024-04-24T08:25:38.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3c8e00640 1 -- 172.21.15.88:0/3201149742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3c4142060 msgr2=0x7ff3c41525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:38.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3c8e00640 1 --2- 172.21.15.88:0/3201149742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3c4142060 0x7ff3c41525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3c8e00640 1 -- 172.21.15.88:0/3201149742 >> v1:172.21.15.142:6789/0 conn(0x7ff3c40bbfb0 legacy=0x7ff3c4141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3c8e00640 1 -- 172.21.15.88:0/3201149742 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c406e2d0 con 0x7ff3c406cbe0 2024-04-24T08:25:38.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3c3e00640 1 -- 172.21.15.88:0/3201149742 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453919729 0 0) 0x7ff3c40bc390 con 0x7ff3c40bbfb0 2024-04-24T08:25:38.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.766+0000 7ff3ca200640 1 --2- 172.21.15.88:0/3201149742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3c4142060 0x7ff3c41525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:38.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.770+0000 7ff3c8e00640 1 --2- 172.21.15.88:0/3201149742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3c406cbe0 0x7ff3c40b7210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00097c0 tx=0x7ff3b001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac4dbdb7169039d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.770+0000 7ff3c3e00640 1 -- 172.21.15.88:0/3201149742 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b00b0070 con 0x7ff3c406cbe0 2024-04-24T08:25:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.770+0000 7ff3c3e00640 1 -- 172.21.15.88:0/3201149742 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b00ab600 con 0x7ff3c406cbe0 2024-04-24T08:25:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.770+0000 7ff3c3e00640 1 -- 172.21.15.88:0/3201149742 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b00ab9d0 con 0x7ff3c406cbe0 2024-04-24T08:25:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.770+0000 7ff3cc200640 1 -- 172.21.15.88:0/3201149742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3c406cbe0 msgr2=0x7ff3c40b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.770+0000 7ff3cc200640 1 --2- 172.21.15.88:0/3201149742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3c406cbe0 0x7ff3c40b7210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00097c0 tx=0x7ff3b001c4a0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.770+0000 7ff3cc200640 1 -- 172.21.15.88:0/3201149742 shutdown_connections 2024-04-24T08:25:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.770+0000 7ff3cc200640 1 --2- 172.21.15.88:0/3201149742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3c4142060 0x7ff3c41525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.770+0000 7ff3cc200640 1 --2- 172.21.15.88:0/3201149742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3c406cbe0 0x7ff3c40b7210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.770+0000 7ff3cc200640 1 -- 172.21.15.88:0/3201149742 >> 172.21.15.88:0/3201149742 conn(0x7ff3c4067e40 msgr2=0x7ff3c40bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.770+0000 7ff3cc200640 1 -- 172.21.15.88:0/3201149742 shutdown_connections 2024-04-24T08:25:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.770+0000 7ff3cc200640 1 -- 172.21.15.88:0/3201149742 wait complete. 2024-04-24T08:25:38.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3cc200640 1 Processor -- start 2024-04-24T08:25:38.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3cc200640 1 -- start start 2024-04-24T08:25:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3cc200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3c406cbe0 0x7ff3c4149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3cc200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3c40bbfb0 0x7ff3c414a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3cc200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3c4142060 0x7ff3c4148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3cc200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c41556d0 con 0x7ff3c4142060 2024-04-24T08:25:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3cc200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c4155550 con 0x7ff3c406cbe0 2024-04-24T08:25:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3cc200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c4155850 con 0x7ff3c40bbfb0 2024-04-24T08:25:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3ca200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3c4142060 0x7ff3c4148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3c9800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3c406cbe0 0x7ff3c4149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3ca200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3c4142060 0x7ff3c4148e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49576/0 (socket says 172.21.15.88:49576) 2024-04-24T08:25:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3ca200640 1 -- 172.21.15.88:0/2903015721 learned_addr learned my addr 172.21.15.88:0/2903015721 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3c8e00640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3c40bbfb0 0x7ff3c414a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3ca200640 1 -- 172.21.15.88:0/2903015721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3c40bbfb0 msgr2=0x7ff3c414a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3ca200640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3c40bbfb0 0x7ff3c414a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3ca200640 1 -- 172.21.15.88:0/2903015721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3c406cbe0 msgr2=0x7ff3c4149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3ca200640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3c406cbe0 0x7ff3c4149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3ca200640 1 -- 172.21.15.88:0/2903015721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c4142dd0 con 0x7ff3c4142060 2024-04-24T08:25:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3ca200640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3c4142060 0x7ff3c4148e20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00e960 tx=0x7ff3bc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3c1600640 1 -- 172.21.15.88:0/2903015721 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc017070 con 0x7ff3c4142060 2024-04-24T08:25:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3c1600640 1 -- 172.21.15.88:0/2903015721 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3bc00ca00 con 0x7ff3c4142060 2024-04-24T08:25:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3cc200640 1 -- 172.21.15.88:0/2903015721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c4143320 con 0x7ff3c4142060 2024-04-24T08:25:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3c1600640 1 -- 172.21.15.88:0/2903015721 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc00ce10 con 0x7ff3c4142060 2024-04-24T08:25:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3cc200640 1 -- 172.21.15.88:0/2903015721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c41e41f0 con 0x7ff3c4142060 2024-04-24T08:25:38.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.774+0000 7ff3cc200640 1 -- 172.21.15.88:0/2903015721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c4068c00 con 0x7ff3c4142060 2024-04-24T08:25:38.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.778+0000 7ff3c1600640 1 -- 172.21.15.88:0/2903015721 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff3bc013470 con 0x7ff3c4142060 2024-04-24T08:25:38.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.778+0000 7ff3c1600640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff3a4068380 0x7ff3a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:38.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.778+0000 7ff3c1600640 1 -- 172.21.15.88:0/2903015721 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff3bc0862f0 con 0x7ff3c4142060 2024-04-24T08:25:38.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.778+0000 7ff3c9800640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff3a4068380 0x7ff3a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:38.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.778+0000 7ff3c9800640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff3a4068380 0x7ff3a406a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8004fd0 tx=0x7ff3b8001770 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:38.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.782+0000 7ff3c1600640 1 -- 172.21.15.88:0/2903015721 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff3bc0562f0 con 0x7ff3c4142060 2024-04-24T08:25:38.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 -- 172.21.15.88:0/2903015721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff3c4143040 con 0x7ff3c4142060 2024-04-24T08:25:38.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3c1600640 1 -- 172.21.15.88:0/2903015721 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7ff3bc05a5f0 con 0x7ff3c4142060 2024-04-24T08:25:38.938 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-24T08:25:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 -- 172.21.15.88:0/2903015721 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff3a4068380 msgr2=0x7ff3a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff3a4068380 0x7ff3a406a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8004fd0 tx=0x7ff3b8001770 comp rx=0 tx=0).stop 2024-04-24T08:25:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 -- 172.21.15.88:0/2903015721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3c4142060 msgr2=0x7ff3c4148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3c4142060 0x7ff3c4148e20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00e960 tx=0x7ff3bc00ee20 comp rx=0 tx=0).stop 2024-04-24T08:25:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 -- 172.21.15.88:0/2903015721 shutdown_connections 2024-04-24T08:25:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff3a4068380 0x7ff3a406a840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3c4142060 0x7ff3c4148e20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3c40bbfb0 0x7ff3c414a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 --2- 172.21.15.88:0/2903015721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3c406cbe0 0x7ff3c4149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:38.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 -- 172.21.15.88:0/2903015721 >> 172.21.15.88:0/2903015721 conn(0x7ff3c4067e40 msgr2=0x7ff3c40b80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:38.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 -- 172.21.15.88:0/2903015721 shutdown_connections 2024-04-24T08:25:38.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:38.938+0000 7ff3cc200640 1 -- 172.21.15.88:0/2903015721 wait complete. 2024-04-24T08:25:38.958 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:25:39.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5619200640 1 Processor -- start 2024-04-24T08:25:39.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5619200640 1 -- start start 2024-04-24T08:25:39.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5619200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56140b7400 0x7f56140ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5619200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f56140a94c0 0x7f5614145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5619200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56140b64e0 con 0x7f56141466b0 2024-04-24T08:25:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5619200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f56140b77e0 con 0x7f56140a94c0 2024-04-24T08:25:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5619200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f56140b69e0 con 0x7f56140b7400 2024-04-24T08:25:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5611400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f56140a94c0 0x7f5614145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5611400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f56140a94c0 0x7f5614145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49584/0 (socket says 172.21.15.88:49584) 2024-04-24T08:25:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5611400640 1 -- 172.21.15.88:0/1303548326 learned_addr learned my addr 172.21.15.88:0/1303548326 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5611e00640 1 --2- 172.21.15.88:0/1303548326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56140b7400 0x7f56140ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5611400640 1 -- 172.21.15.88:0/1303548326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56140b7400 msgr2=0x7f56140ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5611400640 1 --2- 172.21.15.88:0/1303548326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56140b7400 0x7f56140ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5611400640 1 -- 172.21.15.88:0/1303548326 >> v1:172.21.15.142:6789/0 conn(0x7f56141466b0 legacy=0x7f5614149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.094+0000 7f5611400640 1 -- 172.21.15.88:0/1303548326 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56140b6700 con 0x7f56140a94c0 2024-04-24T08:25:39.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5611400640 1 --2- 172.21.15.88:0/1303548326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56140a94c0 0x7f5614145ec0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5600009870 tx=0x7f560001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eced8792090ced1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:39.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5610a00640 1 -- 172.21.15.88:0/1303548326 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56000b2070 con 0x7f56140a94c0 2024-04-24T08:25:39.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5610a00640 1 -- 172.21.15.88:0/1303548326 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56000a9070 con 0x7f56140a94c0 2024-04-24T08:25:39.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5610a00640 1 -- 172.21.15.88:0/1303548326 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56000ad880 con 0x7f56140a94c0 2024-04-24T08:25:39.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5619200640 1 -- 172.21.15.88:0/1303548326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56140a94c0 msgr2=0x7f5614145ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5619200640 1 --2- 172.21.15.88:0/1303548326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56140a94c0 0x7f5614145ec0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5600009870 tx=0x7f560001c490 comp rx=0 tx=0).stop 2024-04-24T08:25:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5619200640 1 -- 172.21.15.88:0/1303548326 shutdown_connections 2024-04-24T08:25:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5619200640 1 --2- 172.21.15.88:0/1303548326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56140a94c0 0x7f5614145ec0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5619200640 1 --2- 172.21.15.88:0/1303548326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56140b7400 0x7f56140ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5619200640 1 -- 172.21.15.88:0/1303548326 >> 172.21.15.88:0/1303548326 conn(0x7f5614067810 msgr2=0x7f5614067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5619200640 1 -- 172.21.15.88:0/1303548326 shutdown_connections 2024-04-24T08:25:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5619200640 1 -- 172.21.15.88:0/1303548326 wait complete. 2024-04-24T08:25:39.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.098+0000 7f5619200640 1 Processor -- start 2024-04-24T08:25:39.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5619200640 1 -- start start 2024-04-24T08:25:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5619200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56140b7400 0x7f5614135dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5619200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56141466b0 0x7f56141381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5619200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f561413f6b0 0x7f5614136a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5619200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5614153920 con 0x7f561413f6b0 2024-04-24T08:25:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5619200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f56141537a0 con 0x7f56140b7400 2024-04-24T08:25:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5619200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5614153aa0 con 0x7f56141466b0 2024-04-24T08:25:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5612800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f561413f6b0 0x7f5614136a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5612800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f561413f6b0 0x7f5614136a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49586/0 (socket says 172.21.15.88:49586) 2024-04-24T08:25:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5612800640 1 -- 172.21.15.88:0/232832090 learned_addr learned my addr 172.21.15.88:0/232832090 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5611400640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56141466b0 0x7f56141381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5611e00640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56140b7400 0x7f5614135dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5612800640 1 -- 172.21.15.88:0/232832090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56141466b0 msgr2=0x7f56141381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5612800640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56141466b0 0x7f56141381f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5612800640 1 -- 172.21.15.88:0/232832090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56140b7400 msgr2=0x7f5614135dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5612800640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56140b7400 0x7f5614135dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5612800640 1 -- 172.21.15.88:0/232832090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5614137d60 con 0x7f561413f6b0 2024-04-24T08:25:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5612800640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f561413f6b0 0x7f5614136a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f560c00c3c0 tx=0x7f560c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f560a000640 1 -- 172.21.15.88:0/232832090 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c011790 con 0x7f561413f6b0 2024-04-24T08:25:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f560a000640 1 -- 172.21.15.88:0/232832090 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560c017070 con 0x7f561413f6b0 2024-04-24T08:25:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f560a000640 1 -- 172.21.15.88:0/232832090 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c011b70 con 0x7f561413f6b0 2024-04-24T08:25:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5619200640 1 -- 172.21.15.88:0/232832090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5614138730 con 0x7f561413f6b0 2024-04-24T08:25:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5619200640 1 -- 172.21.15.88:0/232832090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5614134ef0 con 0x7f561413f6b0 2024-04-24T08:25:39.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.102+0000 7f5619200640 1 -- 172.21.15.88:0/232832090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5614068b90 con 0x7f561413f6b0 2024-04-24T08:25:39.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.106+0000 7f560a000640 1 -- 172.21.15.88:0/232832090 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f560c011d10 con 0x7f561413f6b0 2024-04-24T08:25:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.106+0000 7f560a000640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f55f4068380 0x7f55f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.106+0000 7f560a000640 1 -- 172.21.15.88:0/232832090 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f560c086630 con 0x7f561413f6b0 2024-04-24T08:25:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.106+0000 7f5611e00640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f55f4068380 0x7f55f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.106+0000 7f5611e00640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f55f4068380 0x7f55f406a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5604003ab0 tx=0x7f5604009830 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:39.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.110+0000 7f560a000640 1 -- 172.21.15.88:0/232832090 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f560c056630 con 0x7f561413f6b0 2024-04-24T08:25:39.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.298+0000 7f5619200640 1 -- 172.21.15.88:0/232832090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5614144ee0 con 0x7f561413f6b0 2024-04-24T08:25:39.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.298+0000 7f560a000640 1 -- 172.21.15.88:0/232832090 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7f560c05a930 con 0x7f561413f6b0 2024-04-24T08:25:39.301 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:39.301 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1421585339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1421585339},{"type":"v1","addr":"172.21.15.142:6833","nonce":1421585339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:25:27.478065+0000","modified":"2024-04-24T08:25:30.500783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2851985776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2851985776},{"type":"v1","addr":"172.21.15.88:6835","nonce":2851985776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-24T08:25:39.301 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2024-04-24T08:25:39.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.302+0000 7f5619200640 1 -- 172.21.15.88:0/232832090 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f55f4068380 msgr2=0x7f55f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.302+0000 7f5619200640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f55f4068380 0x7f55f406a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5604003ab0 tx=0x7f5604009830 comp rx=0 tx=0).stop 2024-04-24T08:25:39.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.302+0000 7f5619200640 1 -- 172.21.15.88:0/232832090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f561413f6b0 msgr2=0x7f5614136a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.302+0000 7f5619200640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f561413f6b0 0x7f5614136a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f560c00c3c0 tx=0x7f560c00c880 comp rx=0 tx=0).stop 2024-04-24T08:25:39.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.302+0000 7f5619200640 1 -- 172.21.15.88:0/232832090 shutdown_connections 2024-04-24T08:25:39.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.302+0000 7f5619200640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f55f4068380 0x7f55f406a840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.302+0000 7f5619200640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f561413f6b0 0x7f5614136a00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.302+0000 7f5619200640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56141466b0 0x7f56141381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.302+0000 7f5619200640 1 --2- 172.21.15.88:0/232832090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56140b7400 0x7f5614135dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.302+0000 7f5619200640 1 -- 172.21.15.88:0/232832090 >> 172.21.15.88:0/232832090 conn(0x7f5614067810 msgr2=0x7f56140bad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:39.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.302+0000 7f5619200640 1 -- 172.21.15.88:0/232832090 shutdown_connections 2024-04-24T08:25:39.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.302+0000 7f5619200640 1 -- 172.21.15.88:0/232832090 wait complete. 2024-04-24T08:25:39.321 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:39.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddbb200640 1 Processor -- start 2024-04-24T08:25:39.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddbb200640 1 -- start start 2024-04-24T08:25:39.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddbb200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fddbc148ee0 0x7fddbc0b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddbb200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddbc0bc220 con 0x7fddbc0bbe40 2024-04-24T08:25:39.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddbb200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddbc0b46d0 con 0x7fddbc13f630 2024-04-24T08:25:39.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddbb200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fddbc0b3c20 con 0x7fddbc148ee0 2024-04-24T08:25:39.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fddbc0bbe40 0x7fddbc0b5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39474/0 (socket says 172.21.15.88:39474) 2024-04-24T08:25:39.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9e00640 1 -- 172.21.15.88:0/2337992781 learned_addr learned my addr 172.21.15.88:0/2337992781 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb3e00640 1 --2- 172.21.15.88:0/2337992781 >> v2:172.21.15.142:3300/0 conn(0x7fddbc148ee0 0x7fddbc0b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2890274163 0 0) 0x7fddbc0bc220 con 0x7fddbc0bbe40 2024-04-24T08:25:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdda0003530 con 0x7fddbc0bbe40 2024-04-24T08:25:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4216515814 0 0) 0x7fdda0003530 con 0x7fddbc0bbe40 2024-04-24T08:25:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 >> v2:172.21.15.142:3300/0 conn(0x7fddbc148ee0 msgr2=0x7fddbc0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 --2- 172.21.15.88:0/2337992781 >> v2:172.21.15.142:3300/0 conn(0x7fddbc148ee0 0x7fddbc0b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 >> v1:172.21.15.142:6789/0 conn(0x7fddbc13f630 legacy=0x7fddbc150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc0b4f00 con 0x7fddbc0bbe40 2024-04-24T08:25:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7fddac001680 con 0x7fddbc0bbe40 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb3e00640 1 --2- 172.21.15.88:0/2337992781 >> v2:172.21.15.142:3300/0 conn(0x7fddbc148ee0 0x7fddbc0b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 >> v1:172.21.15.88:6789/0 conn(0x7fddbc0bbe40 legacy=0x7fddbc0b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 --2- 172.21.15.88:0/2337992781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdda00039c0 0x7fdda0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 --2- 172.21.15.88:0/2337992781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdda0004810 0x7fdda0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 --2- 172.21.15.88:0/2337992781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda00052f0 0x7fdda000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc0b3c20 con 0x7fdda00052f0 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdda000c1c0 con 0x7fdda0004810 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdda000c3c0 con 0x7fdda00039c0 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddba800640 1 --2- 172.21.15.88:0/2337992781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda00052f0 0x7fdda000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb9e00640 1 --2- 172.21.15.88:0/2337992781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdda00039c0 0x7fdda0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddb3e00640 1 --2- 172.21.15.88:0/2337992781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdda0004810 0x7fdda0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddba800640 1 -- 172.21.15.88:0/2337992781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdda00039c0 msgr2=0x7fdda0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddba800640 1 --2- 172.21.15.88:0/2337992781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdda00039c0 0x7fdda0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddba800640 1 -- 172.21.15.88:0/2337992781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdda0004810 msgr2=0x7fdda0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:39.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddba800640 1 --2- 172.21.15.88:0/2337992781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdda0004810 0x7fdda0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.458+0000 7fddba800640 1 -- 172.21.15.88:0/2337992781 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda0003530 con 0x7fdda00052f0 2024-04-24T08:25:39.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.462+0000 7fddba800640 1 -- 172.21.15.88:0/2337992781 reap_dead start 2024-04-24T08:25:39.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.462+0000 7fddba800640 1 --2- 172.21.15.88:0/2337992781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda00052f0 0x7fdda000b9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fddb4001e40 tx=0x7fddb401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3510afa4e25771 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:39.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.462+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4001a90 con 0x7fdda00052f0 2024-04-24T08:25:39.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.462+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb4003b80 con 0x7fdda00052f0 2024-04-24T08:25:39.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.462+0000 7fddb9400640 1 -- 172.21.15.88:0/2337992781 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb40050d0 con 0x7fdda00052f0 2024-04-24T08:25:39.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.462+0000 7fddbb200640 1 -- 172.21.15.88:0/2337992781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda00052f0 msgr2=0x7fdda000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.462+0000 7fddbb200640 1 --2- 172.21.15.88:0/2337992781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda00052f0 0x7fdda000b9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fddb4001e40 tx=0x7fddb401c700 comp rx=0 tx=0).stop 2024-04-24T08:25:39.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.462+0000 7fddbb200640 1 -- 172.21.15.88:0/2337992781 shutdown_connections 2024-04-24T08:25:39.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.462+0000 7fddbb200640 1 --2- 172.21.15.88:0/2337992781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda00052f0 0x7fdda000b9d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.462+0000 7fddbb200640 1 -- 172.21.15.88:0/2337992781 >> 172.21.15.88:0/2337992781 conn(0x7fddbc067e10 msgr2=0x7fddbc0bb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:39.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.462+0000 7fddbb200640 1 -- 172.21.15.88:0/2337992781 shutdown_connections 2024-04-24T08:25:39.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.462+0000 7fddbb200640 1 -- 172.21.15.88:0/2337992781 wait complete. 2024-04-24T08:25:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddbb200640 1 Processor -- start 2024-04-24T08:25:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddbb200640 1 -- start start 2024-04-24T08:25:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddbb200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdda00052f0 0x7fddbc06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddbb200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddbc1369d0 0x7fddbc147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddbb200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddbc147dc0 0x7fddbc0b92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddbb200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc0b41a0 con 0x7fddbc1369d0 2024-04-24T08:25:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddbb200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc0b4020 con 0x7fddbc147dc0 2024-04-24T08:25:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddbb200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fddbc0b4320 con 0x7fdda00052f0 2024-04-24T08:25:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb3e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddbc1369d0 0x7fddbc147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb3e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddbc1369d0 0x7fddbc147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49614/0 (socket says 172.21.15.88:49614) 2024-04-24T08:25:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb3e00640 1 -- 172.21.15.88:0/630488532 learned_addr learned my addr 172.21.15.88:0/630488532 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb9e00640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdda00052f0 0x7fddbc06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddba800640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddbc147dc0 0x7fddbc0b92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb3e00640 1 -- 172.21.15.88:0/630488532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdda00052f0 msgr2=0x7fddbc06e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb3e00640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdda00052f0 0x7fddbc06e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb3e00640 1 -- 172.21.15.88:0/630488532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddbc147dc0 msgr2=0x7fddbc0b92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb3e00640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddbc147dc0 0x7fddbc0b92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb3e00640 1 -- 172.21.15.88:0/630488532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc148230 con 0x7fddbc1369d0 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddba800640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddbc147dc0 0x7fddbc0b92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb3e00640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddbc1369d0 0x7fddbc147880 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdda4011a50 tx=0x7fdda4011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb2000640 1 -- 172.21.15.88:0/630488532 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda400fc50 con 0x7fddbc1369d0 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb2000640 1 -- 172.21.15.88:0/630488532 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda400fdf0 con 0x7fddbc1369d0 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb2000640 1 -- 172.21.15.88:0/630488532 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda4004270 con 0x7fddbc1369d0 2024-04-24T08:25:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddbb200640 1 -- 172.21.15.88:0/630488532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddbc146e60 con 0x7fddbc1369d0 2024-04-24T08:25:39.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddbb200640 1 -- 172.21.15.88:0/630488532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddbc137500 con 0x7fddbc1369d0 2024-04-24T08:25:39.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddbb200640 1 -- 172.21.15.88:0/630488532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddbc068b20 con 0x7fddbc1369d0 2024-04-24T08:25:39.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.466+0000 7fddb2000640 1 -- 172.21.15.88:0/630488532 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdda4012040 con 0x7fddbc1369d0 2024-04-24T08:25:39.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.470+0000 7fddb2000640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fdd98068380 0x7fdd9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.470+0000 7fddb2000640 1 -- 172.21.15.88:0/630488532 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdda4086eb0 con 0x7fddbc1369d0 2024-04-24T08:25:39.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.470+0000 7fddb9e00640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fdd98068380 0x7fdd9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.470+0000 7fddb9e00640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fdd98068380 0x7fdd9806a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fddac001760 tx=0x7fddac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:39.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.474+0000 7fddb2000640 1 -- 172.21.15.88:0/630488532 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdda4019070 con 0x7fddbc1369d0 2024-04-24T08:25:39.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 -- 172.21.15.88:0/630488532 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fddbc06edf0 con 0x7fddbc1369d0 2024-04-24T08:25:39.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddb2000640 1 -- 172.21.15.88:0/630488532 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fdda4057500 con 0x7fddbc1369d0 2024-04-24T08:25:39.631 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:39.631 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 -- 172.21.15.88:0/630488532 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fdd98068380 msgr2=0x7fdd9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fdd98068380 0x7fdd9806a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fddac001760 tx=0x7fddac009040 comp rx=0 tx=0).stop 2024-04-24T08:25:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 -- 172.21.15.88:0/630488532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddbc1369d0 msgr2=0x7fddbc147880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddbc1369d0 0x7fddbc147880 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdda4011a50 tx=0x7fdda4011f10 comp rx=0 tx=0).stop 2024-04-24T08:25:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 -- 172.21.15.88:0/630488532 shutdown_connections 2024-04-24T08:25:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fdd98068380 0x7fdd9806a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddbc147dc0 0x7fddbc0b92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddbc1369d0 0x7fddbc147880 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 --2- 172.21.15.88:0/630488532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdda00052f0 0x7fddbc06e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 -- 172.21.15.88:0/630488532 >> 172.21.15.88:0/630488532 conn(0x7fddbc067e10 msgr2=0x7fddbc0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 -- 172.21.15.88:0/630488532 shutdown_connections 2024-04-24T08:25:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.630+0000 7fddbb200640 1 -- 172.21.15.88:0/630488532 wait complete. 2024-04-24T08:25:39.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T08:25:25.116395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T08:25:26.444475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:25:39.652 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:25:39.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b7c00640 1 Processor -- start 2024-04-24T08:25:39.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b7c00640 1 -- start start 2024-04-24T08:25:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b7c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f26b0073020 0x7f26b014b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b7c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b00b5d30 0x7f26b006c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b7c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b0067e50 con 0x7f26b0067a70 2024-04-24T08:25:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b7c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f26b00af500 con 0x7f26b0073020 2024-04-24T08:25:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b7c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f26b00b4790 con 0x7f26b00b5d30 2024-04-24T08:25:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b5c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b00b5d30 0x7f26b006c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b5c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b00b5d30 0x7f26b006c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:33640/0 (socket says 172.21.15.88:33640) 2024-04-24T08:25:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b5c00640 1 -- 172.21.15.88:0/69062397 learned_addr learned my addr 172.21.15.88:0/69062397 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26afe00640 1 --2- 172.21.15.88:0/69062397 >> v2:172.21.15.142:3300/0 conn(0x7f26b0073020 0x7f26b014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b5c00640 1 -- 172.21.15.88:0/69062397 >> v2:172.21.15.142:3300/0 conn(0x7f26b0073020 msgr2=0x7f26b014b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b5c00640 1 --2- 172.21.15.88:0/69062397 >> v2:172.21.15.142:3300/0 conn(0x7f26b0073020 0x7f26b014b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b5c00640 1 -- 172.21.15.88:0/69062397 >> v1:172.21.15.142:6789/0 conn(0x7f26b0067a70 legacy=0x7f26b006bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.790+0000 7f26b5c00640 1 -- 172.21.15.88:0/69062397 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b00b4a70 con 0x7f26b00b5d30 2024-04-24T08:25:39.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.794+0000 7f26b5c00640 1 --2- 172.21.15.88:0/69062397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b00b5d30 0x7f26b006c1e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009e50 tx=0x7f26a801c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f742bbe69f77212 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:39.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.794+0000 7f26af400640 1 -- 172.21.15.88:0/69062397 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a80a55d0 con 0x7f26b00b5d30 2024-04-24T08:25:39.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.794+0000 7f26af400640 1 -- 172.21.15.88:0/69062397 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a80a5770 con 0x7f26b00b5d30 2024-04-24T08:25:39.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.794+0000 7f26af400640 1 -- 172.21.15.88:0/69062397 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a80a5b40 con 0x7f26b00b5d30 2024-04-24T08:25:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.794+0000 7f26b7c00640 1 -- 172.21.15.88:0/69062397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b00b5d30 msgr2=0x7f26b006c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.794+0000 7f26b7c00640 1 --2- 172.21.15.88:0/69062397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b00b5d30 0x7f26b006c1e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009e50 tx=0x7f26a801c910 comp rx=0 tx=0).stop 2024-04-24T08:25:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.794+0000 7f26b7c00640 1 -- 172.21.15.88:0/69062397 shutdown_connections 2024-04-24T08:25:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.794+0000 7f26b7c00640 1 --2- 172.21.15.88:0/69062397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b00b5d30 0x7f26b006c1e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.794+0000 7f26b7c00640 1 --2- 172.21.15.88:0/69062397 >> v2:172.21.15.142:3300/0 conn(0x7f26b0073020 0x7f26b014b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.794+0000 7f26b7c00640 1 -- 172.21.15.88:0/69062397 >> 172.21.15.88:0/69062397 conn(0x7f26b00b9cf0 msgr2=0x7f26b00ba100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.794+0000 7f26b7c00640 1 -- 172.21.15.88:0/69062397 shutdown_connections 2024-04-24T08:25:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.794+0000 7f26b7c00640 1 -- 172.21.15.88:0/69062397 wait complete. 2024-04-24T08:25:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b7c00640 1 Processor -- start 2024-04-24T08:25:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b7c00640 1 -- start start 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b7c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b0067a70 0x7f26b0071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b7c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26b0073020 0x7f26b00b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b7c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26b00b5d30 0x7f26b013d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b7c00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f26b0155390 con 0x7f26b00b5d30 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b7c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f26b00b5170 con 0x7f26b0073020 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b7c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f26b0155510 con 0x7f26b0067a70 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b5c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26b00b5d30 0x7f26b013d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b5c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26b00b5d30 0x7f26b013d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49620/0 (socket says 172.21.15.88:49620) 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b5c00640 1 -- 172.21.15.88:0/2487369733 learned_addr learned my addr 172.21.15.88:0/2487369733 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26afe00640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26b0073020 0x7f26b00b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b5200640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b0067a70 0x7f26b0071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b5c00640 1 -- 172.21.15.88:0/2487369733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b0067a70 msgr2=0x7f26b0071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b5c00640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b0067a70 0x7f26b0071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b5c00640 1 -- 172.21.15.88:0/2487369733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26b0073020 msgr2=0x7f26b00b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b5c00640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26b0073020 0x7f26b00b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b5c00640 1 -- 172.21.15.88:0/2487369733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b00b2c10 con 0x7f26b00b5d30 2024-04-24T08:25:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b5c00640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26b00b5d30 0x7f26b013d220 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f26a801a540 tx=0x7f26a80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26acc00640 1 -- 172.21.15.88:0/2487369733 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a80bc020 con 0x7f26b00b5d30 2024-04-24T08:25:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26acc00640 1 -- 172.21.15.88:0/2487369733 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a80b8670 con 0x7f26b00b5d30 2024-04-24T08:25:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b7c00640 1 -- 172.21.15.88:0/2487369733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b01411c0 con 0x7f26b00b5d30 2024-04-24T08:25:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26acc00640 1 -- 172.21.15.88:0/2487369733 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a80a55d0 con 0x7f26b00b5d30 2024-04-24T08:25:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b7c00640 1 -- 172.21.15.88:0/2487369733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b00b2930 con 0x7f26b00b5d30 2024-04-24T08:25:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.798+0000 7f26b7c00640 1 -- 172.21.15.88:0/2487369733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b00b35f0 con 0x7f26b00b5d30 2024-04-24T08:25:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.802+0000 7f26acc00640 1 -- 172.21.15.88:0/2487369733 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f26a80bf020 con 0x7f26b00b5d30 2024-04-24T08:25:39.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.802+0000 7f26acc00640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2690068380 0x7f269006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:39.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.802+0000 7f26acc00640 1 -- 172.21.15.88:0/2487369733 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f26a8121650 con 0x7f26b00b5d30 2024-04-24T08:25:39.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.802+0000 7f26b5200640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2690068380 0x7f269006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:39.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.802+0000 7f26b5200640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2690068380 0x7f269006a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f26a4007fd0 tx=0x7f26a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.806+0000 7f26acc00640 1 -- 172.21.15.88:0/2487369733 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f26a80c6030 con 0x7f26b00b5d30 2024-04-24T08:25:39.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.962+0000 7f26b7c00640 1 -- 172.21.15.88:0/2487369733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f26b0068c00 con 0x7f26b00b5d30 2024-04-24T08:25:39.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.962+0000 7f26acc00640 1 -- 172.21.15.88:0/2487369733 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f26a8016620 con 0x7f26b00b5d30 2024-04-24T08:25:39.963 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:25:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.962+0000 7f26b7c00640 1 -- 172.21.15.88:0/2487369733 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2690068380 msgr2=0x7f269006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.962+0000 7f26b7c00640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2690068380 0x7f269006a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f26a4007fd0 tx=0x7f26a4009040 comp rx=0 tx=0).stop 2024-04-24T08:25:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.966+0000 7f26b7c00640 1 -- 172.21.15.88:0/2487369733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26b00b5d30 msgr2=0x7f26b013d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.966+0000 7f26b7c00640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26b00b5d30 0x7f26b013d220 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f26a801a540 tx=0x7f26a80196b0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.966+0000 7f26b7c00640 1 -- 172.21.15.88:0/2487369733 shutdown_connections 2024-04-24T08:25:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.966+0000 7f26b7c00640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2690068380 0x7f269006a840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.966+0000 7f26b7c00640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26b00b5d30 0x7f26b013d220 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.966+0000 7f26b7c00640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26b0073020 0x7f26b00b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.966+0000 7f26b7c00640 1 --2- 172.21.15.88:0/2487369733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b0067a70 0x7f26b0071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.966+0000 7f26b7c00640 1 -- 172.21.15.88:0/2487369733 >> 172.21.15.88:0/2487369733 conn(0x7f26b00b9cf0 msgr2=0x7f26b00b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.966+0000 7f26b7c00640 1 -- 172.21.15.88:0/2487369733 shutdown_connections 2024-04-24T08:25:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:39.966+0000 7f26b7c00640 1 -- 172.21.15.88:0/2487369733 wait complete. 2024-04-24T08:25:39.984 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T08:25:40.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.122+0000 7f1d17400640 1 Processor -- start 2024-04-24T08:25:40.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.122+0000 7f1d17400640 1 -- start start 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d17400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d10146690 0x7f1d1009e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d17400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d1006e490 0x7f1d1009e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d17400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d1006d4f0 con 0x7f1d100b4c90 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d17400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f1d1006d2a0 con 0x7f1d10146690 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d17400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1d1006d7d0 con 0x7f1d1006e490 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d07e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d10146690 0x7f1d1009e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d07e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d10146690 0x7f1d1009e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49622/0 (socket says 172.21.15.88:49622) 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d07e00640 1 -- 172.21.15.88:0/1243912215 learned_addr learned my addr 172.21.15.88:0/1243912215 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d15400640 1 --2- 172.21.15.88:0/1243912215 >> v2:172.21.15.142:3300/0 conn(0x7f1d1006e490 0x7f1d1009e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d07e00640 1 -- 172.21.15.88:0/1243912215 >> v2:172.21.15.142:3300/0 conn(0x7f1d1006e490 msgr2=0x7f1d1009e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d07e00640 1 --2- 172.21.15.88:0/1243912215 >> v2:172.21.15.142:3300/0 conn(0x7f1d1006e490 0x7f1d1009e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d07e00640 1 -- 172.21.15.88:0/1243912215 >> v1:172.21.15.142:6789/0 conn(0x7f1d100b4c90 legacy=0x7f1d10145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d07e00640 1 -- 172.21.15.88:0/1243912215 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1009c570 con 0x7f1d10146690 2024-04-24T08:25:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d15400640 1 --2- 172.21.15.88:0/1243912215 >> v2:172.21.15.142:3300/0 conn(0x7f1d1006e490 0x7f1d1009e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:40.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d07e00640 1 --2- 172.21.15.88:0/1243912215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d10146690 0x7f1d1009e090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d100b54d0 tx=0x7f1cf801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e6781944152295 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:40.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d0fe00640 1 -- 172.21.15.88:0/1243912215 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80b0070 con 0x7f1d10146690 2024-04-24T08:25:40.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.126+0000 7f1d0fe00640 1 -- 172.21.15.88:0/1243912215 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf80ab600 con 0x7f1d10146690 2024-04-24T08:25:40.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d0fe00640 1 -- 172.21.15.88:0/1243912215 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80ab9d0 con 0x7f1d10146690 2024-04-24T08:25:40.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 -- 172.21.15.88:0/1243912215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d10146690 msgr2=0x7f1d1009e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 --2- 172.21.15.88:0/1243912215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d10146690 0x7f1d1009e090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d100b54d0 tx=0x7f1cf801c490 comp rx=0 tx=0).stop 2024-04-24T08:25:40.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 -- 172.21.15.88:0/1243912215 shutdown_connections 2024-04-24T08:25:40.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 --2- 172.21.15.88:0/1243912215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d10146690 0x7f1d1009e090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 --2- 172.21.15.88:0/1243912215 >> v2:172.21.15.142:3300/0 conn(0x7f1d1006e490 0x7f1d1009e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 -- 172.21.15.88:0/1243912215 >> 172.21.15.88:0/1243912215 conn(0x7f1d100b9690 msgr2=0x7f1d100b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:40.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 -- 172.21.15.88:0/1243912215 shutdown_connections 2024-04-24T08:25:40.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 -- 172.21.15.88:0/1243912215 wait complete. 2024-04-24T08:25:40.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 Processor -- start 2024-04-24T08:25:40.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 -- start start 2024-04-24T08:25:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d1006e490 0x7f1d101430a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d100b4c90 0x7f1d10141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d10146690 0x7f1d101de620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10152fc0 con 0x7f1d100b4c90 2024-04-24T08:25:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10152e40 con 0x7f1d10146690 2024-04-24T08:25:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d17400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1d10153140 con 0x7f1d1006e490 2024-04-24T08:25:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d07e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d100b4c90 0x7f1d10141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d07e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d100b4c90 0x7f1d10141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49632/0 (socket says 172.21.15.88:49632) 2024-04-24T08:25:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d07e00640 1 -- 172.21.15.88:0/3095295365 learned_addr learned my addr 172.21.15.88:0/3095295365 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d15400640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d10146690 0x7f1d101de620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d14a00640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d1006e490 0x7f1d101430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d07e00640 1 -- 172.21.15.88:0/3095295365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d1006e490 msgr2=0x7f1d101430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d07e00640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d1006e490 0x7f1d101430a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d07e00640 1 -- 172.21.15.88:0/3095295365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d10146690 msgr2=0x7f1d101de620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d07e00640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d10146690 0x7f1d101de620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d07e00640 1 -- 172.21.15.88:0/3095295365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d10142640 con 0x7f1d100b4c90 2024-04-24T08:25:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d15400640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d10146690 0x7f1d101de620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.130+0000 7f1d07e00640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d100b4c90 0x7f1d10141060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80190a0 tx=0x7f1cf8019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.134+0000 7f1d0d600640 1 -- 172.21.15.88:0/3095295365 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80b0040 con 0x7f1d100b4c90 2024-04-24T08:25:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.134+0000 7f1d0d600640 1 -- 172.21.15.88:0/3095295365 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf80b4620 con 0x7f1d100b4c90 2024-04-24T08:25:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.134+0000 7f1d0d600640 1 -- 172.21.15.88:0/3095295365 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80b4a10 con 0x7f1d100b4c90 2024-04-24T08:25:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.134+0000 7f1d17400640 1 -- 172.21.15.88:0/3095295365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d10142920 con 0x7f1d100b4c90 2024-04-24T08:25:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.134+0000 7f1d17400640 1 -- 172.21.15.88:0/3095295365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d100b2f00 con 0x7f1d100b4c90 2024-04-24T08:25:40.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.134+0000 7f1d17400640 1 -- 172.21.15.88:0/3095295365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d10068c00 con 0x7f1d100b4c90 2024-04-24T08:25:40.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.134+0000 7f1d0d600640 1 -- 172.21.15.88:0/3095295365 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1cf80ab4c0 con 0x7f1d100b4c90 2024-04-24T08:25:40.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.134+0000 7f1d0d600640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1cec068380 0x7f1cec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.134+0000 7f1d0d600640 1 -- 172.21.15.88:0/3095295365 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1cf8120560 con 0x7f1d100b4c90 2024-04-24T08:25:40.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.134+0000 7f1d14a00640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1cec068380 0x7f1cec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.134+0000 7f1d14a00640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1cec068380 0x7f1cec06a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d1009e360 tx=0x7f1d00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:40.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.138+0000 7f1d0d600640 1 -- 172.21.15.88:0/3095295365 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1cf8016110 con 0x7f1d100b4c90 2024-04-24T08:25:40.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 -- 172.21.15.88:0/3095295365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1d101501f0 con 0x7f1d100b4c90 2024-04-24T08:25:40.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d0d600640 1 -- 172.21.15.88:0/3095295365 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f1cf80f0b10 con 0x7f1d100b4c90 2024-04-24T08:25:40.299 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-24T08:25:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 -- 172.21.15.88:0/3095295365 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1cec068380 msgr2=0x7f1cec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1cec068380 0x7f1cec06a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d1009e360 tx=0x7f1d00009040 comp rx=0 tx=0).stop 2024-04-24T08:25:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 -- 172.21.15.88:0/3095295365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d100b4c90 msgr2=0x7f1d10141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d100b4c90 0x7f1d10141060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80190a0 tx=0x7f1cf8019230 comp rx=0 tx=0).stop 2024-04-24T08:25:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 -- 172.21.15.88:0/3095295365 shutdown_connections 2024-04-24T08:25:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1cec068380 0x7f1cec06a840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d10146690 0x7f1d101de620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d100b4c90 0x7f1d10141060 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 --2- 172.21.15.88:0/3095295365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d1006e490 0x7f1d101430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 -- 172.21.15.88:0/3095295365 >> 172.21.15.88:0/3095295365 conn(0x7f1d100b9690 msgr2=0x7f1d100b6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:40.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 -- 172.21.15.88:0/3095295365 shutdown_connections 2024-04-24T08:25:40.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.298+0000 7f1d17400640 1 -- 172.21.15.88:0/3095295365 wait complete. 2024-04-24T08:25:40.320 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T08:25:40.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7ef200640 1 Processor -- start 2024-04-24T08:25:40.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7ef200640 1 -- start start 2024-04-24T08:25:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7ef200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa7e80b01a0 0x7fa7e806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7ef200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7e813f090 0x7fa7e814f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7ef200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7e80b0580 con 0x7fa7e80ae4e0 2024-04-24T08:25:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7ef200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa7e80b59d0 con 0x7fa7e813f090 2024-04-24T08:25:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7ef200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa7e80ae970 con 0x7fa7e80b01a0 2024-04-24T08:25:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7ed200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7e813f090 0x7fa7e814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7df400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa7e80ae4e0 0x7fa7e813e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39478/0 (socket says 172.21.15.88:39478) 2024-04-24T08:25:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7df400640 1 -- 172.21.15.88:0/3243382804 learned_addr learned my addr 172.21.15.88:0/3243382804 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7e7e00640 1 --2- 172.21.15.88:0/3243382804 >> v2:172.21.15.142:3300/0 conn(0x7fa7e80b01a0 0x7fa7e806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7ed200640 1 -- 172.21.15.88:0/3243382804 >> v2:172.21.15.142:3300/0 conn(0x7fa7e80b01a0 msgr2=0x7fa7e806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7ed200640 1 --2- 172.21.15.88:0/3243382804 >> v2:172.21.15.142:3300/0 conn(0x7fa7e80b01a0 0x7fa7e806d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7ed200640 1 -- 172.21.15.88:0/3243382804 >> v1:172.21.15.88:6789/0 conn(0x7fa7e80ae4e0 legacy=0x7fa7e813e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7ed200640 1 -- 172.21.15.88:0/3243382804 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e80b53a0 con 0x7fa7e813f090 2024-04-24T08:25:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7e7e00640 1 --2- 172.21.15.88:0/3243382804 >> v2:172.21.15.142:3300/0 conn(0x7fa7e80b01a0 0x7fa7e806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.458+0000 7fa7e7400640 1 -- 172.21.15.88:0/3243382804 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250839636 0 0) 0x7fa7e80b0580 con 0x7fa7e80ae4e0 2024-04-24T08:25:40.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.462+0000 7fa7ed200640 1 --2- 172.21.15.88:0/3243382804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e813f090 0x7fa7e814f430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa7e806ee20 tx=0x7fa7e001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e36da400d8adb43 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:40.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.462+0000 7fa7e7400640 1 -- 172.21.15.88:0/3243382804 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00b0070 con 0x7fa7e813f090 2024-04-24T08:25:40.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.462+0000 7fa7e7400640 1 -- 172.21.15.88:0/3243382804 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e00ab600 con 0x7fa7e813f090 2024-04-24T08:25:40.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.462+0000 7fa7e7400640 1 -- 172.21.15.88:0/3243382804 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00ab9d0 con 0x7fa7e813f090 2024-04-24T08:25:40.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.462+0000 7fa7ef200640 1 -- 172.21.15.88:0/3243382804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e813f090 msgr2=0x7fa7e814f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.462+0000 7fa7ef200640 1 --2- 172.21.15.88:0/3243382804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e813f090 0x7fa7e814f430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa7e806ee20 tx=0x7fa7e001c360 comp rx=0 tx=0).stop 2024-04-24T08:25:40.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.462+0000 7fa7ef200640 1 -- 172.21.15.88:0/3243382804 shutdown_connections 2024-04-24T08:25:40.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.462+0000 7fa7ef200640 1 --2- 172.21.15.88:0/3243382804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e813f090 0x7fa7e814f430 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.462+0000 7fa7ef200640 1 --2- 172.21.15.88:0/3243382804 >> v2:172.21.15.142:3300/0 conn(0x7fa7e80b01a0 0x7fa7e806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.462+0000 7fa7ef200640 1 -- 172.21.15.88:0/3243382804 >> 172.21.15.88:0/3243382804 conn(0x7fa7e80b9690 msgr2=0x7fa7e80b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:40.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.462+0000 7fa7ef200640 1 -- 172.21.15.88:0/3243382804 shutdown_connections 2024-04-24T08:25:40.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.462+0000 7fa7ef200640 1 -- 172.21.15.88:0/3243382804 wait complete. 2024-04-24T08:25:40.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ef200640 1 Processor -- start 2024-04-24T08:25:40.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ef200640 1 -- start start 2024-04-24T08:25:40.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ef200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b01a0 0x7fa7e8137840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ef200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e813f090 0x7fa7e80704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ef200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e8072300 0x7fa7e8070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ef200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e8152310 con 0x7fa7e80b01a0 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ef200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e8152190 con 0x7fa7e813f090 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ef200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa7e8152490 con 0x7fa7e8072300 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7e7e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b01a0 0x7fa7e8137840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7e7e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b01a0 0x7fa7e8137840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49644/0 (socket says 172.21.15.88:49644) 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7e7e00640 1 -- 172.21.15.88:0/2329200216 learned_addr learned my addr 172.21.15.88:0/2329200216 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ed200640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e8072300 0x7fa7e8070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7df400640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e813f090 0x7fa7e80704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7e7e00640 1 -- 172.21.15.88:0/2329200216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e8072300 msgr2=0x7fa7e8070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7e7e00640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e8072300 0x7fa7e8070a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7e7e00640 1 -- 172.21.15.88:0/2329200216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e813f090 msgr2=0x7fa7e80704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7e7e00640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e813f090 0x7fa7e80704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7e7e00640 1 -- 172.21.15.88:0/2329200216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e80727e0 con 0x7fa7e80b01a0 2024-04-24T08:25:40.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ed200640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e8072300 0x7fa7e8070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:40.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7e7e00640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b01a0 0x7fa7e8137840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8007fa0 tx=0x7fa7d800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:40.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7e4c00640 1 -- 172.21.15.88:0/2329200216 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d801a070 con 0x7fa7e80b01a0 2024-04-24T08:25:40.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7e4c00640 1 -- 172.21.15.88:0/2329200216 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d8003ba0 con 0x7fa7e80b01a0 2024-04-24T08:25:40.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7e4c00640 1 -- 172.21.15.88:0/2329200216 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8004030 con 0x7fa7e80b01a0 2024-04-24T08:25:40.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ef200640 1 -- 172.21.15.88:0/2329200216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e8073180 con 0x7fa7e80b01a0 2024-04-24T08:25:40.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ef200640 1 -- 172.21.15.88:0/2329200216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e8138390 con 0x7fa7e80b01a0 2024-04-24T08:25:40.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.466+0000 7fa7ef200640 1 -- 172.21.15.88:0/2329200216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e8068c00 con 0x7fa7e80b01a0 2024-04-24T08:25:40.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.470+0000 7fa7e4c00640 1 -- 172.21.15.88:0/2329200216 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa7d801d070 con 0x7fa7e80b01a0 2024-04-24T08:25:40.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.470+0000 7fa7e4c00640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7c40683b0 0x7fa7c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.470+0000 7fa7e4c00640 1 -- 172.21.15.88:0/2329200216 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa7d8086c70 con 0x7fa7e80b01a0 2024-04-24T08:25:40.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.470+0000 7fa7df400640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7c40683b0 0x7fa7c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.470+0000 7fa7df400640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7c40683b0 0x7fa7c406a870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa7e813c640 tx=0x7fa7d0007b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:40.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.474+0000 7fa7e4c00640 1 -- 172.21.15.88:0/2329200216 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa7d8010070 con 0x7fa7e80b01a0 2024-04-24T08:25:40.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 -- 172.21.15.88:0/2329200216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa7e80714d0 con 0x7fa7e80b01a0 2024-04-24T08:25:40.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7e4c00640 1 -- 172.21.15.88:0/2329200216 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fa7d8056b40 con 0x7fa7e80b01a0 2024-04-24T08:25:40.634 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-24T08:25:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 -- 172.21.15.88:0/2329200216 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7c40683b0 msgr2=0x7fa7c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7c40683b0 0x7fa7c406a870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa7e813c640 tx=0x7fa7d0007b80 comp rx=0 tx=0).stop 2024-04-24T08:25:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 -- 172.21.15.88:0/2329200216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b01a0 msgr2=0x7fa7e8137840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b01a0 0x7fa7e8137840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8007fa0 tx=0x7fa7d800d560 comp rx=0 tx=0).stop 2024-04-24T08:25:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 -- 172.21.15.88:0/2329200216 shutdown_connections 2024-04-24T08:25:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7c40683b0 0x7fa7c406a870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e8072300 0x7fa7e8070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e813f090 0x7fa7e80704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 --2- 172.21.15.88:0/2329200216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b01a0 0x7fa7e8137840 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 -- 172.21.15.88:0/2329200216 >> 172.21.15.88:0/2329200216 conn(0x7fa7e80b9690 msgr2=0x7fa7e80b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:40.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 -- 172.21.15.88:0/2329200216 shutdown_connections 2024-04-24T08:25:40.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.634+0000 7fa7ef200640 1 -- 172.21.15.88:0/2329200216 wait complete. 2024-04-24T08:25:40.655 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:25:40.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa961200640 1 Processor -- start 2024-04-24T08:25:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa961200640 1 -- start start 2024-04-24T08:25:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa961200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa95c0a94c0 0x7fa95c0ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa961200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa95c0b64e0 con 0x7fa95c145ec0 2024-04-24T08:25:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa961200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa95c0b77e0 con 0x7fa95c0b7400 2024-04-24T08:25:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa961200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa95c0b69e0 con 0x7fa95c0a94c0 2024-04-24T08:25:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa951400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa95c0a94c0 0x7fa95c0ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa951400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa95c0a94c0 0x7fa95c0ab360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49656/0 (socket says 172.21.15.88:49656) 2024-04-24T08:25:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa95a800640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa95c145ec0 0x7fa95c150780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39490/0 (socket says 172.21.15.88:39490) 2024-04-24T08:25:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa951400640 1 -- 172.21.15.88:0/2390077069 learned_addr learned my addr 172.21.15.88:0/2390077069 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa951400640 1 -- 172.21.15.88:0/2390077069 >> v1:172.21.15.142:6789/0 conn(0x7fa95c0b7400 legacy=0x7fa95c1466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa951400640 1 -- 172.21.15.88:0/2390077069 >> v1:172.21.15.88:6789/0 conn(0x7fa95c145ec0 legacy=0x7fa95c150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa951400640 1 -- 172.21.15.88:0/2390077069 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95c0b6700 con 0x7fa95c0a94c0 2024-04-24T08:25:40.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.790+0000 7fa959400640 1 -- 172.21.15.88:0/2390077069 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459953007 0 0) 0x7fa95c0b64e0 con 0x7fa95c145ec0 2024-04-24T08:25:40.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa951400640 1 --2- 172.21.15.88:0/2390077069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa95c0a94c0 0x7fa95c0ab360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa944009870 tx=0x7fa94401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd589ac712d3a395 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:40.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa959400640 1 -- 172.21.15.88:0/2390077069 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440b1070 con 0x7fa95c0a94c0 2024-04-24T08:25:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa959400640 1 -- 172.21.15.88:0/2390077069 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9440ac600 con 0x7fa95c0a94c0 2024-04-24T08:25:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa959400640 1 -- 172.21.15.88:0/2390077069 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440ac9d0 con 0x7fa95c0a94c0 2024-04-24T08:25:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa961200640 1 -- 172.21.15.88:0/2390077069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa95c0a94c0 msgr2=0x7fa95c0ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa961200640 1 --2- 172.21.15.88:0/2390077069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa95c0a94c0 0x7fa95c0ab360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa944009870 tx=0x7fa94401c4d0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa961200640 1 -- 172.21.15.88:0/2390077069 shutdown_connections 2024-04-24T08:25:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa961200640 1 --2- 172.21.15.88:0/2390077069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa95c0a94c0 0x7fa95c0ab360 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa961200640 1 -- 172.21.15.88:0/2390077069 >> 172.21.15.88:0/2390077069 conn(0x7fa95c067810 msgr2=0x7fa95c067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa961200640 1 -- 172.21.15.88:0/2390077069 shutdown_connections 2024-04-24T08:25:40.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa961200640 1 -- 172.21.15.88:0/2390077069 wait complete. 2024-04-24T08:25:40.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa961200640 1 Processor -- start 2024-04-24T08:25:40.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.794+0000 7fa961200640 1 -- start start 2024-04-24T08:25:40.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa961200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa95c0b7400 0x7fa95c0aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa961200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa95c145ec0 0x7fa95c0ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa961200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1483b0 0x7fa95c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa961200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c0b7cd0 con 0x7fa95c0b7400 2024-04-24T08:25:40.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa961200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c0b5eb0 con 0x7fa95c145ec0 2024-04-24T08:25:40.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa961200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa95c0b7e50 con 0x7fa95c1483b0 2024-04-24T08:25:40.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa959e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa95c0b7400 0x7fa95c0aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa959e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa95c0b7400 0x7fa95c0aca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49660/0 (socket says 172.21.15.88:49660) 2024-04-24T08:25:40.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa959e00640 1 -- 172.21.15.88:0/460057909 learned_addr learned my addr 172.21.15.88:0/460057909 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:40.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa951400640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa95c145ec0 0x7fa95c0ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa95a800640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1483b0 0x7fa95c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa959e00640 1 -- 172.21.15.88:0/460057909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1483b0 msgr2=0x7fa95c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa959e00640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1483b0 0x7fa95c0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa959e00640 1 -- 172.21.15.88:0/460057909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa95c145ec0 msgr2=0x7fa95c0ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:40.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa959e00640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa95c145ec0 0x7fa95c0ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:40.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa959e00640 1 -- 172.21.15.88:0/460057909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95c0ac2d0 con 0x7fa95c0b7400 2024-04-24T08:25:40.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa95a800640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1483b0 0x7fa95c0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:40.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa959e00640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa95c0b7400 0x7fa95c0aca90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00c7d0 tx=0x7fa94c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:40.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa952a00640 1 -- 172.21.15.88:0/460057909 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c003b80 con 0x7fa95c0b7400 2024-04-24T08:25:40.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa952a00640 1 -- 172.21.15.88:0/460057909 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94c003d20 con 0x7fa95c0b7400 2024-04-24T08:25:40.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa961200640 1 -- 172.21.15.88:0/460057909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95c0aeb10 con 0x7fa95c0b7400 2024-04-24T08:25:40.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa952a00640 1 -- 172.21.15.88:0/460057909 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00aa90 con 0x7fa95c0b7400 2024-04-24T08:25:40.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa961200640 1 -- 172.21.15.88:0/460057909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa95c0adc30 con 0x7fa95c0b7400 2024-04-24T08:25:40.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa961200640 1 -- 172.21.15.88:0/460057909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa95c068b90 con 0x7fa95c0b7400 2024-04-24T08:25:40.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.798+0000 7fa952a00640 1 -- 172.21.15.88:0/460057909 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa94c00ac30 con 0x7fa95c0b7400 2024-04-24T08:25:40.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.802+0000 7fa952a00640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9380683b0 0x7fa93806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:40.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.802+0000 7fa952a00640 1 -- 172.21.15.88:0/460057909 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa94c086790 con 0x7fa95c0b7400 2024-04-24T08:25:40.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.802+0000 7fa951400640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9380683b0 0x7fa93806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:40.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.802+0000 7fa951400640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9380683b0 0x7fa93806a870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9440ae000 tx=0x7fa9440a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:40.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.806+0000 7fa952a00640 1 -- 172.21.15.88:0/460057909 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa94c056de0 con 0x7fa95c0b7400 2024-04-24T08:25:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 -- 172.21.15.88:0/460057909 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa95c0ac720 con 0x7fa95c0b7400 2024-04-24T08:25:41.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa952a00640 1 -- 172.21.15.88:0/460057909 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7fa94c0566e0 con 0x7fa95c0b7400 2024-04-24T08:25:41.005 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:41.005 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1421585339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1421585339},{"type":"v1","addr":"172.21.15.142:6833","nonce":1421585339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:25:27.478065+0000","modified":"2024-04-24T08:25:30.500783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2851985776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2851985776},{"type":"v1","addr":"172.21.15.88:6835","nonce":2851985776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-24T08:25:41.006 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2024-04-24T08:25:41.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 -- 172.21.15.88:0/460057909 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9380683b0 msgr2=0x7fa93806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9380683b0 0x7fa93806a870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9440ae000 tx=0x7fa9440a7000 comp rx=0 tx=0).stop 2024-04-24T08:25:41.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 -- 172.21.15.88:0/460057909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa95c0b7400 msgr2=0x7fa95c0aca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa95c0b7400 0x7fa95c0aca90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00c7d0 tx=0x7fa94c00cc90 comp rx=0 tx=0).stop 2024-04-24T08:25:41.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 -- 172.21.15.88:0/460057909 shutdown_connections 2024-04-24T08:25:41.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9380683b0 0x7fa93806a870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1483b0 0x7fa95c0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa95c145ec0 0x7fa95c0ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 --2- 172.21.15.88:0/460057909 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa95c0b7400 0x7fa95c0aca90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 -- 172.21.15.88:0/460057909 >> 172.21.15.88:0/460057909 conn(0x7fa95c067810 msgr2=0x7fa95c0ba990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:41.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 -- 172.21.15.88:0/460057909 shutdown_connections 2024-04-24T08:25:41.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:40.998+0000 7fa961200640 1 -- 172.21.15.88:0/460057909 wait complete. 2024-04-24T08:25:41.023 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:41.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f2aa00640 1 Processor -- start 2024-04-24T08:25:41.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f2aa00640 1 -- start start 2024-04-24T08:25:41.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f2aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f240ab360 0x7f6f24145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f2aa00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f240b64e0 con 0x7f6f240b7400 2024-04-24T08:25:41.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f2aa00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f240b77e0 con 0x7f6f240a94c0 2024-04-24T08:25:41.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f2aa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6f240b69e0 con 0x7f6f240ab360 2024-04-24T08:25:41.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6f240b7400 0x7f6f241466b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39494/0 (socket says 172.21.15.88:39494) 2024-04-24T08:25:41.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23e00640 1 -- 172.21.15.88:0/2038438464 learned_addr learned my addr 172.21.15.88:0/2038438464 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:41.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f28a00640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f240ab360 0x7f6f24145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711642258 0 0) 0x7f6f240b64e0 con 0x7f6f240b7400 2024-04-24T08:25:41.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f08003530 con 0x7f6f240b7400 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1138216325 0 0) 0x7f6f08003530 con 0x7f6f240b7400 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f240ab360 msgr2=0x7f6f24145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f240ab360 0x7f6f24145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 >> v1:172.21.15.142:6789/0 conn(0x7f6f240a94c0 legacy=0x7f6f2414e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f240b6700 con 0x7f6f240b7400 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f6f14001680 con 0x7f6f240b7400 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 >> v1:172.21.15.88:6789/0 conn(0x7f6f240b7400 legacy=0x7f6f241466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f240ab360 0x7f6f080039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f08003f30 0x7f6f08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f08004d50 0x7f6f080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6f240b69e0 con 0x7f6f08004d50 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0800bae0 con 0x7f6f08003f30 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0800bce0 con 0x7f6f240ab360 2024-04-24T08:25:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f28a00640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f08004d50 0x7f6f080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f1b400640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f08003f30 0x7f6f08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f23e00640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f240ab360 0x7f6f080039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f28a00640 1 -- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f240ab360 msgr2=0x7f6f080039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f28a00640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f240ab360 0x7f6f080039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f28a00640 1 -- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f08003f30 msgr2=0x7f6f08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f28a00640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f08003f30 0x7f6f08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.162+0000 7f6f28a00640 1 -- 172.21.15.88:0/2038438464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f08003530 con 0x7f6f08004d50 2024-04-24T08:25:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f23e00640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f240ab360 0x7f6f080039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f1b400640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f08003f30 0x7f6f08004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:41.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f28a00640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f08004d50 0x7f6f080051d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009fc0 tx=0x7f6f1c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1e30effdc5a6f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:41.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0b2070 con 0x7f6f08004d50 2024-04-24T08:25:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f1c0a5c90 con 0x7f6f08004d50 2024-04-24T08:25:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f23400640 1 -- 172.21.15.88:0/2038438464 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c009c10 con 0x7f6f08004d50 2024-04-24T08:25:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2038438464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f08004d50 msgr2=0x7f6f080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f2aa00640 1 --2- 172.21.15.88:0/2038438464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f08004d50 0x7f6f080051d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009fc0 tx=0x7f6f1c01cc80 comp rx=0 tx=0).stop 2024-04-24T08:25:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f28a00640 1 -- 172.21.15.88:0/2038438464 reap_dead start 2024-04-24T08:25:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2038438464 shutdown_connections 2024-04-24T08:25:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2038438464 >> 172.21.15.88:0/2038438464 conn(0x7f6f24067810 msgr2=0x7f6f24067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2038438464 shutdown_connections 2024-04-24T08:25:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.166+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2038438464 wait complete. 2024-04-24T08:25:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f2aa00640 1 Processor -- start 2024-04-24T08:25:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f2aa00640 1 -- start start 2024-04-24T08:25:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f2aa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f08004d50 0x7f6f24142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f2aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241e1340 0x7f6f241e17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f2aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f2413d680 0x7f6f2413db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f2aa00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6f240b5eb0 con 0x7f6f08004d50 2024-04-24T08:25:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f2aa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24146dc0 con 0x7f6f241e1340 2024-04-24T08:25:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f2aa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6f240b7cd0 con 0x7f6f2413d680 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f23e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f08004d50 0x7f6f24142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f23e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f08004d50 0x7f6f24142800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49676/0 (socket says 172.21.15.88:49676) 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f23e00640 1 -- 172.21.15.88:0/2214890599 learned_addr learned my addr 172.21.15.88:0/2214890599 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f28a00640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f2413d680 0x7f6f2413db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f1b400640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241e1340 0x7f6f241e17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f23e00640 1 -- 172.21.15.88:0/2214890599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f2413d680 msgr2=0x7f6f2413db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f23e00640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f2413d680 0x7f6f2413db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f23e00640 1 -- 172.21.15.88:0/2214890599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241e1340 msgr2=0x7f6f241e17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f23e00640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241e1340 0x7f6f241e17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f23e00640 1 -- 172.21.15.88:0/2214890599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2406e4d0 con 0x7f6f08004d50 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f28a00640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f2413d680 0x7f6f2413db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f1b400640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241e1340 0x7f6f241e17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f23e00640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f08004d50 0x7f6f24142800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400e820 tx=0x7f6f1400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f20c00640 1 -- 172.21.15.88:0/2214890599 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1400c870 con 0x7f6f08004d50 2024-04-24T08:25:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f20c00640 1 -- 172.21.15.88:0/2214890599 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f14018070 con 0x7f6f08004d50 2024-04-24T08:25:41.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2214890599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f241e1d00 con 0x7f6f08004d50 2024-04-24T08:25:41.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f20c00640 1 -- 172.21.15.88:0/2214890599 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1400cc10 con 0x7f6f08004d50 2024-04-24T08:25:41.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.170+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2214890599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2406d260 con 0x7f6f08004d50 2024-04-24T08:25:41.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.174+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2214890599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f24068b90 con 0x7f6f08004d50 2024-04-24T08:25:41.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.174+0000 7f6f20c00640 1 -- 172.21.15.88:0/2214890599 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6f14013420 con 0x7f6f08004d50 2024-04-24T08:25:41.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.174+0000 7f6f20c00640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6f00068380 0x7f6f0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.174+0000 7f6f20c00640 1 -- 172.21.15.88:0/2214890599 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6f14086840 con 0x7f6f08004d50 2024-04-24T08:25:41.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.174+0000 7f6f1b400640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6f00068380 0x7f6f0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.174+0000 7f6f1b400640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6f00068380 0x7f6f0006a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c007bf0 tx=0x7f6f0c007a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:41.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.178+0000 7f6f20c00640 1 -- 172.21.15.88:0/2214890599 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6f241e1d00 con 0x7f6f08004d50 2024-04-24T08:25:41.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.334+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2214890599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f240b77e0 con 0x7f6f08004d50 2024-04-24T08:25:41.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f20c00640 1 -- 172.21.15.88:0/2214890599 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f6f14056df0 con 0x7f6f08004d50 2024-04-24T08:25:41.338 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:41.338 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:41.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2214890599 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6f00068380 msgr2=0x7f6f0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f2aa00640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6f00068380 0x7f6f0006a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c007bf0 tx=0x7f6f0c007a80 comp rx=0 tx=0).stop 2024-04-24T08:25:41.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2214890599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f08004d50 msgr2=0x7f6f24142800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f2aa00640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f08004d50 0x7f6f24142800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400e820 tx=0x7f6f1400ece0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2214890599 shutdown_connections 2024-04-24T08:25:41.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f2aa00640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6f00068380 0x7f6f0006a840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f2aa00640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f2413d680 0x7f6f2413db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f2aa00640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f241e1340 0x7f6f241e17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f2aa00640 1 --2- 172.21.15.88:0/2214890599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f08004d50 0x7f6f24142800 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2214890599 >> 172.21.15.88:0/2214890599 conn(0x7f6f24067810 msgr2=0x7f6f24067bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:41.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2214890599 shutdown_connections 2024-04-24T08:25:41.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.338+0000 7f6f2aa00640 1 -- 172.21.15.88:0/2214890599 wait complete. 2024-04-24T08:25:41.360 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:25:41.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.494+0000 7f6887800640 1 Processor -- start 2024-04-24T08:25:41.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.494+0000 7f6887800640 1 -- start start 2024-04-24T08:25:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.494+0000 7f6887800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f688009c730 0x7f688009e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.494+0000 7f6887800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68800afe00 0x7f68800986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.494+0000 7f6887800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6880098be0 0x7f688014b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.494+0000 7f6887800640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f68800b9ea0 con 0x7f688009c730 2024-04-24T08:25:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.494+0000 7f6887800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f688009cb10 con 0x7f6880098be0 2024-04-24T08:25:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.494+0000 7f6887800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f68800b02e0 con 0x7f68800afe00 2024-04-24T08:25:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.494+0000 7f6884e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f688009c730 0x7f688009e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.498+0000 7f6884e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f688009c730 0x7f688009e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49688/0 (socket says 172.21.15.88:49688) 2024-04-24T08:25:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.498+0000 7f6884e00640 1 -- 172.21.15.88:0/840756172 learned_addr learned my addr 172.21.15.88:0/840756172 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.498+0000 7f6884e00640 1 -- 172.21.15.88:0/840756172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68800afe00 msgr2=0x7f68800986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.498+0000 7f6884e00640 1 --2- 172.21.15.88:0/840756172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68800afe00 0x7f68800986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.498+0000 7f6884e00640 1 -- 172.21.15.88:0/840756172 >> v2:172.21.15.142:3300/0 conn(0x7f6880098be0 msgr2=0x7f688014b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.498+0000 7f6884e00640 1 --2- 172.21.15.88:0/840756172 >> v2:172.21.15.142:3300/0 conn(0x7f6880098be0 0x7f688014b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.498+0000 7f6884e00640 1 -- 172.21.15.88:0/840756172 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68800b9b30 con 0x7f688009c730 2024-04-24T08:25:41.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.498+0000 7f6884e00640 1 --2- 172.21.15.88:0/840756172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f688009c730 0x7f688009e0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f688009c270 tx=0x7f687401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436e1cefd6a4377e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:41.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.498+0000 7f687f400640 1 -- 172.21.15.88:0/840756172 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68740b0070 con 0x7f688009c730 2024-04-24T08:25:41.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.498+0000 7f687f400640 1 -- 172.21.15.88:0/840756172 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68740ab600 con 0x7f688009c730 2024-04-24T08:25:41.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.498+0000 7f687f400640 1 -- 172.21.15.88:0/840756172 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68740ab9d0 con 0x7f688009c730 2024-04-24T08:25:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 -- 172.21.15.88:0/840756172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f688009c730 msgr2=0x7f688009e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 --2- 172.21.15.88:0/840756172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f688009c730 0x7f688009e0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f688009c270 tx=0x7f687401c520 comp rx=0 tx=0).stop 2024-04-24T08:25:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 -- 172.21.15.88:0/840756172 shutdown_connections 2024-04-24T08:25:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 --2- 172.21.15.88:0/840756172 >> v2:172.21.15.142:3300/0 conn(0x7f6880098be0 0x7f688014b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 --2- 172.21.15.88:0/840756172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68800afe00 0x7f68800986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 --2- 172.21.15.88:0/840756172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f688009c730 0x7f688009e0f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 -- 172.21.15.88:0/840756172 >> 172.21.15.88:0/840756172 conn(0x7f688006c0d0 msgr2=0x7f68800b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 -- 172.21.15.88:0/840756172 shutdown_connections 2024-04-24T08:25:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 -- 172.21.15.88:0/840756172 wait complete. 2024-04-24T08:25:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 Processor -- start 2024-04-24T08:25:41.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 -- start start 2024-04-24T08:25:41.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6880098be0 0x7f6880071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f688009c730 0x7f6880151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68800afe00 0x7f6880152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f688006ddb0 con 0x7f68800afe00 2024-04-24T08:25:41.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f688006dc30 con 0x7f688009c730 2024-04-24T08:25:41.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f688006df30 con 0x7f6880098be0 2024-04-24T08:25:41.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6885800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68800afe00 0x7f6880152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6885800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68800afe00 0x7f6880152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49694/0 (socket says 172.21.15.88:49694) 2024-04-24T08:25:41.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6885800640 1 -- 172.21.15.88:0/1402410475 learned_addr learned my addr 172.21.15.88:0/1402410475 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:41.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f687fe00640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f688009c730 0x7f6880151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6884e00640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6880098be0 0x7f6880071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6885800640 1 -- 172.21.15.88:0/1402410475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6880098be0 msgr2=0x7f6880071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6885800640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6880098be0 0x7f6880071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6885800640 1 -- 172.21.15.88:0/1402410475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f688009c730 msgr2=0x7f6880151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6885800640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f688009c730 0x7f6880151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6885800640 1 -- 172.21.15.88:0/1402410475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688009bfa0 con 0x7f68800afe00 2024-04-24T08:25:41.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6885800640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68800afe00 0x7f6880152000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f687800b9a0 tx=0x7f687800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:41.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f687cc00640 1 -- 172.21.15.88:0/1402410475 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878019070 con 0x7f68800afe00 2024-04-24T08:25:41.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f687cc00640 1 -- 172.21.15.88:0/1402410475 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687800cbc0 con 0x7f68800afe00 2024-04-24T08:25:41.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 -- 172.21.15.88:0/1402410475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6880073340 con 0x7f68800afe00 2024-04-24T08:25:41.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f687cc00640 1 -- 172.21.15.88:0/1402410475 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878014440 con 0x7f68800afe00 2024-04-24T08:25:41.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.502+0000 7f6887800640 1 -- 172.21.15.88:0/1402410475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68801e0e30 con 0x7f68800afe00 2024-04-24T08:25:41.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.506+0000 7f6887800640 1 -- 172.21.15.88:0/1402410475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6880068b90 con 0x7f68800afe00 2024-04-24T08:25:41.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.506+0000 7f687cc00640 1 -- 172.21.15.88:0/1402410475 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f687801c070 con 0x7f68800afe00 2024-04-24T08:25:41.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.506+0000 7f687cc00640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6860068380 0x7f686006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:41.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.506+0000 7f687cc00640 1 -- 172.21.15.88:0/1402410475 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f68780865b0 con 0x7f68800afe00 2024-04-24T08:25:41.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.506+0000 7f6884e00640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6860068380 0x7f686006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:41.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.506+0000 7f6884e00640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6860068380 0x7f686006a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f68740ad000 tx=0x7f68740a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:41.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.510+0000 7f687cc00640 1 -- 172.21.15.88:0/1402410475 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f68780565b0 con 0x7f68800afe00 2024-04-24T08:25:41.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.698+0000 7f6887800640 1 -- 172.21.15.88:0/1402410475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f688014af10 con 0x7f68800afe00 2024-04-24T08:25:41.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f687cc00640 1 -- 172.21.15.88:0/1402410475 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7f687805a8b0 con 0x7f68800afe00 2024-04-24T08:25:41.701 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:41.702 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1421585339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1421585339},{"type":"v1","addr":"172.21.15.142:6833","nonce":1421585339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:25:27.478065+0000","modified":"2024-04-24T08:25:30.500783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2851985776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2851985776},{"type":"v1","addr":"172.21.15.88:6835","nonce":2851985776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-24T08:25:41.702 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2024-04-24T08:25:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f6887800640 1 -- 172.21.15.88:0/1402410475 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6860068380 msgr2=0x7f686006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f6887800640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6860068380 0x7f686006a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f68740ad000 tx=0x7f68740a6000 comp rx=0 tx=0).stop 2024-04-24T08:25:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f6887800640 1 -- 172.21.15.88:0/1402410475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68800afe00 msgr2=0x7f6880152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f6887800640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68800afe00 0x7f6880152000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f687800b9a0 tx=0x7f687800be60 comp rx=0 tx=0).stop 2024-04-24T08:25:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f6887800640 1 -- 172.21.15.88:0/1402410475 shutdown_connections 2024-04-24T08:25:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f6887800640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6860068380 0x7f686006a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f6887800640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68800afe00 0x7f6880152000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f6887800640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f688009c730 0x7f6880151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f6887800640 1 --2- 172.21.15.88:0/1402410475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6880098be0 0x7f6880071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f6887800640 1 -- 172.21.15.88:0/1402410475 >> 172.21.15.88:0/1402410475 conn(0x7f688006c0d0 msgr2=0x7f68800b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f6887800640 1 -- 172.21.15.88:0/1402410475 shutdown_connections 2024-04-24T08:25:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:41.702+0000 7f6887800640 1 -- 172.21.15.88:0/1402410475 wait complete. 2024-04-24T08:25:41.923 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T08:25:27.478065+0000', 'modified': '2024-04-24T08:25:30.500783+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6835/2851985776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6834', 'nonce': 2851985776}, {'type': 'v1', 'addr': '172.21.15.88:6835', 'nonce': 2851985776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4263, 'qdb_cluster': [4263]} 2024-04-24T08:25:41.924 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T08:25:41.924 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-24T08:25:42.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.058+0000 7f818fe00640 1 Processor -- start 2024-04-24T08:25:42.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.058+0000 7f818fe00640 1 -- start start 2024-04-24T08:25:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f818fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f818809c4d0 0x7f818809ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f818fe00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f818809d430 con 0x7f818809e2d0 2024-04-24T08:25:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f818fe00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f818809dea0 con 0x7f818809b620 2024-04-24T08:25:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f818fe00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f818806eb30 con 0x7f818809c4d0 2024-04-24T08:25:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f818de00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f818809e2d0 0x7f8188142ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39504/0 (socket says 172.21.15.88:39504) 2024-04-24T08:25:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f818de00640 1 -- 172.21.15.88:0/1718966508 learned_addr learned my addr 172.21.15.88:0/1718966508 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f818ca00640 1 --2- 172.21.15.88:0/1718966508 >> v2:172.21.15.142:3300/0 conn(0x7f818809c4d0 0x7f818809ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f8187e00640 1 -- 172.21.15.88:0/1718966508 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103036872 0 0) 0x7f818809d430 con 0x7f818809e2d0 2024-04-24T08:25:42.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f8187e00640 1 -- 172.21.15.88:0/1718966508 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8170003530 con 0x7f818809e2d0 2024-04-24T08:25:42.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f8187e00640 1 -- 172.21.15.88:0/1718966508 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3711194122 0 0) 0x7f818809dea0 con 0x7f818809b620 2024-04-24T08:25:42.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f8187e00640 1 -- 172.21.15.88:0/1718966508 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f818809d430 con 0x7f818809b620 2024-04-24T08:25:42.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f818ca00640 1 -- 172.21.15.88:0/1718966508 >> v1:172.21.15.142:6789/0 conn(0x7f818809b620 legacy=0x7f81881492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f818ca00640 1 -- 172.21.15.88:0/1718966508 >> v1:172.21.15.88:6789/0 conn(0x7f818809e2d0 legacy=0x7f8188142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.062+0000 7f818ca00640 1 -- 172.21.15.88:0/1718966508 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818809d6a0 con 0x7f818809c4d0 2024-04-24T08:25:42.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f818ca00640 1 --2- 172.21.15.88:0/1718966508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818809c4d0 0x7f818809ba00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f81740097f0 tx=0x7f817401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42c207be160dc1ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:42.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f8187e00640 1 -- 172.21.15.88:0/1718966508 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81740b0070 con 0x7f818809c4d0 2024-04-24T08:25:42.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f8187e00640 1 -- 172.21.15.88:0/1718966508 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81740ab600 con 0x7f818809c4d0 2024-04-24T08:25:42.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f8187e00640 1 -- 172.21.15.88:0/1718966508 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81740ab9d0 con 0x7f818809c4d0 2024-04-24T08:25:42.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f818fe00640 1 -- 172.21.15.88:0/1718966508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818809c4d0 msgr2=0x7f818809ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f818fe00640 1 --2- 172.21.15.88:0/1718966508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818809c4d0 0x7f818809ba00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f81740097f0 tx=0x7f817401c410 comp rx=0 tx=0).stop 2024-04-24T08:25:42.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f818fe00640 1 -- 172.21.15.88:0/1718966508 shutdown_connections 2024-04-24T08:25:42.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f818fe00640 1 --2- 172.21.15.88:0/1718966508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818809c4d0 0x7f818809ba00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f818fe00640 1 -- 172.21.15.88:0/1718966508 >> 172.21.15.88:0/1718966508 conn(0x7f81880b9420 msgr2=0x7f81880b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:42.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f818fe00640 1 -- 172.21.15.88:0/1718966508 shutdown_connections 2024-04-24T08:25:42.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f818fe00640 1 -- 172.21.15.88:0/1718966508 wait complete. 2024-04-24T08:25:42.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f818fe00640 1 Processor -- start 2024-04-24T08:25:42.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.066+0000 7f818fe00640 1 -- start start 2024-04-24T08:25:42.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f818809b620 0x7f8188138870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818809c4d0 0x7f81881e0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f818809e2d0 0x7f818813cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818fe00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8188153ba0 con 0x7f818809b620 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818fe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8188153a20 con 0x7f818809c4d0 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8188153d20 con 0x7f818809e2d0 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818d400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f818809b620 0x7f8188138870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818d400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f818809b620 0x7f8188138870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49698/0 (socket says 172.21.15.88:49698) 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818d400640 1 -- 172.21.15.88:0/1459633741 learned_addr learned my addr 172.21.15.88:0/1459633741 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818de00640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f818809e2d0 0x7f818813cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818ca00640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818809c4d0 0x7f81881e0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818d400640 1 -- 172.21.15.88:0/1459633741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f818809e2d0 msgr2=0x7f818813cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818d400640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f818809e2d0 0x7f818813cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818d400640 1 -- 172.21.15.88:0/1459633741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818809c4d0 msgr2=0x7f81881e0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818d400640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818809c4d0 0x7f81881e0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818d400640 1 -- 172.21.15.88:0/1459633741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81881e0dc0 con 0x7f818809b620 2024-04-24T08:25:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818d400640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f818809b620 0x7f8188138870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c500 tx=0x7f817c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f8185600640 1 -- 172.21.15.88:0/1459633741 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c0052d0 con 0x7f818809b620 2024-04-24T08:25:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f8185600640 1 -- 172.21.15.88:0/1459633741 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817c005490 con 0x7f818809b620 2024-04-24T08:25:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818fe00640 1 -- 172.21.15.88:0/1459633741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81881e1040 con 0x7f818809b620 2024-04-24T08:25:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f8185600640 1 -- 172.21.15.88:0/1459633741 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c012850 con 0x7f818809b620 2024-04-24T08:25:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.070+0000 7f818fe00640 1 -- 172.21.15.88:0/1459633741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8188139f60 con 0x7f818809b620 2024-04-24T08:25:42.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f8185600640 1 -- 172.21.15.88:0/1459633741 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f817c0129f0 con 0x7f818809b620 2024-04-24T08:25:42.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f8185600640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8168068380 0x7f816806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f8185600640 1 -- 172.21.15.88:0/1459633741 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f817c0866a0 con 0x7f818809b620 2024-04-24T08:25:42.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818ca00640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8168068380 0x7f816806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f8193240000 1 Processor -- start 2024-04-24T08:25:42.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f8193240000 1 -- start start 2024-04-24T08:25:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818ca00640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8168068380 0x7f816806a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f81740ad000 tx=0x7f8174008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f8193240000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a6bc80 0x5649f9a6c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f8193240000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a969d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f8193240000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 0x5649f9a972f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f8193240000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5649f994d6f0 con 0x5649f9a96f10 2024-04-24T08:25:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f8193240000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5649f98b44d0 con 0x5649f9a6bc80 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f8193240000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5649f984ebf0 con 0x5649f9a6c5a0 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818de00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 0x5649f9a972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818de00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 0x5649f9a972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49704/0 (socket says 172.21.15.88:49704) 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818de00640 1 -- 172.21.15.88:0/3688730511 learned_addr learned my addr 172.21.15.88:0/3688730511 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818ca00640 1 --2- 172.21.15.88:0/3688730511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818d400640 1 --2- 172.21.15.88:0/3688730511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a6bc80 0x5649f9a6c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818de00640 1 -- 172.21.15.88:0/3688730511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 msgr2=0x5649f9a969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818de00640 1 --2- 172.21.15.88:0/3688730511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818de00640 1 -- 172.21.15.88:0/3688730511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a6bc80 msgr2=0x5649f9a6c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818de00640 1 --2- 172.21.15.88:0/3688730511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a6bc80 0x5649f9a6c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818de00640 1 -- 172.21.15.88:0/3688730511 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f984ee40 con 0x5649f9a96f10 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818d400640 1 --2- 172.21.15.88:0/3688730511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a6bc80 0x5649f9a6c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f818de00640 1 --2- 172.21.15.88:0/3688730511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 0x5649f9a972f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8180001fb0 tx=0x7f818000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6969048d35edf2d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f817a000640 1 -- 172.21.15.88:0/3688730511 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180019070 con 0x5649f9a96f10 2024-04-24T08:25:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f817a000640 1 -- 172.21.15.88:0/3688730511 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f818000ee50 con 0x5649f9a96f10 2024-04-24T08:25:42.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.074+0000 7f817a000640 1 -- 172.21.15.88:0/3688730511 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180014680 con 0x5649f9a96f10 2024-04-24T08:25:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 -- 172.21.15.88:0/3688730511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 msgr2=0x5649f9a972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 --2- 172.21.15.88:0/3688730511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 0x5649f9a972f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8180001fb0 tx=0x7f818000e530 comp rx=0 tx=0).stop 2024-04-24T08:25:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 -- 172.21.15.88:0/3688730511 shutdown_connections 2024-04-24T08:25:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 --2- 172.21.15.88:0/3688730511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 0x5649f9a972f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 --2- 172.21.15.88:0/3688730511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 --2- 172.21.15.88:0/3688730511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a6bc80 0x5649f9a6c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 -- 172.21.15.88:0/3688730511 >> 172.21.15.88:0/3688730511 conn(0x5649f9a92780 msgr2=0x5649f9a94b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 -- 172.21.15.88:0/3688730511 shutdown_connections 2024-04-24T08:25:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 -- 172.21.15.88:0/3688730511 wait complete. 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 -- start start 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 Processor -- start 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a6bc80 0x5649f9a6b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a9cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 0x5649f9a9d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5649f9970e50 con 0x5649f9a96f10 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5649f9871a60 con 0x5649f9a6bc80 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5649f986fcf0 con 0x5649f9a6c5a0 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 10 client.0 _ll_register_callbacks cb 0x5649f9a51a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f818de00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 0x5649f9a9d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f818de00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 0x5649f9a9d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49718/0 (socket says 172.21.15.88:49718) 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f818d400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a6bc80 0x5649f9a6b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f818de00640 1 -- 172.21.15.88:0/4124724941 learned_addr learned my addr 172.21.15.88:0/4124724941 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f818ca00640 1 --2- 172.21.15.88:0/4124724941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a9cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f818de00640 1 -- 172.21.15.88:0/4124724941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 msgr2=0x5649f9a9cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f818de00640 1 --2- 172.21.15.88:0/4124724941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a9cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f818de00640 1 -- 172.21.15.88:0/4124724941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a6bc80 msgr2=0x5649f9a6b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f818de00640 1 --2- 172.21.15.88:0/4124724941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a6bc80 0x5649f9a6b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f818de00640 1 -- 172.21.15.88:0/4124724941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f987fe00 con 0x5649f9a96f10 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f818de00640 1 --2- 172.21.15.88:0/4124724941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 0x5649f9a9d000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8180017040 tx=0x7f8180001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a58ba6b650c386f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f816ea00640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f816ea00640 1 -- 172.21.15.88:0/4124724941 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180023030 con 0x5649f9a96f10 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 -- 172.21.15.88:0/4124724941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f818000ee50 con 0x5649f9a96f10 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f816ea00640 1 -- 172.21.15.88:0/4124724941 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8180014830 con 0x5649f9a96f10 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f816ea00640 1 -- 172.21.15.88:0/4124724941 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f818002f050 con 0x5649f9a96f10 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 10 client.4614 fetch_fsmap learned FSMap version 8 2024-04-24T08:25:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 -- 172.21.15.88:0/4124724941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5649f9936670 con 0x5649f9a96f10 2024-04-24T08:25:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f816ea00640 1 -- 172.21.15.88:0/4124724941 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f818000ee50 con 0x5649f9a96f10 2024-04-24T08:25:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f816ea00640 1 -- 172.21.15.88:0/4124724941 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 8) ==== 2284+0+0 (secure 0 0 0) 0x7f8180032020 con 0x5649f9a96f10 2024-04-24T08:25:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 10 client.4614 fetch_fsmap finished waiting for FSMap version 8 2024-04-24T08:25:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 10 client.4614 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T08:25:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 20 client.4614 populate_metadata read hostname 'smithi088' 2024-04-24T08:25:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 --2- 172.21.15.88:0/4124724941 >> [v2:172.21.15.88:6834/2851985776,v1:172.21.15.88:6835/2851985776] conn(0x5649f9a9da10 0x5649f9a9ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 4 client.4614 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T08:25:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.078+0000 7f8193240000 1 -- 172.21.15.88:0/4124724941 --> [v2:172.21.15.88:6834/2851985776,v1:172.21.15.88:6835/2851985776] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649f984dbc0 con 0x5649f9a9da10 2024-04-24T08:25:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f818d400640 1 --2- 172.21.15.88:0/4124724941 >> [v2:172.21.15.88:6834/2851985776,v1:172.21.15.88:6835/2851985776] conn(0x5649f9a9da10 0x5649f9a9ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f818d400640 1 --2- 172.21.15.88:0/4124724941 >> [v2:172.21.15.88:6834/2851985776,v1:172.21.15.88:6835/2851985776] conn(0x5649f9a9da10 0x5649f9a9ddf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6bf92999b6859a3 server_cookie=444d010ca5ccffc5 in_seq=0 out_seq=0 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f816ea00640 10 client.4614 ms_handle_connect on v2:172.21.15.88:6834/2851985776 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f816ea00640 1 -- 172.21.15.88:0/4124724941 <== mds.0 v2:172.21.15.88:6834/2851985776 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5649f984dbc0 con 0x5649f9a9da10 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f816ea00640 10 client.4614 handle_command_reply: tid=0 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f8193240000 1 client.4614 shutdown 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f8193240000 1 -- 172.21.15.88:0/4124724941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 msgr2=0x5649f9a9d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f8193240000 1 --2- 172.21.15.88:0/4124724941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 0x5649f9a9d000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8180017040 tx=0x7f8180001260 comp rx=0 tx=0).stop 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f8193240000 1 -- 172.21.15.88:0/4124724941 shutdown_connections 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f8193240000 1 --2- 172.21.15.88:0/4124724941 >> [v2:172.21.15.88:6834/2851985776,v1:172.21.15.88:6835/2851985776] conn(0x5649f9a9da10 0x5649f9a9ddf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f8193240000 1 --2- 172.21.15.88:0/4124724941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a96f10 0x5649f9a9d000 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f8193240000 1 --2- 172.21.15.88:0/4124724941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a9cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f8193240000 1 --2- 172.21.15.88:0/4124724941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a6bc80 0x5649f9a6b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f816ea00640 0 client.4614 ms_handle_reset on v2:172.21.15.88:6834/2851985776 2024-04-24T08:25:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f8193240000 1 -- 172.21.15.88:0/4124724941 >> 172.21.15.88:0/4124724941 conn(0x5649f9a92780 msgr2=0x5649f9a94b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:42.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f8193240000 1 -- 172.21.15.88:0/4124724941 shutdown_connections 2024-04-24T08:25:42.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f8193240000 1 -- 172.21.15.88:0/4124724941 wait complete. 2024-04-24T08:25:42.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.082+0000 7f8193240000 20 client.4614 trim_cache size 0 max 16384 2024-04-24T08:25:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.098+0000 7f8193240000 1 Processor -- start 2024-04-24T08:25:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.098+0000 7f8193240000 1 -- start start 2024-04-24T08:25:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 0x5649f9ab22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a6af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a96f10 0x5649f9a6b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f81881ece20 con 0x5649f9a6bc80 2024-04-24T08:25:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f81881ebf80 con 0x5649f9a96f10 2024-04-24T08:25:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5649f98b37e0 con 0x5649f9a6c5a0 2024-04-24T08:25:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818d400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 0x5649f9ab22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818d400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 0x5649f9ab22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49730/0 (socket says 172.21.15.88:49730) 2024-04-24T08:25:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818d400640 1 -- 172.21.15.88:0/2121226645 learned_addr learned my addr 172.21.15.88:0/2121226645 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818d400640 1 -- 172.21.15.88:0/2121226645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 msgr2=0x5649f9a6af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818d400640 1 --2- 172.21.15.88:0/2121226645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a6af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818d400640 1 -- 172.21.15.88:0/2121226645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a96f10 msgr2=0x5649f9a6b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818d400640 1 --2- 172.21.15.88:0/2121226645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a96f10 0x5649f9a6b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818d400640 1 -- 172.21.15.88:0/2121226645 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f990d340 con 0x5649f9a6bc80 2024-04-24T08:25:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818d400640 1 --2- 172.21.15.88:0/2121226645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 0x5649f9ab22b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f817c056320 tx=0x7f817c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d41eceab14d29c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8179600640 1 -- 172.21.15.88:0/2121226645 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c0546c0 con 0x5649f9a6bc80 2024-04-24T08:25:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8179600640 1 -- 172.21.15.88:0/2121226645 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817c054920 con 0x5649f9a6bc80 2024-04-24T08:25:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8179600640 1 -- 172.21.15.88:0/2121226645 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c012ce0 con 0x5649f9a6bc80 2024-04-24T08:25:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 -- 172.21.15.88:0/2121226645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 msgr2=0x5649f9ab22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 --2- 172.21.15.88:0/2121226645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 0x5649f9ab22b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f817c056320 tx=0x7f817c005040 comp rx=0 tx=0).stop 2024-04-24T08:25:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 -- 172.21.15.88:0/2121226645 shutdown_connections 2024-04-24T08:25:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 --2- 172.21.15.88:0/2121226645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a96f10 0x5649f9a6b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 --2- 172.21.15.88:0/2121226645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a6af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 --2- 172.21.15.88:0/2121226645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 0x5649f9ab22b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 -- 172.21.15.88:0/2121226645 >> 172.21.15.88:0/2121226645 conn(0x5649f9a92780 msgr2=0x5649f9aa7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 -- 172.21.15.88:0/2121226645 shutdown_connections 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 -- 172.21.15.88:0/2121226645 wait complete. 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 -- start start 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 Processor -- start 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 0x5649f9a6b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a6a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a96f10 0x5649f9a683f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5649f98c16e0 con 0x5649f9a6bc80 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5649f98b8b00 con 0x5649f9a96f10 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5649f984a7b0 con 0x5649f9a6c5a0 2024-04-24T08:25:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f8193240000 10 client.0 _ll_register_callbacks cb 0x7f8180017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818d400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 0x5649f9a6b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818d400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 0x5649f9a6b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49740/0 (socket says 172.21.15.88:49740) 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818d400640 1 -- 172.21.15.88:0/70230725 learned_addr learned my addr 172.21.15.88:0/70230725 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818ca00640 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a6a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.102+0000 7f818de00640 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a96f10 0x5649f9a683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818d400640 1 -- 172.21.15.88:0/70230725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 msgr2=0x5649f9a6a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818d400640 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a6a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818d400640 1 -- 172.21.15.88:0/70230725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a96f10 msgr2=0x5649f9a683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818d400640 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a96f10 0x5649f9a683f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818d400640 1 -- 172.21.15.88:0/70230725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f98467c0 con 0x5649f9a6bc80 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818d400640 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 0x5649f9a6b090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f817c056320 tx=0x7f817c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a0b08eb0d12ae server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f816ea00640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f816ea00640 1 -- 172.21.15.88:0/70230725 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c084060 con 0x5649f9a6bc80 2024-04-24T08:25:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f816ea00640 1 -- 172.21.15.88:0/70230725 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f817c055a70 con 0x5649f9a6bc80 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 -- 172.21.15.88:0/70230725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f817c054920 con 0x5649f9a6bc80 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f816ea00640 1 -- 172.21.15.88:0/70230725 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f817c072070 con 0x5649f9a6bc80 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 10 client.4620 fetch_fsmap learned FSMap version 8 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 -- 172.21.15.88:0/70230725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5649f9859650 con 0x5649f9a6bc80 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f816ea00640 1 -- 172.21.15.88:0/70230725 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817c054920 con 0x5649f9a6bc80 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f816ea00640 1 -- 172.21.15.88:0/70230725 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 8) ==== 2284+0+0 (secure 0 0 0) 0x7f817c052370 con 0x5649f9a6bc80 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 10 client.4620 fetch_fsmap finished waiting for FSMap version 8 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 10 client.4620 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 20 client.4620 populate_metadata read hostname 'smithi088' 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.88:6834/2851985776,v1:172.21.15.88:6835/2851985776] conn(0x5649f9a68930 0x5649f9a68d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 4 client.4620 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 -- 172.21.15.88:0/70230725 --> [v2:172.21.15.88:6834/2851985776,v1:172.21.15.88:6835/2851985776] -- command(tid 0: {"prefix": "status"}) -- 0x5649f98894e0 con 0x5649f9a68930 2024-04-24T08:25:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818ca00640 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.88:6834/2851985776,v1:172.21.15.88:6835/2851985776] conn(0x5649f9a68930 0x5649f9a68d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818ca00640 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.88:6834/2851985776,v1:172.21.15.88:6835/2851985776] conn(0x5649f9a68930 0x5649f9a68d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5be8a9e3a0322cc8 server_cookie=46f4e66654b21add in_seq=0 out_seq=0 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f816ea00640 10 client.4620 ms_handle_connect on v2:172.21.15.88:6834/2851985776 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f816ea00640 1 -- 172.21.15.88:0/70230725 <== mds.0 v2:172.21.15.88:6834/2851985776 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5649f98894e0 con 0x5649f9a68930 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f816ea00640 10 client.4620 handle_command_reply: tid=0 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 client.4620 shutdown 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 -- 172.21.15.88:0/70230725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 msgr2=0x5649f9a6b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 0x5649f9a6b090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f817c056320 tx=0x7f817c000ee0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 -- 172.21.15.88:0/70230725 shutdown_connections 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.88:6834/2851985776,v1:172.21.15.88:6835/2851985776] conn(0x5649f9a68930 0x5649f9a68d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5649f9a96f10 0x5649f9a683f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5649f9a6c5a0 0x5649f9a6a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f816ea00640 0 client.4620 ms_handle_reset on v2:172.21.15.88:6834/2851985776 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 --2- 172.21.15.88:0/70230725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5649f9a6bc80 0x5649f9a6b090 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 -- 172.21.15.88:0/70230725 >> 172.21.15.88:0/70230725 conn(0x5649f9a92780 msgr2=0x5649f9ab12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 -- 172.21.15.88:0/70230725 shutdown_connections 2024-04-24T08:25:42.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 1 -- 172.21.15.88:0/70230725 wait complete. 2024-04-24T08:25:42.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f8193240000 20 client.4620 trim_cache size 0 max 16384 2024-04-24T08:25:42.112 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:25:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "0c7f29ca-8828-476d-9ca3-111d6acc4dca", 2024-04-24T08:25:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2024-04-24T08:25:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4263, 2024-04-24T08:25:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2024-04-24T08:25:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2024-04-24T08:25:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2024-04-24T08:25:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 14.017687598, 2024-04-24T08:25:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 8, 2024-04-24T08:25:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 20, 2024-04-24T08:25:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 20, 2024-04-24T08:25:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 21.610219900000001 2024-04-24T08:25:42.113 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:25:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818fe00640 1 -- 172.21.15.88:0/1459633741 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8168068380 msgr2=0x7f816806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818fe00640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8168068380 0x7f816806a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f81740ad000 tx=0x7f8174008040 comp rx=0 tx=0).stop 2024-04-24T08:25:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818fe00640 1 -- 172.21.15.88:0/1459633741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f818809b620 msgr2=0x7f8188138870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818fe00640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f818809b620 0x7f8188138870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c500 tx=0x7f817c00c9c0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818fe00640 1 -- 172.21.15.88:0/1459633741 shutdown_connections 2024-04-24T08:25:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818fe00640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8168068380 0x7f816806a840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818fe00640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f818809e2d0 0x7f818813cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818fe00640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818809c4d0 0x7f81881e0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818fe00640 1 --2- 172.21.15.88:0/1459633741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f818809b620 0x7f8188138870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818fe00640 1 -- 172.21.15.88:0/1459633741 >> 172.21.15.88:0/1459633741 conn(0x7f81880b9420 msgr2=0x7f81880b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818fe00640 1 -- 172.21.15.88:0/1459633741 shutdown_connections 2024-04-24T08:25:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.106+0000 7f818fe00640 1 -- 172.21.15.88:0/1459633741 wait complete. 2024-04-24T08:25:42.127 INFO:teuthology.run_tasks:Running task sequential... 2024-04-24T08:25:42.137 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-24T08:25:42.137 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-24T08:25:42.137 INFO:teuthology.task.print:Enabling mgr modules 2024-04-24T08:25:42.137 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-24T08:25:42.195 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-24T08:25:42.195 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-24T08:25:42.196 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-24T08:25:42.196 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T08:25:42.196 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T08:25:42.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:42.196 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-04-24T08:25:42.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:42.205 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2024-04-24T08:25:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2024-04-24T08:25:42.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:25:42.273 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-24T08:25:42.273 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T08:25:42.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.454+0000 7f67ee200640 1 Processor -- start 2024-04-24T08:25:42.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.454+0000 7f67ee200640 1 -- start start 2024-04-24T08:25:42.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.454+0000 7f67ee200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f67e80b3e20 0x7f67e80afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.454+0000 7f67ee200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e8144390 con 0x7f67e806d470 2024-04-24T08:25:42.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.454+0000 7f67ee200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e809c4d0 con 0x7f67e809cc40 2024-04-24T08:25:42.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.454+0000 7f67ee200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f67e80b5b40 con 0x7f67e80b3e20 2024-04-24T08:25:42.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.454+0000 7f67e7400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f67e806d470 0x7f67e8144b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39510/0 (socket says 172.21.15.88:39510) 2024-04-24T08:25:42.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.458+0000 7f67e7400640 1 -- 172.21.15.88:0/1250402500 learned_addr learned my addr 172.21.15.88:0/1250402500 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:42.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.458+0000 7f67e6a00640 1 --2- 172.21.15.88:0/1250402500 >> v2:172.21.15.142:3300/0 conn(0x7f67e80b3e20 0x7f67e80afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.458+0000 7f67e6000640 1 -- 172.21.15.88:0/1250402500 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2408971273 0 0) 0x7f67e8144390 con 0x7f67e806d470 2024-04-24T08:25:42.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.458+0000 7f67e6000640 1 -- 172.21.15.88:0/1250402500 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67cc003450 con 0x7f67e806d470 2024-04-24T08:25:42.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.458+0000 7f67e6000640 1 -- 172.21.15.88:0/1250402500 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1054662428 0 0) 0x7f67cc003450 con 0x7f67e806d470 2024-04-24T08:25:42.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.458+0000 7f67e6a00640 1 -- 172.21.15.88:0/1250402500 >> v1:172.21.15.142:6789/0 conn(0x7f67e809cc40 legacy=0x7f67e814ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.458+0000 7f67e6a00640 1 -- 172.21.15.88:0/1250402500 >> v1:172.21.15.88:6789/0 conn(0x7f67e806d470 legacy=0x7f67e8144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.458+0000 7f67e6a00640 1 -- 172.21.15.88:0/1250402500 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e806d850 con 0x7f67e80b3e20 2024-04-24T08:25:42.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.458+0000 7f67e6a00640 1 --2- 172.21.15.88:0/1250402500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e80b3e20 0x7f67e80afae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f67d40097c0 tx=0x7f67d401c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be259e90b706d926 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:42.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.458+0000 7f67e6000640 1 -- 172.21.15.88:0/1250402500 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d40b0070 con 0x7f67e80b3e20 2024-04-24T08:25:42.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67e6000640 1 -- 172.21.15.88:0/1250402500 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d40ab400 con 0x7f67e80b3e20 2024-04-24T08:25:42.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67e6000640 1 -- 172.21.15.88:0/1250402500 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d8001a00 con 0x7f67e80b3e20 2024-04-24T08:25:42.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 -- 172.21.15.88:0/1250402500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e80b3e20 msgr2=0x7f67e80afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 --2- 172.21.15.88:0/1250402500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e80b3e20 0x7f67e80afae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f67d40097c0 tx=0x7f67d401c2a0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 -- 172.21.15.88:0/1250402500 shutdown_connections 2024-04-24T08:25:42.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 --2- 172.21.15.88:0/1250402500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e80b3e20 0x7f67e80afae0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 -- 172.21.15.88:0/1250402500 >> 172.21.15.88:0/1250402500 conn(0x7f67e806c0d0 msgr2=0x7f67e80b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:42.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 -- 172.21.15.88:0/1250402500 shutdown_connections 2024-04-24T08:25:42.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 -- 172.21.15.88:0/1250402500 wait complete. 2024-04-24T08:25:42.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 Processor -- start 2024-04-24T08:25:42.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 -- start start 2024-04-24T08:25:42.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e806d470 0x7f67e81340e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67e809cc40 0x7f67e813fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e80b3e20 0x7f67e809b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8152360 con 0x7f67e806d470 2024-04-24T08:25:42.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f67e80b0430 con 0x7f67e80b3e20 2024-04-24T08:25:42.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67ee200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f67e81524e0 con 0x7f67e809cc40 2024-04-24T08:25:42.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67e7400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e806d470 0x7f67e81340e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67e7400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e806d470 0x7f67e81340e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49746/0 (socket says 172.21.15.88:49746) 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67e7400640 1 -- 172.21.15.88:0/256685728 learned_addr learned my addr 172.21.15.88:0/256685728 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67e6a00640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67e809cc40 0x7f67e813fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67e7e00640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e80b3e20 0x7f67e809b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67e7400640 1 -- 172.21.15.88:0/256685728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67e809cc40 msgr2=0x7f67e813fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67e7400640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67e809cc40 0x7f67e813fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67e7400640 1 -- 172.21.15.88:0/256685728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e80b3e20 msgr2=0x7f67e809b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67e7400640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e80b3e20 0x7f67e809b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.462+0000 7f67e7400640 1 -- 172.21.15.88:0/256685728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e80730d0 con 0x7f67e806d470 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.466+0000 7f67e7400640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e806d470 0x7f67e81340e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f67d800cc20 tx=0x7f67d800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.466+0000 7f67df400640 1 -- 172.21.15.88:0/256685728 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d8017070 con 0x7f67e806d470 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.466+0000 7f67df400640 1 -- 172.21.15.88:0/256685728 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d800ce30 con 0x7f67e806d470 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.466+0000 7f67df400640 1 -- 172.21.15.88:0/256685728 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d8012600 con 0x7f67e806d470 2024-04-24T08:25:42.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.466+0000 7f67ee200640 1 -- 172.21.15.88:0/256685728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e81402f0 con 0x7f67e806d470 2024-04-24T08:25:42.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.466+0000 7f67ee200640 1 -- 172.21.15.88:0/256685728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e80722e0 con 0x7f67e806d470 2024-04-24T08:25:42.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.466+0000 7f67ee200640 1 -- 172.21.15.88:0/256685728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e8068b90 con 0x7f67e806d470 2024-04-24T08:25:42.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.466+0000 7f67df400640 1 -- 172.21.15.88:0/256685728 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f67d801a070 con 0x7f67e806d470 2024-04-24T08:25:42.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.466+0000 7f67df400640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f67c8068380 0x7f67c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:42.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.466+0000 7f67df400640 1 -- 172.21.15.88:0/256685728 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f67d8086920 con 0x7f67e806d470 2024-04-24T08:25:42.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.466+0000 7f67e6a00640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f67c8068380 0x7f67c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:42.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.470+0000 7f67e6a00640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f67c8068380 0x7f67c806a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f67d40ad000 tx=0x7f67d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:42.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.470+0000 7f67df400640 1 -- 172.21.15.88:0/256685728 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f67d8056ed0 con 0x7f67e806d470 2024-04-24T08:25:42.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.662+0000 7f67ee200640 1 -- 172.21.15.88:0/256685728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f67e809d330 con 0x7f67e806d470 2024-04-24T08:25:42.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.662+0000 7f67df400640 1 -- 172.21.15.88:0/256685728 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f67d80567d0 con 0x7f67e806d470 2024-04-24T08:25:42.663 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T08:25:42.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.666+0000 7f67ee200640 1 -- 172.21.15.88:0/256685728 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f67c8068380 msgr2=0x7f67c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.666+0000 7f67ee200640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f67c8068380 0x7f67c806a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f67d40ad000 tx=0x7f67d4008040 comp rx=0 tx=0).stop 2024-04-24T08:25:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.666+0000 7f67ee200640 1 -- 172.21.15.88:0/256685728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e806d470 msgr2=0x7f67e81340e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.666+0000 7f67ee200640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e806d470 0x7f67e81340e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f67d800cc20 tx=0x7f67d800a430 comp rx=0 tx=0).stop 2024-04-24T08:25:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.666+0000 7f67ee200640 1 -- 172.21.15.88:0/256685728 shutdown_connections 2024-04-24T08:25:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.666+0000 7f67ee200640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f67c8068380 0x7f67c806a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.666+0000 7f67ee200640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e80b3e20 0x7f67e809b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.666+0000 7f67ee200640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67e809cc40 0x7f67e813fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.666+0000 7f67ee200640 1 --2- 172.21.15.88:0/256685728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e806d470 0x7f67e81340e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.666+0000 7f67ee200640 1 -- 172.21.15.88:0/256685728 >> 172.21.15.88:0/256685728 conn(0x7f67e806c0d0 msgr2=0x7f67e80734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.666+0000 7f67ee200640 1 -- 172.21.15.88:0/256685728 shutdown_connections 2024-04-24T08:25:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42.666+0000 7f67ee200640 1 -- 172.21.15.88:0/256685728 wait complete. 2024-04-24T08:25:42.685 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T08:25:42.685 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T08:25:42.685 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2024-04-24T08:25:42.685 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T08:25:42.685 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T08:25:42.685 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T08:25:42.685 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T08:25:42.685 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T08:25:42.685 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T08:25:42.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:42.685 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2024-04-24T08:25:42.694 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T08:25:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T08:25:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T08:25:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-24T08:25:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2024-04-24T08:25:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-24T08:25:42.694 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T08:25:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2024-04-24T08:25:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2024-04-24T08:25:42.694 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42484sec preferred_lft 42484sec 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:b8:c2:5a:7c brd ff:ff:ff:ff:ff:ff 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-24T08:25:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-24T08:25:42.696 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-24T08:25:42.696 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T08:25:42.697 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-24T08:25:42.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2024-04-24T08:25:42.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2024-04-24T08:25:42.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2024-04-24T08:25:42.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-24T08:25:42.697 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-24T08:25:42.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T08:25:42.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T08:25:42.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:42.852 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T08:25:42.870 INFO:teuthology.orchestra.run.smithi088.stdout:1 2024-04-24T08:25:42.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:42.872 DEBUG:teuthology.orchestra.run.smithi088:> route 2024-04-24T08:25:42.952 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2024-04-24T08:25:42.952 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T08:25:42.952 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-24T08:25:42.952 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T08:25:42.952 INFO:teuthology.orchestra.run.smithi088.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-24T08:25:42.952 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-24T08:25:42.952 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T08:25:42.952 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T08:25:42.952 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T08:25:42.952 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T08:25:42.952 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T08:25:42.953 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T08:25:42.953 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-24T08:25:42.953 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T08:25:42.953 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T08:25:42.953 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T08:25:42.953 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-24T08:25:43.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T08:25:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T08:25:43.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:43.090 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-04-24T08:25:43.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:43.141 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2024-04-24T08:25:43.193 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T08:25:43.193 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-24T08:25:43.193 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T08:25:43.193 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-24T08:25:43.193 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-24T08:25:43.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T08:25:43.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T08:25:43.322 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-24T08:25:43.323 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T08:25:43.323 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-24T08:25:43.323 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-24T08:25:43.323 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-24T08:25:43.323 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-24T08:25:43.323 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-24T08:25:43.323 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-24T08:25:43.323 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-24T08:25:43.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T08:25:43.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T08:25:43.528 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T08:25:43.528 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-24T08:25:43.528 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2024-04-24T08:25:43.528 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2024-04-24T08:25:43.528 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-24T08:25:43.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T08:25:43.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T08:25:43.611 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-24T08:25:43.611 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T08:25:43.611 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T08:25:43.665 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T08:25:43.665 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T08:25:43.665 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T08:25:43.716 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2024-04-24T08:25:43.780 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T08:25:43.834 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2024-04-24T08:25:43.834 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2024-04-24T08:25:43.834 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2024-04-24T08:25:43.834 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2024-04-24T08:25:43.834 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2024-04-24T08:25:43.834 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2024-04-24T08:25:43.834 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2024-04-24T08:25:43.834 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2024-04-24T08:25:43.834 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2024-04-24T08:25:43.835 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2024-04-24T08:25:43.836 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T08:25:43.836 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T08:25:43.836 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T08:25:43.836 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T08:25:43.836 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2024-04-24T08:25:43.836 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T08:25:43.836 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T08:25:43.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:43.837 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2024-04-24T08:25:43.888 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-24T08:25:43.888 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-24T08:25:43.939 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2024-04-24T08:25:43.959 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T08:25:44.010 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2024-04-24T08:25:44.010 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2024-04-24T08:25:44.010 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2024-04-24T08:25:44.010 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2024-04-24T08:25:44.010 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2024-04-24T08:25:44.010 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2024-04-24T08:25:44.010 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2024-04-24T08:25:44.010 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2024-04-24T08:25:44.010 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2024-04-24T08:25:44.011 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2024-04-24T08:25:44.012 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T08:25:44.012 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T08:25:44.012 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T08:25:44.012 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T08:25:44.012 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2024-04-24T08:25:44.012 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T08:25:44.012 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T08:25:44.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:44.013 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2024-04-24T08:25:44.033 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:2024-04-24T08:25:44.034+0000 7f9bed48e580 -1 init, newargv = 0x55935b497b60 newargc=15 2024-04-24T08:25:44.033 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[35183]: starting ceph client 2024-04-24T08:25:44.041 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[35183]: starting fuse 2024-04-24T08:25:44.043 INFO:teuthology.orchestra.run.smithi088.stdout:44 2024-04-24T08:25:44.043 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-24T08:25:44.043 DEBUG:teuthology.orchestra.run.smithi088:> sudo stdin-killer -- python3 -c ' 2024-04-24T08:25:44.043 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2024-04-24T08:25:44.043 DEBUG:teuthology.orchestra.run.smithi088:> import re 2024-04-24T08:25:44.043 DEBUG:teuthology.orchestra.run.smithi088:> import os 2024-04-24T08:25:44.043 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2024-04-24T08:25:44.043 DEBUG:teuthology.orchestra.run.smithi088:> 2024-04-24T08:25:44.043 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2024-04-24T08:25:44.043 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-24T08:25:44.043 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> return f 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-24T08:25:44.044 DEBUG:teuthology.orchestra.run.smithi088:> 2024-04-24T08:25:44.045 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.0")) 2024-04-24T08:25:44.045 DEBUG:teuthology.orchestra.run.smithi088:> ' 2024-04-24T08:25:44.167 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.0.35183.asok 2024-04-24T08:25:44.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T08:25:44.178 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35183.asok 2024-04-24T08:25:44.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:44.179 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35183.asok status 2024-04-24T08:25:44.347 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:25:44.347 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2024-04-24T08:25:44.347 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "1f81fb397ae98da7563d451a78c61574c8f4e6e0", 2024-04-24T08:25:44.347 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 19.0.0-3116-g1f81fb39 (1f81fb397ae98da7563d451a78c61574c8f4e6e0) squid (dev)", 2024-04-24T08:25:44.347 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "0", 2024-04-24T08:25:44.347 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2024-04-24T08:25:44.347 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-24T08:25:44.347 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "35183", 2024-04-24T08:25:44.347 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2024-04-24T08:25:44.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4635, 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4635 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 412205566 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:25:44.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 412205566 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.4635 192.168.0.1:0/412205566", 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "192.168.0.1:0/412205566", 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 8, 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 20, 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2024-04-24T08:25:44.349 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:25:44.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:44.363 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2024-04-24T08:25:44.363 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-24T08:25:44.372 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2024-04-24T08:25:44.372 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-24T08:25:44.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:44.372 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T08:25:44.433 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-24T08:25:44.449 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:44.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50d6400640 1 Processor -- start 2024-04-24T08:25:44.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50d6400640 1 -- start start 2024-04-24T08:25:44.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50d6400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f50d0145f20 0x7f50d01514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50d6400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50d006e030 con 0x7f50d00b9d90 2024-04-24T08:25:44.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50d6400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50d00ba170 con 0x7f50d009be30 2024-04-24T08:25:44.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50d6400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f50d009cd30 con 0x7f50d0145f20 2024-04-24T08:25:44.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cf400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f50d00b9d90 0x7f50d006d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39522/0 (socket says 172.21.15.88:39522) 2024-04-24T08:25:44.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cf400640 1 -- 172.21.15.88:0/4188549622 learned_addr learned my addr 172.21.15.88:0/4188549622 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cfe00640 1 --2- 172.21.15.88:0/4188549622 >> v2:172.21.15.142:3300/0 conn(0x7f50d0145f20 0x7f50d01514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 268468193 0 0) 0x7f50d006e030 con 0x7f50d00b9d90 2024-04-24T08:25:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50b4003530 con 0x7f50d00b9d90 2024-04-24T08:25:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2282267333 0 0) 0x7f50b4003530 con 0x7f50d00b9d90 2024-04-24T08:25:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 >> v2:172.21.15.142:3300/0 conn(0x7f50d0145f20 msgr2=0x7f50d01514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 --2- 172.21.15.88:0/4188549622 >> v2:172.21.15.142:3300/0 conn(0x7f50d0145f20 0x7f50d01514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 >> v1:172.21.15.142:6789/0 conn(0x7f50d009be30 legacy=0x7f50d006d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d014a060 con 0x7f50d00b9d90 2024-04-24T08:25:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f50c0001680 con 0x7f50d00b9d90 2024-04-24T08:25:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 >> v1:172.21.15.88:6789/0 conn(0x7f50d00b9d90 legacy=0x7f50d006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 --2- 172.21.15.88:0/4188549622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50b40039c0 0x7f50b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 --2- 172.21.15.88:0/4188549622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b4004810 0x7f50b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 --2- 172.21.15.88:0/4188549622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 0x7f50b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f50d009cd30 con 0x7f50b40052f0 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f50b400c1c0 con 0x7f50b4004810 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f50b400c3c0 con 0x7f50b40039c0 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cfe00640 1 --2- 172.21.15.88:0/4188549622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 0x7f50b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50cf400640 1 --2- 172.21.15.88:0/4188549622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50b40039c0 0x7f50b4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.610+0000 7f50c6a00640 1 --2- 172.21.15.88:0/4188549622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b4004810 0x7f50b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50cfe00640 1 -- 172.21.15.88:0/4188549622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50b40039c0 msgr2=0x7f50b4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50cfe00640 1 --2- 172.21.15.88:0/4188549622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50b40039c0 0x7f50b4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50cfe00640 1 -- 172.21.15.88:0/4188549622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b4004810 msgr2=0x7f50b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50cfe00640 1 --2- 172.21.15.88:0/4188549622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b4004810 0x7f50b4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50cfe00640 1 -- 172.21.15.88:0/4188549622 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b4003530 con 0x7f50b40052f0 2024-04-24T08:25:44.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50cfe00640 1 -- 172.21.15.88:0/4188549622 reap_dead start 2024-04-24T08:25:44.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50cfe00640 1 --2- 172.21.15.88:0/4188549622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 0x7f50b400b9d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009f90 tx=0x7f50c801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2af6083e5342a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:44.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8009c10 con 0x7f50b40052f0 2024-04-24T08:25:44.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c8003ba0 con 0x7f50b40052f0 2024-04-24T08:25:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50cea00640 1 -- 172.21.15.88:0/4188549622 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c80a5960 con 0x7f50b40052f0 2024-04-24T08:25:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50d6400640 1 -- 172.21.15.88:0/4188549622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 msgr2=0x7f50b400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50d6400640 1 --2- 172.21.15.88:0/4188549622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 0x7f50b400b9d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009f90 tx=0x7f50c801cc80 comp rx=0 tx=0).stop 2024-04-24T08:25:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50d6400640 1 -- 172.21.15.88:0/4188549622 shutdown_connections 2024-04-24T08:25:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50d6400640 1 --2- 172.21.15.88:0/4188549622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 0x7f50b400b9d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50d6400640 1 -- 172.21.15.88:0/4188549622 >> 172.21.15.88:0/4188549622 conn(0x7f50d006c0d0 msgr2=0x7f50d00b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50d6400640 1 -- 172.21.15.88:0/4188549622 shutdown_connections 2024-04-24T08:25:44.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.614+0000 7f50d6400640 1 -- 172.21.15.88:0/4188549622 wait complete. 2024-04-24T08:25:44.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50d6400640 1 Processor -- start 2024-04-24T08:25:44.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50d6400640 1 -- start start 2024-04-24T08:25:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50d6400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 0x7f50d01e48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50d6400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50d013c7d0 0x7f50d01e0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50d6400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50d0146da0 0x7f50d0147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50d6400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f50d00b3e20 con 0x7f50b40052f0 2024-04-24T08:25:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50d6400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f50d0146330 con 0x7f50d0146da0 2024-04-24T08:25:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50d6400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f50d00b3fa0 con 0x7f50d013c7d0 2024-04-24T08:25:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50cf400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 0x7f50d01e48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50cf400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 0x7f50d01e48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49762/0 (socket says 172.21.15.88:49762) 2024-04-24T08:25:44.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50cf400640 1 -- 172.21.15.88:0/1371755328 learned_addr learned my addr 172.21.15.88:0/1371755328 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:44.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50cfe00640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50d0146da0 0x7f50d0147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50c6a00640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50d013c7d0 0x7f50d01e0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50cf400640 1 -- 172.21.15.88:0/1371755328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50d013c7d0 msgr2=0x7f50d01e0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50cf400640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50d013c7d0 0x7f50d01e0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50cf400640 1 -- 172.21.15.88:0/1371755328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50d0146da0 msgr2=0x7f50d0147220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50cf400640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50d0146da0 0x7f50d0147220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50cf400640 1 -- 172.21.15.88:0/1371755328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d01e3e50 con 0x7f50b40052f0 2024-04-24T08:25:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50c6a00640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50d013c7d0 0x7f50d01e0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50cf400640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 0x7f50d01e48f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f50c0007320 tx=0x7f50c00077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50c7e00640 1 -- 172.21.15.88:0/1371755328 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c001a070 con 0x7f50b40052f0 2024-04-24T08:25:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50c7e00640 1 -- 172.21.15.88:0/1371755328 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c000f960 con 0x7f50b40052f0 2024-04-24T08:25:44.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50d6400640 1 -- 172.21.15.88:0/1371755328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d01e40f0 con 0x7f50b40052f0 2024-04-24T08:25:44.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50c7e00640 1 -- 172.21.15.88:0/1371755328 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c000fd30 con 0x7f50b40052f0 2024-04-24T08:25:44.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.618+0000 7f50d6400640 1 -- 172.21.15.88:0/1371755328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d014eb10 con 0x7f50b40052f0 2024-04-24T08:25:44.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.622+0000 7f50d6400640 1 -- 172.21.15.88:0/1371755328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d0068b90 con 0x7f50b40052f0 2024-04-24T08:25:44.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.622+0000 7f50c7e00640 1 -- 172.21.15.88:0/1371755328 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f50c001d070 con 0x7f50b40052f0 2024-04-24T08:25:44.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.622+0000 7f50c7e00640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f50ac068380 0x7f50ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.622+0000 7f50c7e00640 1 -- 172.21.15.88:0/1371755328 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f50c00861f0 con 0x7f50b40052f0 2024-04-24T08:25:44.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.622+0000 7f50c6a00640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f50ac068380 0x7f50ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.622+0000 7f50c6a00640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f50ac068380 0x7f50ac06a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f50b8000c10 tx=0x7f50b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:44.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.626+0000 7f50c7e00640 1 -- 172.21.15.88:0/1371755328 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f50c0056140 con 0x7f50b40052f0 2024-04-24T08:25:44.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 -- 172.21.15.88:0/1371755328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50d0145820 con 0x7f50b40052f0 2024-04-24T08:25:44.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50c7e00640 1 -- 172.21.15.88:0/1371755328 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f50c005a440 con 0x7f50b40052f0 2024-04-24T08:25:44.787 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:44.787 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:44.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 -- 172.21.15.88:0/1371755328 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f50ac068380 msgr2=0x7f50ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:44.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f50ac068380 0x7f50ac06a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f50b8000c10 tx=0x7f50b8009040 comp rx=0 tx=0).stop 2024-04-24T08:25:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 -- 172.21.15.88:0/1371755328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 msgr2=0x7f50d01e48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 0x7f50d01e48f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f50c0007320 tx=0x7f50c00077e0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 -- 172.21.15.88:0/1371755328 shutdown_connections 2024-04-24T08:25:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f50ac068380 0x7f50ac06a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50d0146da0 0x7f50d0147220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50d013c7d0 0x7f50d01e0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 --2- 172.21.15.88:0/1371755328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50b40052f0 0x7f50d01e48f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 -- 172.21.15.88:0/1371755328 >> 172.21.15.88:0/1371755328 conn(0x7f50d006c0d0 msgr2=0x7f50d0144ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 -- 172.21.15.88:0/1371755328 shutdown_connections 2024-04-24T08:25:44.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.786+0000 7f50d6400640 1 -- 172.21.15.88:0/1371755328 wait complete. 2024-04-24T08:25:44.808 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T08:25:25.116395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T08:25:26.444475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:25:44.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:25:44.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bd3200640 1 Processor -- start 2024-04-24T08:25:44.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bd3200640 1 -- start start 2024-04-24T08:25:44.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bd3200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7bcc14b190 0x7f7bcc147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bd3200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bcc14b620 con 0x7f7bcc09b9d0 2024-04-24T08:25:44.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bd3200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bcc14b900 con 0x7f7bcc0b3eb0 2024-04-24T08:25:44.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bd3200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f7bcc0b4290 con 0x7f7bcc14b190 2024-04-24T08:25:44.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bcb400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7bcc14b190 0x7f7bcc147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bd1200640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7bcc09b9d0 0x7f7bcc152520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39524/0 (socket says 172.21.15.88:39524) 2024-04-24T08:25:44.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bcb400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7bcc14b190 0x7f7bcc147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49770/0 (socket says 172.21.15.88:49770) 2024-04-24T08:25:44.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bd1200640 1 -- 172.21.15.88:0/444834105 learned_addr learned my addr 172.21.15.88:0/444834105 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:44.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bcb400640 1 -- 172.21.15.88:0/444834105 >> v1:172.21.15.142:6789/0 conn(0x7f7bcc0b3eb0 legacy=0x7f7bcc0bdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:44.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bcb400640 1 -- 172.21.15.88:0/444834105 >> v1:172.21.15.88:6789/0 conn(0x7f7bcc09b9d0 legacy=0x7f7bcc152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:44.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.946+0000 7f7bcb400640 1 -- 172.21.15.88:0/444834105 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc0b4460 con 0x7f7bcc14b190 2024-04-24T08:25:44.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.950+0000 7f7bcb400640 1 --2- 172.21.15.88:0/444834105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bcc14b190 0x7f7bcc147ba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80097c0 tx=0x7f7bb801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1fe5f867ea0741 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:44.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.950+0000 7f7bcaa00640 1 -- 172.21.15.88:0/444834105 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80b0070 con 0x7f7bcc14b190 2024-04-24T08:25:44.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.950+0000 7f7bcaa00640 1 -- 172.21.15.88:0/444834105 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb80ab600 con 0x7f7bcc14b190 2024-04-24T08:25:44.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.950+0000 7f7bcaa00640 1 -- 172.21.15.88:0/444834105 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80ab9d0 con 0x7f7bcc14b190 2024-04-24T08:25:44.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.950+0000 7f7bd3200640 1 -- 172.21.15.88:0/444834105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bcc14b190 msgr2=0x7f7bcc147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:44.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.950+0000 7f7bd3200640 1 --2- 172.21.15.88:0/444834105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bcc14b190 0x7f7bcc147ba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80097c0 tx=0x7f7bb801c410 comp rx=0 tx=0).stop 2024-04-24T08:25:44.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.950+0000 7f7bd3200640 1 -- 172.21.15.88:0/444834105 shutdown_connections 2024-04-24T08:25:44.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.950+0000 7f7bd3200640 1 --2- 172.21.15.88:0/444834105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bcc14b190 0x7f7bcc147ba0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.950+0000 7f7bd3200640 1 -- 172.21.15.88:0/444834105 >> 172.21.15.88:0/444834105 conn(0x7f7bcc067e10 msgr2=0x7f7bcc0bd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:44.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.950+0000 7f7bd3200640 1 -- 172.21.15.88:0/444834105 shutdown_connections 2024-04-24T08:25:44.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.950+0000 7f7bd3200640 1 -- 172.21.15.88:0/444834105 wait complete. 2024-04-24T08:25:44.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bd3200640 1 Processor -- start 2024-04-24T08:25:44.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bd3200640 1 -- start start 2024-04-24T08:25:44.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bd3200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bcc0b3eb0 0x7f7bcc0b7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bd3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bcc09fea0 0x7f7bcc1e47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bd3200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bcc145090 0x7f7bcc09e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bd3200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc156c90 con 0x7f7bcc0b3eb0 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bd3200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc14c0e0 con 0x7f7bcc09fea0 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bd3200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7bcc156e10 con 0x7f7bcc145090 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bcbe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bcc0b3eb0 0x7f7bcc0b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bcbe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bcc0b3eb0 0x7f7bcc0b7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49786/0 (socket says 172.21.15.88:49786) 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bcbe00640 1 -- 172.21.15.88:0/4075460993 learned_addr learned my addr 172.21.15.88:0/4075460993 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bcb400640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bcc09fea0 0x7f7bcc1e47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bd1200640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bcc145090 0x7f7bcc09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bcbe00640 1 -- 172.21.15.88:0/4075460993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bcc145090 msgr2=0x7f7bcc09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bcbe00640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bcc145090 0x7f7bcc09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bcbe00640 1 -- 172.21.15.88:0/4075460993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bcc09fea0 msgr2=0x7f7bcc1e47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bcbe00640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bcc09fea0 0x7f7bcc1e47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bcbe00640 1 -- 172.21.15.88:0/4075460993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc0b7a40 con 0x7f7bcc0b3eb0 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bcbe00640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bcc0b3eb0 0x7f7bcc0b7500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00c790 tx=0x7f7bbc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:44.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bc3e00640 1 -- 172.21.15.88:0/4075460993 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc016020 con 0x7f7bcc0b3eb0 2024-04-24T08:25:44.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bc3e00640 1 -- 172.21.15.88:0/4075460993 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bbc006d60 con 0x7f7bcc0b3eb0 2024-04-24T08:25:44.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bd3200640 1 -- 172.21.15.88:0/4075460993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bcc0b4f10 con 0x7f7bcc0b3eb0 2024-04-24T08:25:44.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bc3e00640 1 -- 172.21.15.88:0/4075460993 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc003bc0 con 0x7f7bcc0b3eb0 2024-04-24T08:25:44.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bd3200640 1 -- 172.21.15.88:0/4075460993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bcc09f110 con 0x7f7bcc0b3eb0 2024-04-24T08:25:44.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.954+0000 7f7bd3200640 1 -- 172.21.15.88:0/4075460993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bcc068c00 con 0x7f7bcc0b3eb0 2024-04-24T08:25:44.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.958+0000 7f7bc3e00640 1 -- 172.21.15.88:0/4075460993 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7bbc00a850 con 0x7f7bcc0b3eb0 2024-04-24T08:25:44.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.958+0000 7f7bc3e00640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7bac0683b0 0x7f7bac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:44.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.958+0000 7f7bc3e00640 1 -- 172.21.15.88:0/4075460993 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7bbc0865f0 con 0x7f7bcc0b3eb0 2024-04-24T08:25:44.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.958+0000 7f7bcb400640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7bac0683b0 0x7f7bac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:44.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.958+0000 7f7bcb400640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7bac0683b0 0x7f7bac06a870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80ad000 tx=0x7f7bb80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:44.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:44.962+0000 7f7bc3e00640 1 -- 172.21.15.88:0/4075460993 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7bbc020020 con 0x7f7bcc0b3eb0 2024-04-24T08:25:45.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 -- 172.21.15.88:0/4075460993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7bcc0b5540 con 0x7f7bcc0b3eb0 2024-04-24T08:25:45.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bc3e00640 1 -- 172.21.15.88:0/4075460993 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f7bbc056c40 con 0x7f7bcc0b3eb0 2024-04-24T08:25:45.122 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:25:45.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 -- 172.21.15.88:0/4075460993 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7bac0683b0 msgr2=0x7f7bac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7bac0683b0 0x7f7bac06a870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80ad000 tx=0x7f7bb80a6000 comp rx=0 tx=0).stop 2024-04-24T08:25:45.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 -- 172.21.15.88:0/4075460993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bcc0b3eb0 msgr2=0x7f7bcc0b7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bcc0b3eb0 0x7f7bcc0b7500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00c790 tx=0x7f7bbc00cc50 comp rx=0 tx=0).stop 2024-04-24T08:25:45.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 -- 172.21.15.88:0/4075460993 shutdown_connections 2024-04-24T08:25:45.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7bac0683b0 0x7f7bac06a870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bcc145090 0x7f7bcc09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bcc09fea0 0x7f7bcc1e47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 --2- 172.21.15.88:0/4075460993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bcc0b3eb0 0x7f7bcc0b7500 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 -- 172.21.15.88:0/4075460993 >> 172.21.15.88:0/4075460993 conn(0x7f7bcc067e10 msgr2=0x7f7bcc0bcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:45.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 -- 172.21.15.88:0/4075460993 shutdown_connections 2024-04-24T08:25:45.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.122+0000 7f7bd3200640 1 -- 172.21.15.88:0/4075460993 wait complete. 2024-04-24T08:25:45.143 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T08:25:45.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b95800640 1 Processor -- start 2024-04-24T08:25:45.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b95800640 1 -- start start 2024-04-24T08:25:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b95800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6b900bbfb0 0x7f6b900b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b95800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b9006cbe0 0x7f6b90141950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b95800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b9014b250 0x7f6b90141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b95800640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6b901423d0 con 0x7f6b9014b250 2024-04-24T08:25:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b95800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6b900bc390 con 0x7f6b900bbfb0 2024-04-24T08:25:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b95800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9006e640 con 0x7f6b9006cbe0 2024-04-24T08:25:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b8f400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b9014b250 0x7f6b90141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b8f400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b9014b250 0x7f6b90141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49800/0 (socket says 172.21.15.88:49800) 2024-04-24T08:25:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b8f400640 1 -- 172.21.15.88:0/2391497323 learned_addr learned my addr 172.21.15.88:0/2391497323 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b8ea00640 1 --2- 172.21.15.88:0/2391497323 >> v2:172.21.15.142:3300/0 conn(0x7f6b900bbfb0 0x7f6b900b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b86000640 1 --2- 172.21.15.88:0/2391497323 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b9006cbe0 0x7f6b90141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b8f400640 1 -- 172.21.15.88:0/2391497323 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b9006cbe0 msgr2=0x7f6b90141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:45.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b8f400640 1 --2- 172.21.15.88:0/2391497323 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b9006cbe0 0x7f6b90141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b8f400640 1 -- 172.21.15.88:0/2391497323 >> v2:172.21.15.142:3300/0 conn(0x7f6b900bbfb0 msgr2=0x7f6b900b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:45.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b8f400640 1 --2- 172.21.15.88:0/2391497323 >> v2:172.21.15.142:3300/0 conn(0x7f6b900bbfb0 0x7f6b900b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.282+0000 7f6b8f400640 1 -- 172.21.15.88:0/2391497323 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9006e920 con 0x7f6b9014b250 2024-04-24T08:25:45.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b8f400640 1 --2- 172.21.15.88:0/2391497323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b9014b250 0x7f6b90141e90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6b900bc640 tx=0x7f6b8801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bc7a93513801c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:45.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b8e000640 1 -- 172.21.15.88:0/2391497323 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b880a5670 con 0x7f6b9014b250 2024-04-24T08:25:45.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b8e000640 1 -- 172.21.15.88:0/2391497323 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b880a5810 con 0x7f6b9014b250 2024-04-24T08:25:45.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b8e000640 1 -- 172.21.15.88:0/2391497323 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b880a5be0 con 0x7f6b9014b250 2024-04-24T08:25:45.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b95800640 1 -- 172.21.15.88:0/2391497323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b9014b250 msgr2=0x7f6b90141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b95800640 1 --2- 172.21.15.88:0/2391497323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b9014b250 0x7f6b90141e90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6b900bc640 tx=0x7f6b8801c9f0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b95800640 1 -- 172.21.15.88:0/2391497323 shutdown_connections 2024-04-24T08:25:45.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b95800640 1 --2- 172.21.15.88:0/2391497323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b9014b250 0x7f6b90141e90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b95800640 1 --2- 172.21.15.88:0/2391497323 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b9006cbe0 0x7f6b90141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b95800640 1 --2- 172.21.15.88:0/2391497323 >> v2:172.21.15.142:3300/0 conn(0x7f6b900bbfb0 0x7f6b900b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b95800640 1 -- 172.21.15.88:0/2391497323 >> 172.21.15.88:0/2391497323 conn(0x7f6b90067e40 msgr2=0x7f6b900bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:45.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b95800640 1 -- 172.21.15.88:0/2391497323 shutdown_connections 2024-04-24T08:25:45.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.286+0000 7f6b95800640 1 -- 172.21.15.88:0/2391497323 wait complete. 2024-04-24T08:25:45.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b95800640 1 Processor -- start 2024-04-24T08:25:45.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b95800640 1 -- start start 2024-04-24T08:25:45.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b95800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b9006cbe0 0x7f6b9014a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b95800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b900bbfb0 0x7f6b901e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b95800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b9014b250 0x7f6b901427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b95800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90073020 con 0x7f6b9014b250 2024-04-24T08:25:45.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b95800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90072ea0 con 0x7f6b9006cbe0 2024-04-24T08:25:45.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b95800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6b900731a0 con 0x7f6b900bbfb0 2024-04-24T08:25:45.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b8f400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b9014b250 0x7f6b901427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b8f400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b9014b250 0x7f6b901427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49804/0 (socket says 172.21.15.88:49804) 2024-04-24T08:25:45.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b8f400640 1 -- 172.21.15.88:0/3785506446 learned_addr learned my addr 172.21.15.88:0/3785506446 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:45.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b8ea00640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b9006cbe0 0x7f6b9014a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b86000640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b900bbfb0 0x7f6b901e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b8f400640 1 -- 172.21.15.88:0/3785506446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b900bbfb0 msgr2=0x7f6b901e39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b8f400640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b900bbfb0 0x7f6b901e39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b8f400640 1 -- 172.21.15.88:0/3785506446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b9006cbe0 msgr2=0x7f6b9014a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b8f400640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b9006cbe0 0x7f6b9014a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b8f400640 1 -- 172.21.15.88:0/3785506446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b90143a20 con 0x7f6b9014b250 2024-04-24T08:25:45.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b8f400640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b9014b250 0x7f6b901427b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6b880af040 tx=0x7f6b88019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:45.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b87400640 1 -- 172.21.15.88:0/3785506446 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b880a5670 con 0x7f6b9014b250 2024-04-24T08:25:45.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b87400640 1 -- 172.21.15.88:0/3785506446 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b880be070 con 0x7f6b9014b250 2024-04-24T08:25:45.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b95800640 1 -- 172.21.15.88:0/3785506446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9013afb0 con 0x7f6b9014b250 2024-04-24T08:25:45.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b87400640 1 -- 172.21.15.88:0/3785506446 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88009510 con 0x7f6b9014b250 2024-04-24T08:25:45.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b95800640 1 -- 172.21.15.88:0/3785506446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9013ac40 con 0x7f6b9014b250 2024-04-24T08:25:45.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.290+0000 7f6b95800640 1 -- 172.21.15.88:0/3785506446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b90068c00 con 0x7f6b9014b250 2024-04-24T08:25:45.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.294+0000 7f6b87400640 1 -- 172.21.15.88:0/3785506446 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6b880b88b0 con 0x7f6b9014b250 2024-04-24T08:25:45.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.294+0000 7f6b87400640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6b6c068380 0x7f6b6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.294+0000 7f6b87400640 1 -- 172.21.15.88:0/3785506446 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6b881219e0 con 0x7f6b9014b250 2024-04-24T08:25:45.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.294+0000 7f6b8ea00640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6b6c068380 0x7f6b6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.294+0000 7f6b8ea00640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6b6c068380 0x7f6b6c06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6b80009b60 tx=0x7f6b80009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:45.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.298+0000 7f6b87400640 1 -- 172.21.15.88:0/3785506446 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b880165e0 con 0x7f6b9014b250 2024-04-24T08:25:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.454+0000 7f6b95800640 1 -- 172.21.15.88:0/3785506446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6b900bbb00 con 0x7f6b9014b250 2024-04-24T08:25:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.454+0000 7f6b87400640 1 -- 172.21.15.88:0/3785506446 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6b880f19e0 con 0x7f6b9014b250 2024-04-24T08:25:45.456 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-24T08:25:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.458+0000 7f6b95800640 1 -- 172.21.15.88:0/3785506446 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6b6c068380 msgr2=0x7f6b6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.458+0000 7f6b95800640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6b6c068380 0x7f6b6c06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6b80009b60 tx=0x7f6b80009190 comp rx=0 tx=0).stop 2024-04-24T08:25:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.458+0000 7f6b95800640 1 -- 172.21.15.88:0/3785506446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b9014b250 msgr2=0x7f6b901427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.458+0000 7f6b95800640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b9014b250 0x7f6b901427b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6b880af040 tx=0x7f6b88019790 comp rx=0 tx=0).stop 2024-04-24T08:25:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.458+0000 7f6b95800640 1 -- 172.21.15.88:0/3785506446 shutdown_connections 2024-04-24T08:25:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.458+0000 7f6b95800640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6b6c068380 0x7f6b6c06a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.458+0000 7f6b95800640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b9014b250 0x7f6b901427b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.458+0000 7f6b95800640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b900bbfb0 0x7f6b901e39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.458+0000 7f6b95800640 1 --2- 172.21.15.88:0/3785506446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b9006cbe0 0x7f6b9014a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.458+0000 7f6b95800640 1 -- 172.21.15.88:0/3785506446 >> 172.21.15.88:0/3785506446 conn(0x7f6b90067e40 msgr2=0x7f6b90073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.458+0000 7f6b95800640 1 -- 172.21.15.88:0/3785506446 shutdown_connections 2024-04-24T08:25:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.458+0000 7f6b95800640 1 -- 172.21.15.88:0/3785506446 wait complete. 2024-04-24T08:25:45.476 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T08:25:45.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9474400640 1 Processor -- start 2024-04-24T08:25:45.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9474400640 1 -- start start 2024-04-24T08:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9474400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f946c0bbfb0 0x7f946c0b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9474400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f946c142060 0x7f946c1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9474400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f946c0bc390 con 0x7f946c06cbe0 2024-04-24T08:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9474400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f946c06e640 con 0x7f946c0bbfb0 2024-04-24T08:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9474400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f946c06e920 con 0x7f946c142060 2024-04-24T08:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9471a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f946c0bbfb0 0x7f946c0b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9471a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f946c0bbfb0 0x7f946c0b7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49816/0 (socket says 172.21.15.88:49816) 2024-04-24T08:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9471a00640 1 -- 172.21.15.88:0/2997613853 learned_addr learned my addr 172.21.15.88:0/2997613853 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9472400640 1 --2- 172.21.15.88:0/2997613853 >> v2:172.21.15.142:3300/0 conn(0x7f946c142060 0x7f946c1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9471a00640 1 -- 172.21.15.88:0/2997613853 >> v2:172.21.15.142:3300/0 conn(0x7f946c142060 msgr2=0x7f946c1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9471a00640 1 --2- 172.21.15.88:0/2997613853 >> v2:172.21.15.142:3300/0 conn(0x7f946c142060 0x7f946c1525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9471a00640 1 -- 172.21.15.88:0/2997613853 >> v1:172.21.15.142:6789/0 conn(0x7f946c06cbe0 legacy=0x7f946c141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:45.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.613+0000 7f9471a00640 1 -- 172.21.15.88:0/2997613853 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946c06e2d0 con 0x7f946c0bbfb0 2024-04-24T08:25:45.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.617+0000 7f9471a00640 1 --2- 172.21.15.88:0/2997613853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f946c0bbfb0 0x7f946c0b7210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f946c06d530 tx=0x7f946001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15849bd21411d86d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:45.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.617+0000 7f946be00640 1 -- 172.21.15.88:0/2997613853 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600a55e0 con 0x7f946c0bbfb0 2024-04-24T08:25:45.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.617+0000 7f946be00640 1 -- 172.21.15.88:0/2997613853 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94600a5780 con 0x7f946c0bbfb0 2024-04-24T08:25:45.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.617+0000 7f946be00640 1 -- 172.21.15.88:0/2997613853 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600a5b50 con 0x7f946c0bbfb0 2024-04-24T08:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.617+0000 7f9474400640 1 -- 172.21.15.88:0/2997613853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f946c0bbfb0 msgr2=0x7f946c0b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.617+0000 7f9474400640 1 --2- 172.21.15.88:0/2997613853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f946c0bbfb0 0x7f946c0b7210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f946c06d530 tx=0x7f946001c920 comp rx=0 tx=0).stop 2024-04-24T08:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.617+0000 7f9474400640 1 -- 172.21.15.88:0/2997613853 shutdown_connections 2024-04-24T08:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.617+0000 7f9474400640 1 --2- 172.21.15.88:0/2997613853 >> v2:172.21.15.142:3300/0 conn(0x7f946c142060 0x7f946c1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.617+0000 7f9474400640 1 --2- 172.21.15.88:0/2997613853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f946c0bbfb0 0x7f946c0b7210 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.617+0000 7f9474400640 1 -- 172.21.15.88:0/2997613853 >> 172.21.15.88:0/2997613853 conn(0x7f946c067e40 msgr2=0x7f946c0bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.617+0000 7f9474400640 1 -- 172.21.15.88:0/2997613853 shutdown_connections 2024-04-24T08:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.617+0000 7f9474400640 1 -- 172.21.15.88:0/2997613853 wait complete. 2024-04-24T08:25:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9474400640 1 Processor -- start 2024-04-24T08:25:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9474400640 1 -- start start 2024-04-24T08:25:45.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9474400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f946c06cbe0 0x7f946c14a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9474400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f946c0bbfb0 0x7f946c1429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9474400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f946c142060 0x7f946c142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9474400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f946c1556d0 con 0x7f946c0bbfb0 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9474400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f946c155550 con 0x7f946c06cbe0 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9474400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f946c155850 con 0x7f946c142060 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9471000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f946c0bbfb0 0x7f946c1429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9471000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f946c0bbfb0 0x7f946c1429c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49824/0 (socket says 172.21.15.88:49824) 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9471000640 1 -- 172.21.15.88:0/3508742311 learned_addr learned my addr 172.21.15.88:0/3508742311 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9471a00640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f946c06cbe0 0x7f946c14a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9472400640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f946c142060 0x7f946c142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9471000640 1 -- 172.21.15.88:0/3508742311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f946c142060 msgr2=0x7f946c142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9471000640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f946c142060 0x7f946c142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9471000640 1 -- 172.21.15.88:0/3508742311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f946c06cbe0 msgr2=0x7f946c14a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9471000640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f946c06cbe0 0x7f946c14a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9471000640 1 -- 172.21.15.88:0/3508742311 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946c14d1d0 con 0x7f946c0bbfb0 2024-04-24T08:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9472400640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f946c142060 0x7f946c142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9471000640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f946c0bbfb0 0x7f946c1429c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f945800b410 tx=0x7f945800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9469600640 1 -- 172.21.15.88:0/3508742311 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458015030 con 0x7f946c0bbfb0 2024-04-24T08:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9469600640 1 -- 172.21.15.88:0/3508742311 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9458004020 con 0x7f946c0bbfb0 2024-04-24T08:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9469600640 1 -- 172.21.15.88:0/3508742311 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458004410 con 0x7f946c0bbfb0 2024-04-24T08:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9474400640 1 -- 172.21.15.88:0/3508742311 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f946c14d4b0 con 0x7f946c0bbfb0 2024-04-24T08:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9474400640 1 -- 172.21.15.88:0/3508742311 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f946c14acf0 con 0x7f946c0bbfb0 2024-04-24T08:25:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.621+0000 7f9474400640 1 -- 172.21.15.88:0/3508742311 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f946c144ec0 con 0x7f946c0bbfb0 2024-04-24T08:25:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.625+0000 7f9469600640 1 -- 172.21.15.88:0/3508742311 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9458018070 con 0x7f946c0bbfb0 2024-04-24T08:25:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.625+0000 7f9469600640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f944c068380 0x7f944c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.625+0000 7f9469600640 1 -- 172.21.15.88:0/3508742311 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f94580864b0 con 0x7f946c0bbfb0 2024-04-24T08:25:45.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.625+0000 7f9471a00640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f944c068380 0x7f944c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.625+0000 7f9471a00640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f944c068380 0x7f944c06a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f94600ae000 tx=0x7f94600a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:45.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.629+0000 7f9469600640 1 -- 172.21.15.88:0/3508742311 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9458056a60 con 0x7f946c0bbfb0 2024-04-24T08:25:45.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 -- 172.21.15.88:0/3508742311 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f946c068c00 con 0x7f946c0bbfb0 2024-04-24T08:25:45.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9469600640 1 -- 172.21.15.88:0/3508742311 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f9458056360 con 0x7f946c0bbfb0 2024-04-24T08:25:45.786 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-24T08:25:45.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 -- 172.21.15.88:0/3508742311 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f944c068380 msgr2=0x7f944c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f944c068380 0x7f944c06a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f94600ae000 tx=0x7f94600a7070 comp rx=0 tx=0).stop 2024-04-24T08:25:45.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 -- 172.21.15.88:0/3508742311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f946c0bbfb0 msgr2=0x7f946c1429c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f946c0bbfb0 0x7f946c1429c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f945800b410 tx=0x7f945800b8d0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 -- 172.21.15.88:0/3508742311 shutdown_connections 2024-04-24T08:25:45.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f944c068380 0x7f944c06a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f946c142060 0x7f946c142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f946c0bbfb0 0x7f946c1429c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 --2- 172.21.15.88:0/3508742311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f946c06cbe0 0x7f946c14a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 -- 172.21.15.88:0/3508742311 >> 172.21.15.88:0/3508742311 conn(0x7f946c067e40 msgr2=0x7f946c0bb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:45.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 -- 172.21.15.88:0/3508742311 shutdown_connections 2024-04-24T08:25:45.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.785+0000 7f9474400640 1 -- 172.21.15.88:0/3508742311 wait complete. 2024-04-24T08:25:45.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:45.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.941+0000 7fedb6000640 1 Processor -- start 2024-04-24T08:25:45.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.941+0000 7fedb6000640 1 -- start start 2024-04-24T08:25:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.941+0000 7fedb6000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb00bbe40 0x7fedb014b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.941+0000 7fedb6000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fedb01421b0 0x7fedb014bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.941+0000 7fedb6000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb00bc220 con 0x7fedb00b7b50 2024-04-24T08:25:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.941+0000 7fedb6000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fedb00b6220 con 0x7fedb01421b0 2024-04-24T08:25:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.941+0000 7fedb6000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fedb00b6500 con 0x7fedb00bbe40 2024-04-24T08:25:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.941+0000 7fedaea00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fedb00b7b50 0x7fedb0141aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39538/0 (socket says 172.21.15.88:39538) 2024-04-24T08:25:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.941+0000 7fedaea00640 1 -- 172.21.15.88:0/3739445935 learned_addr learned my addr 172.21.15.88:0/3739445935 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedafe00640 1 --2- 172.21.15.88:0/3739445935 >> v2:172.21.15.88:3300/0 conn(0x7fedb01421b0 0x7fedb014bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedaf400640 1 --2- 172.21.15.88:0/3739445935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb00bbe40 0x7fedb014b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedae000640 1 -- 172.21.15.88:0/3739445935 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60341923 0 0) 0x7fedb00bc220 con 0x7fedb00b7b50 2024-04-24T08:25:45.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedae000640 1 -- 172.21.15.88:0/3739445935 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed94003530 con 0x7fedb00b7b50 2024-04-24T08:25:45.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedafe00640 1 -- 172.21.15.88:0/3739445935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb00bbe40 msgr2=0x7fedb014b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:45.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedafe00640 1 --2- 172.21.15.88:0/3739445935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb00bbe40 0x7fedb014b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedafe00640 1 -- 172.21.15.88:0/3739445935 >> v1:172.21.15.88:6789/0 conn(0x7fedb00b7b50 legacy=0x7fedb0141aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedafe00640 1 -- 172.21.15.88:0/3739445935 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb014b350 con 0x7fedb01421b0 2024-04-24T08:25:45.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedaf400640 1 --2- 172.21.15.88:0/3739445935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb00bbe40 0x7fedb014b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:45.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedafe00640 1 --2- 172.21.15.88:0/3739445935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedb01421b0 0x7fedb014bdb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feda80097c0 tx=0x7feda801ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bb017db9d4b006 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:45.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedae000640 1 -- 172.21.15.88:0/3739445935 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda80b1070 con 0x7fedb01421b0 2024-04-24T08:25:45.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedae000640 1 -- 172.21.15.88:0/3739445935 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda80ac630 con 0x7fedb01421b0 2024-04-24T08:25:45.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.945+0000 7fedae000640 1 -- 172.21.15.88:0/3739445935 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda80a8050 con 0x7fedb01421b0 2024-04-24T08:25:45.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 -- 172.21.15.88:0/3739445935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedb01421b0 msgr2=0x7fedb014bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 --2- 172.21.15.88:0/3739445935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedb01421b0 0x7fedb014bdb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feda80097c0 tx=0x7feda801ce10 comp rx=0 tx=0).stop 2024-04-24T08:25:45.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 -- 172.21.15.88:0/3739445935 shutdown_connections 2024-04-24T08:25:45.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 --2- 172.21.15.88:0/3739445935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedb01421b0 0x7fedb014bdb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 --2- 172.21.15.88:0/3739445935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb00bbe40 0x7fedb014b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 -- 172.21.15.88:0/3739445935 >> 172.21.15.88:0/3739445935 conn(0x7fedb0067e10 msgr2=0x7fedb00bb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 -- 172.21.15.88:0/3739445935 shutdown_connections 2024-04-24T08:25:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 -- 172.21.15.88:0/3739445935 wait complete. 2024-04-24T08:25:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 Processor -- start 2024-04-24T08:25:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 -- start start 2024-04-24T08:25:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedb00b7b50 0x7fedb014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedb00bbe40 0x7fedb00afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb01421b0 0x7fedb01e3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fedb0154fe0 con 0x7fedb00b7b50 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fedb0154e60 con 0x7fedb00bbe40 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fedb0155160 con 0x7fedb01421b0 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedaf400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedb00b7b50 0x7fedb014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedaf400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedb00b7b50 0x7fedb014a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49850/0 (socket says 172.21.15.88:49850) 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedaf400640 1 -- 172.21.15.88:0/238471974 learned_addr learned my addr 172.21.15.88:0/238471974 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedaea00640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedb00bbe40 0x7fedb00afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedafe00640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb01421b0 0x7fedb01e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedaf400640 1 -- 172.21.15.88:0/238471974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb01421b0 msgr2=0x7fedb01e3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedaf400640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb01421b0 0x7fedb01e3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedaf400640 1 -- 172.21.15.88:0/238471974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedb00bbe40 msgr2=0x7fedb00afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedaf400640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedb00bbe40 0x7fedb00afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedaf400640 1 -- 172.21.15.88:0/238471974 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb00b0260 con 0x7fedb00b7b50 2024-04-24T08:25:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedaf400640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedb00b7b50 0x7fedb014a340 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feda0009fc0 tx=0x7feda000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7feda7400640 1 -- 172.21.15.88:0/238471974 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda001a070 con 0x7fedb00b7b50 2024-04-24T08:25:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7feda7400640 1 -- 172.21.15.88:0/238471974 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda0003ba0 con 0x7fedb00b7b50 2024-04-24T08:25:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7feda7400640 1 -- 172.21.15.88:0/238471974 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0004030 con 0x7fedb00b7b50 2024-04-24T08:25:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 -- 172.21.15.88:0/238471974 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb014ae30 con 0x7fedb00b7b50 2024-04-24T08:25:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.949+0000 7fedb6000640 1 -- 172.21.15.88:0/238471974 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb00b07c0 con 0x7fedb00b7b50 2024-04-24T08:25:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.953+0000 7fedb6000640 1 -- 172.21.15.88:0/238471974 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb0068b90 con 0x7fedb00b7b50 2024-04-24T08:25:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.953+0000 7feda7400640 1 -- 172.21.15.88:0/238471974 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feda001d070 con 0x7fedb00b7b50 2024-04-24T08:25:45.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.953+0000 7feda7400640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fed90068380 0x7fed9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:45.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.953+0000 7feda7400640 1 -- 172.21.15.88:0/238471974 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feda0086b30 con 0x7fedb00b7b50 2024-04-24T08:25:45.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.953+0000 7fedaea00640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fed90068380 0x7fed9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:45.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.953+0000 7fedaea00640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fed90068380 0x7fed9006a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fedb00b4970 tx=0x7fed9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:45.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:45.957+0000 7feda7400640 1 -- 172.21.15.88:0/238471974 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fedb00b0260 con 0x7fedb00b7b50 2024-04-24T08:25:46.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 -- 172.21.15.88:0/238471974 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedb00738e0 con 0x7fedb00b7b50 2024-04-24T08:25:46.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7feda7400640 1 -- 172.21.15.88:0/238471974 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7feda0010070 con 0x7fedb00b7b50 2024-04-24T08:25:46.118 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:46.119 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 -- 172.21.15.88:0/238471974 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fed90068380 msgr2=0x7fed9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fed90068380 0x7fed9006a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fedb00b4970 tx=0x7fed9c009040 comp rx=0 tx=0).stop 2024-04-24T08:25:46.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 -- 172.21.15.88:0/238471974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedb00b7b50 msgr2=0x7fedb014a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedb00b7b50 0x7fedb014a340 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feda0009fc0 tx=0x7feda000d560 comp rx=0 tx=0).stop 2024-04-24T08:25:46.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 -- 172.21.15.88:0/238471974 shutdown_connections 2024-04-24T08:25:46.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fed90068380 0x7fed9006a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb01421b0 0x7fedb01e3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedb00bbe40 0x7fedb00afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 --2- 172.21.15.88:0/238471974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fedb00b7b50 0x7fedb014a340 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 -- 172.21.15.88:0/238471974 >> 172.21.15.88:0/238471974 conn(0x7fedb0067e10 msgr2=0x7fedb00b7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:46.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 -- 172.21.15.88:0/238471974 shutdown_connections 2024-04-24T08:25:46.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.117+0000 7fedb6000640 1 -- 172.21.15.88:0/238471974 wait complete. 2024-04-24T08:25:46.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T08:25:25.116395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T08:25:26.444475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:25:46.140 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:25:46.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5683200640 1 Processor -- start 2024-04-24T08:25:46.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5683200640 1 -- start start 2024-04-24T08:25:46.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5683200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f567c0bbfb0 0x7f567c0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5683200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f567c0b2b40 0x7f567c142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5683200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f567c0b7be0 0x7f567c1431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5683200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f567c0bc390 con 0x7f567c0b7be0 2024-04-24T08:25:46.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5683200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f567c0b6400 con 0x7f567c0b2b40 2024-04-24T08:25:46.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5683200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f567c0b66e0 con 0x7f567c0bbfb0 2024-04-24T08:25:46.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5681200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f567c0b7be0 0x7f567c1431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5681200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f567c0b7be0 0x7f567c1431f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49864/0 (socket says 172.21.15.88:49864) 2024-04-24T08:25:46.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5681200640 1 -- 172.21.15.88:0/933994348 learned_addr learned my addr 172.21.15.88:0/933994348 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:46.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5681200640 1 -- 172.21.15.88:0/933994348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f567c0bbfb0 msgr2=0x7f567c0b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:46.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5681200640 1 --2- 172.21.15.88:0/933994348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f567c0bbfb0 0x7f567c0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5681200640 1 -- 172.21.15.88:0/933994348 >> v2:172.21.15.142:3300/0 conn(0x7f567c0b2b40 msgr2=0x7f567c142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:46.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5681200640 1 --2- 172.21.15.88:0/933994348 >> v2:172.21.15.142:3300/0 conn(0x7f567c0b2b40 0x7f567c142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.277+0000 7f5681200640 1 -- 172.21.15.88:0/933994348 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567c0b5070 con 0x7f567c0b7be0 2024-04-24T08:25:46.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f5681200640 1 --2- 172.21.15.88:0/933994348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f567c0b7be0 0x7f567c1431f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f567c0bc6c0 tx=0x7f567401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3faa49868b0b573 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:46.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f567aa00640 1 -- 172.21.15.88:0/933994348 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56740a5550 con 0x7f567c0b7be0 2024-04-24T08:25:46.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f567aa00640 1 -- 172.21.15.88:0/933994348 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56740a56f0 con 0x7f567c0b7be0 2024-04-24T08:25:46.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f567aa00640 1 -- 172.21.15.88:0/933994348 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56740a5ac0 con 0x7f567c0b7be0 2024-04-24T08:25:46.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f5683200640 1 -- 172.21.15.88:0/933994348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f567c0b7be0 msgr2=0x7f567c1431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f5683200640 1 --2- 172.21.15.88:0/933994348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f567c0b7be0 0x7f567c1431f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f567c0bc6c0 tx=0x7f567401c8d0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f5683200640 1 -- 172.21.15.88:0/933994348 shutdown_connections 2024-04-24T08:25:46.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f5683200640 1 --2- 172.21.15.88:0/933994348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f567c0b7be0 0x7f567c1431f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f5683200640 1 --2- 172.21.15.88:0/933994348 >> v2:172.21.15.142:3300/0 conn(0x7f567c0b2b40 0x7f567c142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f5683200640 1 --2- 172.21.15.88:0/933994348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f567c0bbfb0 0x7f567c0b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f5683200640 1 -- 172.21.15.88:0/933994348 >> 172.21.15.88:0/933994348 conn(0x7f567c067e40 msgr2=0x7f567c0bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:46.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f5683200640 1 -- 172.21.15.88:0/933994348 shutdown_connections 2024-04-24T08:25:46.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.281+0000 7f5683200640 1 -- 172.21.15.88:0/933994348 wait complete. 2024-04-24T08:25:46.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5683200640 1 Processor -- start 2024-04-24T08:25:46.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5683200640 1 -- start start 2024-04-24T08:25:46.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5683200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f567c0b2b40 0x7f567c0baef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5683200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f567c0b7be0 0x7f567c144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5683200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f567c0bbfb0 0x7f567c0b9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5683200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f567c073270 con 0x7f567c0b2b40 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5683200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f567c0730f0 con 0x7f567c0bbfb0 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5683200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f567c0733f0 con 0x7f567c0b7be0 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f567be00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f567c0b2b40 0x7f567c0baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f567be00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f567c0b2b40 0x7f567c0baef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49872/0 (socket says 172.21.15.88:49872) 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f567be00640 1 -- 172.21.15.88:0/3062334887 learned_addr learned my addr 172.21.15.88:0/3062334887 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5681200640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f567c0bbfb0 0x7f567c0b9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f567b400640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f567c0b7be0 0x7f567c144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f567be00640 1 -- 172.21.15.88:0/3062334887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f567c0b7be0 msgr2=0x7f567c144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f567be00640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f567c0b7be0 0x7f567c144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f567be00640 1 -- 172.21.15.88:0/3062334887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f567c0bbfb0 msgr2=0x7f567c0b9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f567be00640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f567c0bbfb0 0x7f567c0b9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f567be00640 1 -- 172.21.15.88:0/3062334887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567c148240 con 0x7f567c0b2b40 2024-04-24T08:25:46.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f567be00640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f567c0b2b40 0x7f567c0baef0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f566c00b440 tx=0x7f566c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:46.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5673e00640 1 -- 172.21.15.88:0/3062334887 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c015020 con 0x7f567c0b2b40 2024-04-24T08:25:46.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5673e00640 1 -- 172.21.15.88:0/3062334887 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566c0118b0 con 0x7f567c0b2b40 2024-04-24T08:25:46.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5683200640 1 -- 172.21.15.88:0/3062334887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567c1484b0 con 0x7f567c0b2b40 2024-04-24T08:25:46.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5673e00640 1 -- 172.21.15.88:0/3062334887 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c011ca0 con 0x7f567c0b2b40 2024-04-24T08:25:46.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5683200640 1 -- 172.21.15.88:0/3062334887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567c146fd0 con 0x7f567c0b2b40 2024-04-24T08:25:46.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.285+0000 7f5683200640 1 -- 172.21.15.88:0/3062334887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f567c068c00 con 0x7f567c0b2b40 2024-04-24T08:25:46.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.289+0000 7f5673e00640 1 -- 172.21.15.88:0/3062334887 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f566c018020 con 0x7f567c0b2b40 2024-04-24T08:25:46.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.289+0000 7f5673e00640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f565c0683b0 0x7f565c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.289+0000 7f5673e00640 1 -- 172.21.15.88:0/3062334887 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f566c086a80 con 0x7f567c0b2b40 2024-04-24T08:25:46.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.289+0000 7f567b400640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f565c0683b0 0x7f565c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.289+0000 7f567b400640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f565c0683b0 0x7f565c06a870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5668006fd0 tx=0x7f5668008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:46.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.293+0000 7f5673e00640 1 -- 172.21.15.88:0/3062334887 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f566c088e20 con 0x7f567c0b2b40 2024-04-24T08:25:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.449+0000 7f5683200640 1 -- 172.21.15.88:0/3062334887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f567c14fce0 con 0x7f567c0b2b40 2024-04-24T08:25:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.449+0000 7f5673e00640 1 -- 172.21.15.88:0/3062334887 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f566c01f020 con 0x7f567c0b2b40 2024-04-24T08:25:46.452 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:25:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.453+0000 7f5683200640 1 -- 172.21.15.88:0/3062334887 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f565c0683b0 msgr2=0x7f565c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.453+0000 7f5683200640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f565c0683b0 0x7f565c06a870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5668006fd0 tx=0x7f5668008040 comp rx=0 tx=0).stop 2024-04-24T08:25:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.453+0000 7f5683200640 1 -- 172.21.15.88:0/3062334887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f567c0b2b40 msgr2=0x7f567c0baef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.453+0000 7f5683200640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f567c0b2b40 0x7f567c0baef0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f566c00b440 tx=0x7f566c00b900 comp rx=0 tx=0).stop 2024-04-24T08:25:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.453+0000 7f5683200640 1 -- 172.21.15.88:0/3062334887 shutdown_connections 2024-04-24T08:25:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.453+0000 7f5683200640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f565c0683b0 0x7f565c06a870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.453+0000 7f5683200640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f567c0bbfb0 0x7f567c0b9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.453+0000 7f5683200640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f567c0b7be0 0x7f567c144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.453+0000 7f5683200640 1 --2- 172.21.15.88:0/3062334887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f567c0b2b40 0x7f567c0baef0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.453+0000 7f5683200640 1 -- 172.21.15.88:0/3062334887 >> 172.21.15.88:0/3062334887 conn(0x7f567c067e40 msgr2=0x7f567c14e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:46.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.453+0000 7f5683200640 1 -- 172.21.15.88:0/3062334887 shutdown_connections 2024-04-24T08:25:46.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.453+0000 7f5683200640 1 -- 172.21.15.88:0/3062334887 wait complete. 2024-04-24T08:25:46.472 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T08:25:46.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07bc000640 1 Processor -- start 2024-04-24T08:25:46.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07bc000640 1 -- start start 2024-04-24T08:25:46.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07bc000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f07b40b4c90 0x7f07b4145f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07bc000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07b409e7a0 0x7f07b41464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07bc000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b406d4f0 con 0x7f07b406e490 2024-04-24T08:25:46.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07bc000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f07b406d2a0 con 0x7f07b40b4c90 2024-04-24T08:25:46.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07bc000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f07b406d7d0 con 0x7f07b409e7a0 2024-04-24T08:25:46.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07b9600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f07b40b4c90 0x7f07b4145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07b9600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f07b40b4c90 0x7f07b4145f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49882/0 (socket says 172.21.15.88:49882) 2024-04-24T08:25:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07b9600640 1 -- 172.21.15.88:0/3416015960 learned_addr learned my addr 172.21.15.88:0/3416015960 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07ba000640 1 --2- 172.21.15.88:0/3416015960 >> v2:172.21.15.142:3300/0 conn(0x7f07b409e7a0 0x7f07b41464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07b9600640 1 -- 172.21.15.88:0/3416015960 >> v2:172.21.15.142:3300/0 conn(0x7f07b409e7a0 msgr2=0x7f07b41464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07b9600640 1 --2- 172.21.15.88:0/3416015960 >> v2:172.21.15.142:3300/0 conn(0x7f07b409e7a0 0x7f07b41464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07b9600640 1 -- 172.21.15.88:0/3416015960 >> v1:172.21.15.142:6789/0 conn(0x7f07b406e490 legacy=0x7f07b409e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:46.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.609+0000 7f07b9600640 1 -- 172.21.15.88:0/3416015960 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b409c570 con 0x7f07b40b4c90 2024-04-24T08:25:46.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.613+0000 7f07b9600640 1 --2- 172.21.15.88:0/3416015960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07b40b4c90 0x7f07b4145f80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f07b40b54d0 tx=0x7f07a801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320cc79701d4ad49 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:46.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.613+0000 7f07b3e00640 1 -- 172.21.15.88:0/3416015960 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a80b2070 con 0x7f07b40b4c90 2024-04-24T08:25:46.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.613+0000 7f07b3e00640 1 -- 172.21.15.88:0/3416015960 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a80a9070 con 0x7f07b40b4c90 2024-04-24T08:25:46.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.613+0000 7f07b3e00640 1 -- 172.21.15.88:0/3416015960 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a80ad880 con 0x7f07b40b4c90 2024-04-24T08:25:46.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.613+0000 7f07bc000640 1 -- 172.21.15.88:0/3416015960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07b40b4c90 msgr2=0x7f07b4145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.613+0000 7f07bc000640 1 --2- 172.21.15.88:0/3416015960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07b40b4c90 0x7f07b4145f80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f07b40b54d0 tx=0x7f07a801c450 comp rx=0 tx=0).stop 2024-04-24T08:25:46.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.613+0000 7f07bc000640 1 -- 172.21.15.88:0/3416015960 shutdown_connections 2024-04-24T08:25:46.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.613+0000 7f07bc000640 1 --2- 172.21.15.88:0/3416015960 >> v2:172.21.15.142:3300/0 conn(0x7f07b409e7a0 0x7f07b41464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.613+0000 7f07bc000640 1 --2- 172.21.15.88:0/3416015960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07b40b4c90 0x7f07b4145f80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.613+0000 7f07bc000640 1 -- 172.21.15.88:0/3416015960 >> 172.21.15.88:0/3416015960 conn(0x7f07b40b9690 msgr2=0x7f07b40b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:46.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.613+0000 7f07bc000640 1 -- 172.21.15.88:0/3416015960 shutdown_connections 2024-04-24T08:25:46.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.613+0000 7f07bc000640 1 -- 172.21.15.88:0/3416015960 wait complete. 2024-04-24T08:25:46.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07bc000640 1 Processor -- start 2024-04-24T08:25:46.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07bc000640 1 -- start start 2024-04-24T08:25:46.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07bc000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b406e490 0x7f07b40b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07bc000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07b409e7a0 0x7f07b41e03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07bc000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b40b4c90 0x7f07b4149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07bc000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f07b4152fc0 con 0x7f07b409e7a0 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07bc000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f07b4152e40 con 0x7f07b406e490 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07bc000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f07b4153140 con 0x7f07b40b4c90 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b8c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07b409e7a0 0x7f07b41e03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b8c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07b409e7a0 0x7f07b41e03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49896/0 (socket says 172.21.15.88:49896) 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b8c00640 1 -- 172.21.15.88:0/1744529324 learned_addr learned my addr 172.21.15.88:0/1744529324 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b9600640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b406e490 0x7f07b40b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07ba000640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b40b4c90 0x7f07b4149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b8c00640 1 -- 172.21.15.88:0/1744529324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b40b4c90 msgr2=0x7f07b4149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b8c00640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b40b4c90 0x7f07b4149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b8c00640 1 -- 172.21.15.88:0/1744529324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b406e490 msgr2=0x7f07b40b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b8c00640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b406e490 0x7f07b40b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b8c00640 1 -- 172.21.15.88:0/1744529324 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b40b18e0 con 0x7f07b409e7a0 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b8c00640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07b409e7a0 0x7f07b41e03d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f07a000c450 tx=0x7f07a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b1600640 1 -- 172.21.15.88:0/1744529324 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a0012830 con 0x7f07b409e7a0 2024-04-24T08:25:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b1600640 1 -- 172.21.15.88:0/1744529324 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a0017070 con 0x7f07b409e7a0 2024-04-24T08:25:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07b1600640 1 -- 172.21.15.88:0/1744529324 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a0012c30 con 0x7f07b409e7a0 2024-04-24T08:25:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07bc000640 1 -- 172.21.15.88:0/1744529324 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b4142360 con 0x7f07b409e7a0 2024-04-24T08:25:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07bc000640 1 -- 172.21.15.88:0/1744529324 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b40b3780 con 0x7f07b409e7a0 2024-04-24T08:25:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.617+0000 7f07bc000640 1 -- 172.21.15.88:0/1744529324 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b4068c00 con 0x7f07b409e7a0 2024-04-24T08:25:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.621+0000 7f07b1600640 1 -- 172.21.15.88:0/1744529324 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f07a001c460 con 0x7f07b409e7a0 2024-04-24T08:25:46.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.621+0000 7f07b1600640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f07940683b0 0x7f079406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.621+0000 7f07b1600640 1 -- 172.21.15.88:0/1744529324 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f07a0086590 con 0x7f07b409e7a0 2024-04-24T08:25:46.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.621+0000 7f07b9600640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f07940683b0 0x7f079406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.621+0000 7f07b9600640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f07940683b0 0x7f079406a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f07a80af000 tx=0x7f07a80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:46.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.625+0000 7f07b1600640 1 -- 172.21.15.88:0/1744529324 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f07a00564f0 con 0x7f07b409e7a0 2024-04-24T08:25:46.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.781+0000 7f07bc000640 1 -- 172.21.15.88:0/1744529324 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f07b4143420 con 0x7f07b409e7a0 2024-04-24T08:25:46.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.781+0000 7f07b1600640 1 -- 172.21.15.88:0/1744529324 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f07a005a7f0 con 0x7f07b409e7a0 2024-04-24T08:25:46.785 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-24T08:25:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.785+0000 7f07bc000640 1 -- 172.21.15.88:0/1744529324 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f07940683b0 msgr2=0x7f079406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.785+0000 7f07bc000640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f07940683b0 0x7f079406a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f07a80af000 tx=0x7f07a80a7000 comp rx=0 tx=0).stop 2024-04-24T08:25:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.785+0000 7f07bc000640 1 -- 172.21.15.88:0/1744529324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07b409e7a0 msgr2=0x7f07b41e03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.785+0000 7f07bc000640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07b409e7a0 0x7f07b41e03d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f07a000c450 tx=0x7f07a000c910 comp rx=0 tx=0).stop 2024-04-24T08:25:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.785+0000 7f07bc000640 1 -- 172.21.15.88:0/1744529324 shutdown_connections 2024-04-24T08:25:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.785+0000 7f07bc000640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f07940683b0 0x7f079406a870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.785+0000 7f07bc000640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b40b4c90 0x7f07b4149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.785+0000 7f07bc000640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07b409e7a0 0x7f07b41e03d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.785+0000 7f07bc000640 1 --2- 172.21.15.88:0/1744529324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b406e490 0x7f07b40b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.785+0000 7f07bc000640 1 -- 172.21.15.88:0/1744529324 >> 172.21.15.88:0/1744529324 conn(0x7f07b40b9690 msgr2=0x7f07b409aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.785+0000 7f07bc000640 1 -- 172.21.15.88:0/1744529324 shutdown_connections 2024-04-24T08:25:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.785+0000 7f07bc000640 1 -- 172.21.15.88:0/1744529324 wait complete. 2024-04-24T08:25:46.806 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T08:25:46.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.941+0000 7fd631000640 1 Processor -- start 2024-04-24T08:25:46.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.941+0000 7fd631000640 1 -- start start 2024-04-24T08:25:46.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd631000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd62c0b01a0 0x7fd62c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd631000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd62c0ae4e0 0x7fd62c13e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd631000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c0b0580 con 0x7fd62c0737c0 2024-04-24T08:25:46.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd631000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd62c0b59d0 con 0x7fd62c0ae4e0 2024-04-24T08:25:46.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd631000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c0ae970 con 0x7fd62c0b01a0 2024-04-24T08:25:46.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd621400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd62c0ae4e0 0x7fd62c13e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd621400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd62c0ae4e0 0x7fd62c13e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49912/0 (socket says 172.21.15.88:49912) 2024-04-24T08:25:46.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd621400640 1 -- 172.21.15.88:0/2806014373 learned_addr learned my addr 172.21.15.88:0/2806014373 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:46.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd629e00640 1 --2- 172.21.15.88:0/2806014373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd62c0b01a0 0x7fd62c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd621400640 1 -- 172.21.15.88:0/2806014373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd62c0b01a0 msgr2=0x7fd62c06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:46.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd621400640 1 --2- 172.21.15.88:0/2806014373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd62c0b01a0 0x7fd62c06d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd621400640 1 -- 172.21.15.88:0/2806014373 >> v1:172.21.15.142:6789/0 conn(0x7fd62c0737c0 legacy=0x7fd62c148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.945+0000 7fd621400640 1 -- 172.21.15.88:0/2806014373 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c0b53a0 con 0x7fd62c0ae4e0 2024-04-24T08:25:46.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd621400640 1 --2- 172.21.15.88:0/2806014373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd62c0ae4e0 0x7fd62c13e980 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd614009870 tx=0x7fd61401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1500028b1388ede server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:46.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd629400640 1 -- 172.21.15.88:0/2806014373 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6140b0070 con 0x7fd62c0ae4e0 2024-04-24T08:25:46.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd629400640 1 -- 172.21.15.88:0/2806014373 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6140ab600 con 0x7fd62c0ae4e0 2024-04-24T08:25:46.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd629400640 1 -- 172.21.15.88:0/2806014373 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6140ab9d0 con 0x7fd62c0ae4e0 2024-04-24T08:25:46.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 -- 172.21.15.88:0/2806014373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd62c0ae4e0 msgr2=0x7fd62c13e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 --2- 172.21.15.88:0/2806014373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd62c0ae4e0 0x7fd62c13e980 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd614009870 tx=0x7fd61401c440 comp rx=0 tx=0).stop 2024-04-24T08:25:46.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 -- 172.21.15.88:0/2806014373 shutdown_connections 2024-04-24T08:25:46.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 --2- 172.21.15.88:0/2806014373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd62c0ae4e0 0x7fd62c13e980 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 --2- 172.21.15.88:0/2806014373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd62c0b01a0 0x7fd62c06d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 -- 172.21.15.88:0/2806014373 >> 172.21.15.88:0/2806014373 conn(0x7fd62c0b9690 msgr2=0x7fd62c0b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:46.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 -- 172.21.15.88:0/2806014373 shutdown_connections 2024-04-24T08:25:46.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 -- 172.21.15.88:0/2806014373 wait complete. 2024-04-24T08:25:46.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 Processor -- start 2024-04-24T08:25:46.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 -- start start 2024-04-24T08:25:46.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd62c0737c0 0x7fd62c0709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd62c0b01a0 0x7fd62c152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd62c072ee0 0x7fd62c1e0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c06e3e0 con 0x7fd62c0737c0 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c06e260 con 0x7fd62c072ee0 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd631000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c150440 con 0x7fd62c0b01a0 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd629e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd62c0737c0 0x7fd62c0709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd629e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd62c0737c0 0x7fd62c0709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49914/0 (socket says 172.21.15.88:49914) 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd629e00640 1 -- 172.21.15.88:0/226177042 learned_addr learned my addr 172.21.15.88:0/226177042 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd621400640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd62c0b01a0 0x7fd62c152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.949+0000 7fd62a800640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd62c072ee0 0x7fd62c1e0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd629e00640 1 -- 172.21.15.88:0/226177042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd62c0b01a0 msgr2=0x7fd62c152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd629e00640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd62c0b01a0 0x7fd62c152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd629e00640 1 -- 172.21.15.88:0/226177042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd62c072ee0 msgr2=0x7fd62c1e0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd629e00640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd62c072ee0 0x7fd62c1e0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd629e00640 1 -- 172.21.15.88:0/226177042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c073380 con 0x7fd62c0737c0 2024-04-24T08:25:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd629e00640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd62c0737c0 0x7fd62c0709f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd61c007e60 tx=0x7fd61c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd622a00640 1 -- 172.21.15.88:0/226177042 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61c014620 con 0x7fd62c0737c0 2024-04-24T08:25:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd622a00640 1 -- 172.21.15.88:0/226177042 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd61c019070 con 0x7fd62c0737c0 2024-04-24T08:25:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd622a00640 1 -- 172.21.15.88:0/226177042 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61c014a20 con 0x7fd62c0737c0 2024-04-24T08:25:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd631000640 1 -- 172.21.15.88:0/226177042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62c071d40 con 0x7fd62c0737c0 2024-04-24T08:25:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd631000640 1 -- 172.21.15.88:0/226177042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62c0729c0 con 0x7fd62c0737c0 2024-04-24T08:25:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd631000640 1 -- 172.21.15.88:0/226177042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62c068c00 con 0x7fd62c0737c0 2024-04-24T08:25:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd622a00640 1 -- 172.21.15.88:0/226177042 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd61c014bc0 con 0x7fd62c0737c0 2024-04-24T08:25:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd622a00640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd608068380 0x7fd60806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd622a00640 1 -- 172.21.15.88:0/226177042 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd61c0873e0 con 0x7fd62c0737c0 2024-04-24T08:25:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.953+0000 7fd621400640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd608068380 0x7fd60806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:46.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.957+0000 7fd621400640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd608068380 0x7fd60806a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd6140ad000 tx=0x7fd614008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:46.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:46.961+0000 7fd622a00640 1 -- 172.21.15.88:0/226177042 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd62c073380 con 0x7fd62c0737c0 2024-04-24T08:25:47.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.117+0000 7fd631000640 1 -- 172.21.15.88:0/226177042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd62c072b90 con 0x7fd62c0737c0 2024-04-24T08:25:47.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.117+0000 7fd622a00640 1 -- 172.21.15.88:0/226177042 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fd61c057870 con 0x7fd62c0737c0 2024-04-24T08:25:47.120 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-24T08:25:47.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.121+0000 7fd631000640 1 -- 172.21.15.88:0/226177042 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd608068380 msgr2=0x7fd60806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.121+0000 7fd631000640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd608068380 0x7fd60806a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd6140ad000 tx=0x7fd614008040 comp rx=0 tx=0).stop 2024-04-24T08:25:47.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.121+0000 7fd631000640 1 -- 172.21.15.88:0/226177042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd62c0737c0 msgr2=0x7fd62c0709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.121+0000 7fd631000640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd62c0737c0 0x7fd62c0709f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd61c007e60 tx=0x7fd61c00e4b0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.121+0000 7fd631000640 1 -- 172.21.15.88:0/226177042 shutdown_connections 2024-04-24T08:25:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.121+0000 7fd631000640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd608068380 0x7fd60806a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.121+0000 7fd631000640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd62c072ee0 0x7fd62c1e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.121+0000 7fd631000640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd62c0b01a0 0x7fd62c152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.121+0000 7fd631000640 1 --2- 172.21.15.88:0/226177042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd62c0737c0 0x7fd62c0709f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.121+0000 7fd631000640 1 -- 172.21.15.88:0/226177042 >> 172.21.15.88:0/226177042 conn(0x7fd62c0b9690 msgr2=0x7fd62c13de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.121+0000 7fd631000640 1 -- 172.21.15.88:0/226177042 shutdown_connections 2024-04-24T08:25:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.121+0000 7fd631000640 1 -- 172.21.15.88:0/226177042 wait complete. 2024-04-24T08:25:47.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.273+0000 7f72df000640 1 Processor -- start 2024-04-24T08:25:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.273+0000 7f72df000640 1 -- start start 2024-04-24T08:25:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.273+0000 7f72df000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d809be30 0x7f72d8145f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.273+0000 7f72df000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d80ba170 con 0x7f72d80b9d90 2024-04-24T08:25:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.273+0000 7f72df000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d814a060 con 0x7f72d806d920 2024-04-24T08:25:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.273+0000 7f72df000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f72d809cd30 con 0x7f72d809be30 2024-04-24T08:25:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.273+0000 7f72d7e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f72d80b9d90 0x7f72d806d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39542/0 (socket says 172.21.15.88:39542) 2024-04-24T08:25:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.273+0000 7f72d7e00640 1 -- 172.21.15.88:0/3550518008 learned_addr learned my addr 172.21.15.88:0/3550518008 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72cf400640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d809be30 0x7f72d8145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651439759 0 0) 0x7f72d80ba170 con 0x7f72d80b9d90 2024-04-24T08:25:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72bc003530 con 0x7f72d80b9d90 2024-04-24T08:25:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2525567703 0 0) 0x7f72bc003530 con 0x7f72d80b9d90 2024-04-24T08:25:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d809be30 msgr2=0x7f72d8145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d809be30 0x7f72d8145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 >> v1:172.21.15.142:6789/0 conn(0x7f72d806d920 legacy=0x7f72d81504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d8149860 con 0x7f72d80b9d90 2024-04-24T08:25:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f72c8001680 con 0x7f72d80b9d90 2024-04-24T08:25:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 >> v1:172.21.15.88:6789/0 conn(0x7f72d80b9d90 legacy=0x7f72d806d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d809be30 0x7f72bc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72bc003f70 0x7f72bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72bc004d50 0x7f72bc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f72d809cd30 con 0x7f72bc003f70 2024-04-24T08:25:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc00bc10 con 0x7f72bc004d50 2024-04-24T08:25:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f72bc00be10 con 0x7f72d809be30 2024-04-24T08:25:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72cf400640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72bc003f70 0x7f72bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72d7e00640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d809be30 0x7f72bc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72dd000640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72bc004d50 0x7f72bc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72cf400640 1 -- 172.21.15.88:0/3550518008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d809be30 msgr2=0x7f72bc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72cf400640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d809be30 0x7f72bc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72cf400640 1 -- 172.21.15.88:0/3550518008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72bc004d50 msgr2=0x7f72bc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72cf400640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72bc004d50 0x7f72bc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72cf400640 1 -- 172.21.15.88:0/3550518008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72bc003530 con 0x7f72bc003f70 2024-04-24T08:25:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.277+0000 7f72dd000640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72bc004d50 0x7f72bc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72cf400640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72bc003f70 0x7f72bc004810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009fc0 tx=0x7f72c001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a1ce38574cdeb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c00b2070 con 0x7f72bc003f70 2024-04-24T08:25:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c00a5b40 con 0x7f72bc003f70 2024-04-24T08:25:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72d7400640 1 -- 172.21.15.88:0/3550518008 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0009c10 con 0x7f72bc003f70 2024-04-24T08:25:47.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 -- 172.21.15.88:0/3550518008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72bc003f70 msgr2=0x7f72bc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 --2- 172.21.15.88:0/3550518008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72bc003f70 0x7f72bc004810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009fc0 tx=0x7f72c001cc80 comp rx=0 tx=0).stop 2024-04-24T08:25:47.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72dd000640 1 -- 172.21.15.88:0/3550518008 reap_dead start 2024-04-24T08:25:47.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 -- 172.21.15.88:0/3550518008 shutdown_connections 2024-04-24T08:25:47.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 -- 172.21.15.88:0/3550518008 >> 172.21.15.88:0/3550518008 conn(0x7f72d806c0d0 msgr2=0x7f72d80b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:47.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 -- 172.21.15.88:0/3550518008 shutdown_connections 2024-04-24T08:25:47.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 -- 172.21.15.88:0/3550518008 wait complete. 2024-04-24T08:25:47.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 Processor -- start 2024-04-24T08:25:47.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 -- start start 2024-04-24T08:25:47.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72bc003f70 0x7f72d80b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d81dec70 0x7f72d81df0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d8141ee0 0x7f72d8142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f72d80b3fa0 con 0x7f72d81dec70 2024-04-24T08:25:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f72d80b3e20 con 0x7f72bc003f70 2024-04-24T08:25:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72df000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f72d8152410 con 0x7f72d8141ee0 2024-04-24T08:25:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72cf400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d81dec70 0x7f72d81df0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72cf400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d81dec70 0x7f72d81df0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49922/0 (socket says 172.21.15.88:49922) 2024-04-24T08:25:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72cf400640 1 -- 172.21.15.88:0/2276392226 learned_addr learned my addr 172.21.15.88:0/2276392226 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72d7e00640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72bc003f70 0x7f72d80b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72dd000640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d8141ee0 0x7f72d8142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72cf400640 1 -- 172.21.15.88:0/2276392226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d8141ee0 msgr2=0x7f72d8142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72cf400640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d8141ee0 0x7f72d8142360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72cf400640 1 -- 172.21.15.88:0/2276392226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72bc003f70 msgr2=0x7f72d80b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72cf400640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72bc003f70 0x7f72d80b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72cf400640 1 -- 172.21.15.88:0/2276392226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d81df630 con 0x7f72d81dec70 2024-04-24T08:25:47.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72d7e00640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72bc003f70 0x7f72d80b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:47.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.281+0000 7f72dd000640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d8141ee0 0x7f72d8142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:47.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.285+0000 7f72cf400640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d81dec70 0x7f72d81df0f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f72c0098660 tx=0x7f72c0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:47.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.285+0000 7f72d4c00640 1 -- 172.21.15.88:0/2276392226 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c00ba070 con 0x7f72d81dec70 2024-04-24T08:25:47.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.285+0000 7f72d4c00640 1 -- 172.21.15.88:0/2276392226 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c00ad9c0 con 0x7f72d81dec70 2024-04-24T08:25:47.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.285+0000 7f72d4c00640 1 -- 172.21.15.88:0/2276392226 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c00b2040 con 0x7f72d81dec70 2024-04-24T08:25:47.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.285+0000 7f72df000640 1 -- 172.21.15.88:0/2276392226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d80b18f0 con 0x7f72d81dec70 2024-04-24T08:25:47.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.285+0000 7f72df000640 1 -- 172.21.15.88:0/2276392226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d80b2ef0 con 0x7f72d81dec70 2024-04-24T08:25:47.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.285+0000 7f72df000640 1 -- 172.21.15.88:0/2276392226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d80b2d00 con 0x7f72d81dec70 2024-04-24T08:25:47.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.285+0000 7f72d4c00640 1 -- 172.21.15.88:0/2276392226 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72c00b6410 con 0x7f72d81dec70 2024-04-24T08:25:47.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.285+0000 7f72d4c00640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72b4068380 0x7f72b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.285+0000 7f72d4c00640 1 -- 172.21.15.88:0/2276392226 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f72c0121130 con 0x7f72d81dec70 2024-04-24T08:25:47.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.285+0000 7f72d7e00640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72b4068380 0x7f72b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.285+0000 7f72d7e00640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72b4068380 0x7f72b406a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f72c8001ec0 tx=0x7f72c8001160 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:47.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.289+0000 7f72d4c00640 1 -- 172.21.15.88:0/2276392226 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f72d81df630 con 0x7f72d81dec70 2024-04-24T08:25:47.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.449+0000 7f72df000640 1 -- 172.21.15.88:0/2276392226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72d8068b90 con 0x7f72d81dec70 2024-04-24T08:25:47.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.449+0000 7f72d4c00640 1 -- 172.21.15.88:0/2276392226 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f72c0016990 con 0x7f72d81dec70 2024-04-24T08:25:47.453 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:47.453 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:47.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.453+0000 7f72df000640 1 -- 172.21.15.88:0/2276392226 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72b4068380 msgr2=0x7f72b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.453+0000 7f72df000640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72b4068380 0x7f72b406a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f72c8001ec0 tx=0x7f72c8001160 comp rx=0 tx=0).stop 2024-04-24T08:25:47.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.453+0000 7f72df000640 1 -- 172.21.15.88:0/2276392226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d81dec70 msgr2=0x7f72d81df0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.453+0000 7f72df000640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d81dec70 0x7f72d81df0f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f72c0098660 tx=0x7f72c0009750 comp rx=0 tx=0).stop 2024-04-24T08:25:47.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.453+0000 7f72df000640 1 -- 172.21.15.88:0/2276392226 shutdown_connections 2024-04-24T08:25:47.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.453+0000 7f72df000640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72b4068380 0x7f72b406a840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.453+0000 7f72df000640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72d8141ee0 0x7f72d8142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.453+0000 7f72df000640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d81dec70 0x7f72d81df0f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.453+0000 7f72df000640 1 --2- 172.21.15.88:0/2276392226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72bc003f70 0x7f72d80b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.453+0000 7f72df000640 1 -- 172.21.15.88:0/2276392226 >> 172.21.15.88:0/2276392226 conn(0x7f72d806c0d0 msgr2=0x7f72d809d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.453+0000 7f72df000640 1 -- 172.21.15.88:0/2276392226 shutdown_connections 2024-04-24T08:25:47.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.453+0000 7f72df000640 1 -- 172.21.15.88:0/2276392226 wait complete. 2024-04-24T08:25:47.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T08:25:25.116395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T08:25:26.444475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:25:47.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:25:47.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f336b000640 1 Processor -- start 2024-04-24T08:25:47.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f336b000640 1 -- start start 2024-04-24T08:25:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f336b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f336406d500 0x7f33640aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f336b000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f336409b160 0x7f3364156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f336b000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33640ae680 con 0x7f33640af330 2024-04-24T08:25:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f336b000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f336406df00 con 0x7f336409b160 2024-04-24T08:25:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f336b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f336406d8e0 con 0x7f336406d500 2024-04-24T08:25:47.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f3363e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f336406d500 0x7f33640aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f3369000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f336409b160 0x7f3364156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f335b400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f33640af330 0x7f336409aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:35738/0 (socket says 172.21.15.88:35738) 2024-04-24T08:25:47.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f3363e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f336406d500 0x7f33640aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:33866/0 (socket says 172.21.15.88:33866) 2024-04-24T08:25:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f335b400640 1 -- 172.21.15.88:0/1970171484 learned_addr learned my addr 172.21.15.88:0/1970171484 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f3363e00640 1 -- 172.21.15.88:0/1970171484 >> v2:172.21.15.142:3300/0 conn(0x7f336409b160 msgr2=0x7f3364156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f3363e00640 1 --2- 172.21.15.88:0/1970171484 >> v2:172.21.15.142:3300/0 conn(0x7f336409b160 0x7f3364156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f3363e00640 1 -- 172.21.15.88:0/1970171484 >> v1:172.21.15.142:6789/0 conn(0x7f33640af330 legacy=0x7f336409aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f3363e00640 1 -- 172.21.15.88:0/1970171484 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33640ae960 con 0x7f336406d500 2024-04-24T08:25:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.613+0000 7f3363400640 1 -- 172.21.15.88:0/1970171484 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682316885 0 0) 0x7f334c001120 con 0x7f33640af330 2024-04-24T08:25:47.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.617+0000 7f3363e00640 1 --2- 172.21.15.88:0/1970171484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f336406d500 0x7f33640aedf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f33540097c0 tx=0x7f335401c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8560b6898b5f749a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:47.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.617+0000 7f3363400640 1 -- 172.21.15.88:0/1970171484 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540b1070 con 0x7f336406d500 2024-04-24T08:25:47.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.617+0000 7f3363400640 1 -- 172.21.15.88:0/1970171484 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33540ac600 con 0x7f336406d500 2024-04-24T08:25:47.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.617+0000 7f3363400640 1 -- 172.21.15.88:0/1970171484 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540ac9d0 con 0x7f336406d500 2024-04-24T08:25:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.617+0000 7f336b000640 1 -- 172.21.15.88:0/1970171484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f336406d500 msgr2=0x7f33640aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.617+0000 7f336b000640 1 --2- 172.21.15.88:0/1970171484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f336406d500 0x7f33640aedf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f33540097c0 tx=0x7f335401c380 comp rx=0 tx=0).stop 2024-04-24T08:25:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.617+0000 7f336b000640 1 -- 172.21.15.88:0/1970171484 shutdown_connections 2024-04-24T08:25:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.617+0000 7f336b000640 1 --2- 172.21.15.88:0/1970171484 >> v2:172.21.15.142:3300/0 conn(0x7f336409b160 0x7f3364156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.617+0000 7f336b000640 1 --2- 172.21.15.88:0/1970171484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f336406d500 0x7f33640aedf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.617+0000 7f336b000640 1 -- 172.21.15.88:0/1970171484 >> 172.21.15.88:0/1970171484 conn(0x7f33640b9690 msgr2=0x7f33640b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.617+0000 7f336b000640 1 -- 172.21.15.88:0/1970171484 shutdown_connections 2024-04-24T08:25:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.617+0000 7f336b000640 1 -- 172.21.15.88:0/1970171484 wait complete. 2024-04-24T08:25:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f336b000640 1 Processor -- start 2024-04-24T08:25:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f336b000640 1 -- start start 2024-04-24T08:25:47.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f336b000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336406d500 0x7f33640b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f336b000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f336409b160 0x7f33640b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f336b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33640af330 0x7f33640b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f336b000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f33640b57b0 con 0x7f336406d500 2024-04-24T08:25:47.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f336b000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f33640b5630 con 0x7f336409b160 2024-04-24T08:25:47.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f336b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f33640b5a30 con 0x7f33640af330 2024-04-24T08:25:47.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3363e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336406d500 0x7f33640b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3369000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33640af330 0x7f33640b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f335b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f336409b160 0x7f33640b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3363e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336406d500 0x7f33640b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49926/0 (socket says 172.21.15.88:49926) 2024-04-24T08:25:47.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3363e00640 1 -- 172.21.15.88:0/2939501917 learned_addr learned my addr 172.21.15.88:0/2939501917 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:47.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3369000640 1 -- 172.21.15.88:0/2939501917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f336409b160 msgr2=0x7f33640b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3369000640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f336409b160 0x7f33640b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3369000640 1 -- 172.21.15.88:0/2939501917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336406d500 msgr2=0x7f33640b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3369000640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336406d500 0x7f33640b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3369000640 1 -- 172.21.15.88:0/2939501917 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33640b1fd0 con 0x7f33640af330 2024-04-24T08:25:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3363e00640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336406d500 0x7f33640b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f335b400640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f336409b160 0x7f33640b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3369000640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33640af330 0x7f33640b31c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f335c00efc0 tx=0x7f335c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3360c00640 1 -- 172.21.15.88:0/2939501917 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c018020 con 0x7f33640af330 2024-04-24T08:25:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3360c00640 1 -- 172.21.15.88:0/2939501917 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f335c014480 con 0x7f33640af330 2024-04-24T08:25:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f3360c00640 1 -- 172.21.15.88:0/2939501917 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c014870 con 0x7f33640af330 2024-04-24T08:25:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f336b000640 1 -- 172.21.15.88:0/2939501917 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336414bd00 con 0x7f33640af330 2024-04-24T08:25:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f336b000640 1 -- 172.21.15.88:0/2939501917 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f33640b2740 con 0x7f33640af330 2024-04-24T08:25:47.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.621+0000 7f336b000640 1 -- 172.21.15.88:0/2939501917 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3364068c00 con 0x7f33640af330 2024-04-24T08:25:47.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.625+0000 7f3360c00640 1 -- 172.21.15.88:0/2939501917 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f335c01b020 con 0x7f33640af330 2024-04-24T08:25:47.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.625+0000 7f3360c00640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3340068380 0x7f334006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.625+0000 7f3360c00640 1 -- 172.21.15.88:0/2939501917 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f335c087b30 con 0x7f33640af330 2024-04-24T08:25:47.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.625+0000 7f3363e00640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3340068380 0x7f334006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.625+0000 7f3363e00640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3340068380 0x7f334006a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f335401c3c0 tx=0x7f33540a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:47.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.629+0000 7f3360c00640 1 -- 172.21.15.88:0/2939501917 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f335c022030 con 0x7f33640af330 2024-04-24T08:25:47.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 -- 172.21.15.88:0/2939501917 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3364156fa0 con 0x7f33640af330 2024-04-24T08:25:47.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f3360c00640 1 -- 172.21.15.88:0/2939501917 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f335c010040 con 0x7f33640af330 2024-04-24T08:25:47.786 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:25:47.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 -- 172.21.15.88:0/2939501917 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3340068380 msgr2=0x7f334006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3340068380 0x7f334006a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f335401c3c0 tx=0x7f33540a7000 comp rx=0 tx=0).stop 2024-04-24T08:25:47.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 -- 172.21.15.88:0/2939501917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33640af330 msgr2=0x7f33640b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33640af330 0x7f33640b31c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f335c00efc0 tx=0x7f335c00c490 comp rx=0 tx=0).stop 2024-04-24T08:25:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 -- 172.21.15.88:0/2939501917 shutdown_connections 2024-04-24T08:25:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3340068380 0x7f334006a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33640af330 0x7f33640b31c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f336409b160 0x7f33640b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 --2- 172.21.15.88:0/2939501917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336406d500 0x7f33640b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 -- 172.21.15.88:0/2939501917 >> 172.21.15.88:0/2939501917 conn(0x7f33640b9690 msgr2=0x7f33640b6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 -- 172.21.15.88:0/2939501917 shutdown_connections 2024-04-24T08:25:47.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.785+0000 7f336b000640 1 -- 172.21.15.88:0/2939501917 wait complete. 2024-04-24T08:25:47.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T08:25:47.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abec00640 1 Processor -- start 2024-04-24T08:25:47.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abec00640 1 -- start start 2024-04-24T08:25:47.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abec00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ab80b01a0 0x7f2ab806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abec00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ab813f090 0x7f2ab814f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abec00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab80b0580 con 0x7f2ab80ae4e0 2024-04-24T08:25:47.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abec00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2ab80b59d0 con 0x7f2ab813f090 2024-04-24T08:25:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abec00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab80ae970 con 0x7f2ab80b01a0 2024-04-24T08:25:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abcc00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ab813f090 0x7f2ab814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abcc00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ab813f090 0x7f2ab814f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59070/0 (socket says 172.21.15.88:59070) 2024-04-24T08:25:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abcc00640 1 -- 172.21.15.88:0/2069938702 learned_addr learned my addr 172.21.15.88:0/2069938702 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2ab7e00640 1 --2- 172.21.15.88:0/2069938702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ab80b01a0 0x7f2ab806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abcc00640 1 -- 172.21.15.88:0/2069938702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ab80b01a0 msgr2=0x7f2ab806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abcc00640 1 --2- 172.21.15.88:0/2069938702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ab80b01a0 0x7f2ab806d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abcc00640 1 -- 172.21.15.88:0/2069938702 >> v1:172.21.15.142:6789/0 conn(0x7f2ab80ae4e0 legacy=0x7f2ab813e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.949+0000 7f2abcc00640 1 -- 172.21.15.88:0/2069938702 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab80b53a0 con 0x7f2ab813f090 2024-04-24T08:25:47.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2abcc00640 1 --2- 172.21.15.88:0/2069938702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab813f090 0x7f2ab814f430 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009870 tx=0x7f2ab001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54f041e77f62732 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:47.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2ab6a00640 1 -- 172.21.15.88:0/2069938702 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00b0070 con 0x7f2ab813f090 2024-04-24T08:25:47.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2ab6a00640 1 -- 172.21.15.88:0/2069938702 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab0004230 con 0x7f2ab813f090 2024-04-24T08:25:47.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2ab6a00640 1 -- 172.21.15.88:0/2069938702 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0003620 con 0x7f2ab813f090 2024-04-24T08:25:47.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2abec00640 1 -- 172.21.15.88:0/2069938702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab813f090 msgr2=0x7f2ab814f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2abec00640 1 --2- 172.21.15.88:0/2069938702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab813f090 0x7f2ab814f430 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009870 tx=0x7f2ab001c440 comp rx=0 tx=0).stop 2024-04-24T08:25:47.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2abec00640 1 -- 172.21.15.88:0/2069938702 shutdown_connections 2024-04-24T08:25:47.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2abec00640 1 --2- 172.21.15.88:0/2069938702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab813f090 0x7f2ab814f430 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2abec00640 1 --2- 172.21.15.88:0/2069938702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ab80b01a0 0x7f2ab806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2abec00640 1 -- 172.21.15.88:0/2069938702 >> 172.21.15.88:0/2069938702 conn(0x7f2ab80b9690 msgr2=0x7f2ab80b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2abec00640 1 -- 172.21.15.88:0/2069938702 shutdown_connections 2024-04-24T08:25:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2abec00640 1 -- 172.21.15.88:0/2069938702 wait complete. 2024-04-24T08:25:47.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.953+0000 7f2abec00640 1 Processor -- start 2024-04-24T08:25:47.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2abec00640 1 -- start start 2024-04-24T08:25:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2abec00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab80b01a0 0x7f2ab8072910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2abec00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ab813f090 0x7f2ab8143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2abec00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ab8143760 0x7f2ab81e3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2abec00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab8152190 con 0x7f2ab80b01a0 2024-04-24T08:25:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2abec00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab806e470 con 0x7f2ab813f090 2024-04-24T08:25:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2abec00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab8152310 con 0x7f2ab8143760 2024-04-24T08:25:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2ab7e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab80b01a0 0x7f2ab8072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2ab7e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab80b01a0 0x7f2ab8072910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59080/0 (socket says 172.21.15.88:59080) 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2ab7e00640 1 -- 172.21.15.88:0/3348875375 learned_addr learned my addr 172.21.15.88:0/3348875375 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2ab7400640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ab813f090 0x7f2ab8143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2abcc00640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ab8143760 0x7f2ab81e3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2ab7e00640 1 -- 172.21.15.88:0/3348875375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ab8143760 msgr2=0x7f2ab81e3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2ab7e00640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ab8143760 0x7f2ab81e3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2ab7e00640 1 -- 172.21.15.88:0/3348875375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ab813f090 msgr2=0x7f2ab8143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2ab7e00640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ab813f090 0x7f2ab8143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2ab7e00640 1 -- 172.21.15.88:0/3348875375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab809e310 con 0x7f2ab80b01a0 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2ab7e00640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab80b01a0 0x7f2ab8072910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8007ef0 tx=0x7f2aa800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2aafe00640 1 -- 172.21.15.88:0/3348875375 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8014620 con 0x7f2ab80b01a0 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2aafe00640 1 -- 172.21.15.88:0/3348875375 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa8019070 con 0x7f2ab80b01a0 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2aafe00640 1 -- 172.21.15.88:0/3348875375 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8014a00 con 0x7f2ab80b01a0 2024-04-24T08:25:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2abec00640 1 -- 172.21.15.88:0/3348875375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab8142a00 con 0x7f2ab80b01a0 2024-04-24T08:25:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2abec00640 1 -- 172.21.15.88:0/3348875375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab8145100 con 0x7f2ab80b01a0 2024-04-24T08:25:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.957+0000 7f2abec00640 1 -- 172.21.15.88:0/3348875375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab8068c00 con 0x7f2ab80b01a0 2024-04-24T08:25:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.961+0000 7f2aafe00640 1 -- 172.21.15.88:0/3348875375 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2aa8014ba0 con 0x7f2ab80b01a0 2024-04-24T08:25:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.961+0000 7f2aafe00640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2a98068380 0x7f2a9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.961+0000 7f2aafe00640 1 -- 172.21.15.88:0/3348875375 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2aa80871d0 con 0x7f2ab80b01a0 2024-04-24T08:25:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.961+0000 7f2ab7400640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2a98068380 0x7f2a9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.961+0000 7f2ab7400640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2a98068380 0x7f2a9806a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2ab81e16e0 tx=0x7f2aa4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:47.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:47.965+0000 7f2aafe00640 1 -- 172.21.15.88:0/3348875375 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2aa8057130 con 0x7f2ab80b01a0 2024-04-24T08:25:48.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.121+0000 7f2abec00640 1 -- 172.21.15.88:0/3348875375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2ab809df30 con 0x7f2ab80b01a0 2024-04-24T08:25:48.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2aafe00640 1 -- 172.21.15.88:0/3348875375 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f2aa805b430 con 0x7f2ab80b01a0 2024-04-24T08:25:48.125 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-24T08:25:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2abec00640 1 -- 172.21.15.88:0/3348875375 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2a98068380 msgr2=0x7f2a9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2abec00640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2a98068380 0x7f2a9806a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2ab81e16e0 tx=0x7f2aa4009040 comp rx=0 tx=0).stop 2024-04-24T08:25:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2abec00640 1 -- 172.21.15.88:0/3348875375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab80b01a0 msgr2=0x7f2ab8072910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2abec00640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab80b01a0 0x7f2ab8072910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8007ef0 tx=0x7f2aa800e4b0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2abec00640 1 -- 172.21.15.88:0/3348875375 shutdown_connections 2024-04-24T08:25:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2abec00640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2a98068380 0x7f2a9806a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2abec00640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ab8143760 0x7f2ab81e3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2abec00640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ab813f090 0x7f2ab8143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2abec00640 1 --2- 172.21.15.88:0/3348875375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab80b01a0 0x7f2ab8072910 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2abec00640 1 -- 172.21.15.88:0/3348875375 >> 172.21.15.88:0/3348875375 conn(0x7f2ab80b9690 msgr2=0x7f2ab809aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2abec00640 1 -- 172.21.15.88:0/3348875375 shutdown_connections 2024-04-24T08:25:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.125+0000 7f2abec00640 1 -- 172.21.15.88:0/3348875375 wait complete. 2024-04-24T08:25:48.146 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T08:25:48.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.281+0000 7fc473600640 1 Processor -- start 2024-04-24T08:25:48.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.281+0000 7fc473600640 1 -- start start 2024-04-24T08:25:48.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.281+0000 7fc473600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc46c0b01a0 0x7fc46c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.281+0000 7fc473600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46c0b0580 con 0x7fc46c0ae4e0 2024-04-24T08:25:48.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.281+0000 7fc473600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46c0b59d0 con 0x7fc46c13f090 2024-04-24T08:25:48.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.281+0000 7fc473600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc46c0ae970 con 0x7fc46c0b01a0 2024-04-24T08:25:48.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.281+0000 7fc463e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc46c0ae4e0 0x7fc46c13e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50208/0 (socket says 172.21.15.88:50208) 2024-04-24T08:25:48.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.281+0000 7fc463e00640 1 -- 172.21.15.88:0/416844419 learned_addr learned my addr 172.21.15.88:0/416844419 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:48.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.285+0000 7fc470c00640 1 --2- 172.21.15.88:0/416844419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc46c0b01a0 0x7fc46c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.285+0000 7fc46be00640 1 -- 172.21.15.88:0/416844419 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2320194244 0 0) 0x7fc46c0b0580 con 0x7fc46c0ae4e0 2024-04-24T08:25:48.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.285+0000 7fc46be00640 1 -- 172.21.15.88:0/416844419 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc450003530 con 0x7fc46c0ae4e0 2024-04-24T08:25:48.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.285+0000 7fc46be00640 1 -- 172.21.15.88:0/416844419 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3497548928 0 0) 0x7fc46c0b59d0 con 0x7fc46c13f090 2024-04-24T08:25:48.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.285+0000 7fc46be00640 1 -- 172.21.15.88:0/416844419 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc46c0b0580 con 0x7fc46c13f090 2024-04-24T08:25:48.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.285+0000 7fc470c00640 1 -- 172.21.15.88:0/416844419 >> v1:172.21.15.142:6789/0 conn(0x7fc46c13f090 legacy=0x7fc46c14f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.285+0000 7fc470c00640 1 -- 172.21.15.88:0/416844419 >> v1:172.21.15.88:6789/0 conn(0x7fc46c0ae4e0 legacy=0x7fc46c13e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.285+0000 7fc470c00640 1 -- 172.21.15.88:0/416844419 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46c0b53a0 con 0x7fc46c0b01a0 2024-04-24T08:25:48.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.285+0000 7fc470c00640 1 --2- 172.21.15.88:0/416844419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc46c0b01a0 0x7fc46c06d2a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0097f0 tx=0x7fc45c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f16b02818b50d58 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:48.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.285+0000 7fc46be00640 1 -- 172.21.15.88:0/416844419 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c0b0070 con 0x7fc46c0b01a0 2024-04-24T08:25:48.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.285+0000 7fc46be00640 1 -- 172.21.15.88:0/416844419 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc45c0ab600 con 0x7fc46c0b01a0 2024-04-24T08:25:48.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.285+0000 7fc46be00640 1 -- 172.21.15.88:0/416844419 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c0ab9d0 con 0x7fc46c0b01a0 2024-04-24T08:25:48.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 -- 172.21.15.88:0/416844419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc46c0b01a0 msgr2=0x7fc46c06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 --2- 172.21.15.88:0/416844419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc46c0b01a0 0x7fc46c06d2a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0097f0 tx=0x7fc45c01c3c0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 -- 172.21.15.88:0/416844419 shutdown_connections 2024-04-24T08:25:48.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 --2- 172.21.15.88:0/416844419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc46c0b01a0 0x7fc46c06d2a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 -- 172.21.15.88:0/416844419 >> 172.21.15.88:0/416844419 conn(0x7fc46c0b9690 msgr2=0x7fc46c0b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:48.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 -- 172.21.15.88:0/416844419 shutdown_connections 2024-04-24T08:25:48.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 -- 172.21.15.88:0/416844419 wait complete. 2024-04-24T08:25:48.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 Processor -- start 2024-04-24T08:25:48.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 -- start start 2024-04-24T08:25:48.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc46c0b01a0 0x7fc46c138800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc46c13f090 0x7fc46c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc46c0b86d0 0x7fc46c133b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c153780 con 0x7fc46c13f090 2024-04-24T08:25:48.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c06e470 con 0x7fc46c0b86d0 2024-04-24T08:25:48.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc473600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc46c153900 con 0x7fc46c0b01a0 2024-04-24T08:25:48.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc463e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc46c13f090 0x7fc46c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc463e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc46c13f090 0x7fc46c0b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59092/0 (socket says 172.21.15.88:59092) 2024-04-24T08:25:48.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc463e00640 1 -- 172.21.15.88:0/1601313749 learned_addr learned my addr 172.21.15.88:0/1601313749 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:48.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc470c00640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc46c0b01a0 0x7fc46c138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc471600640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc46c0b86d0 0x7fc46c133b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc463e00640 1 -- 172.21.15.88:0/1601313749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc46c0b01a0 msgr2=0x7fc46c138800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc463e00640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc46c0b01a0 0x7fc46c138800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc463e00640 1 -- 172.21.15.88:0/1601313749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc46c0b86d0 msgr2=0x7fc46c133b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc463e00640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc46c0b86d0 0x7fc46c133b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc463e00640 1 -- 172.21.15.88:0/1601313749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46c13a910 con 0x7fc46c13f090 2024-04-24T08:25:48.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.289+0000 7fc463e00640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc46c13f090 0x7fc46c0b8190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc45400c4d0 tx=0x7fc45400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:48.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.293+0000 7fc469600640 1 -- 172.21.15.88:0/1601313749 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454017070 con 0x7fc46c13f090 2024-04-24T08:25:48.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.293+0000 7fc469600640 1 -- 172.21.15.88:0/1601313749 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc454005cf0 con 0x7fc46c13f090 2024-04-24T08:25:48.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.293+0000 7fc469600640 1 -- 172.21.15.88:0/1601313749 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454007290 con 0x7fc46c13f090 2024-04-24T08:25:48.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.293+0000 7fc473600640 1 -- 172.21.15.88:0/1601313749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc46c13ae60 con 0x7fc46c13f090 2024-04-24T08:25:48.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.293+0000 7fc473600640 1 -- 172.21.15.88:0/1601313749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc46c13bff0 con 0x7fc46c13f090 2024-04-24T08:25:48.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.293+0000 7fc473600640 1 -- 172.21.15.88:0/1601313749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc46c068c00 con 0x7fc46c13f090 2024-04-24T08:25:48.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.293+0000 7fc469600640 1 -- 172.21.15.88:0/1601313749 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc45401a070 con 0x7fc46c13f090 2024-04-24T08:25:48.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.293+0000 7fc469600640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc448068380 0x7fc44806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.293+0000 7fc469600640 1 -- 172.21.15.88:0/1601313749 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc454085d10 con 0x7fc46c13f090 2024-04-24T08:25:48.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.293+0000 7fc470c00640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc448068380 0x7fc44806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.293+0000 7fc470c00640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc448068380 0x7fc44806a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0ad000 tx=0x7fc45c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:48.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.297+0000 7fc469600640 1 -- 172.21.15.88:0/1601313749 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc45408b020 con 0x7fc46c13f090 2024-04-24T08:25:48.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.453+0000 7fc473600640 1 -- 172.21.15.88:0/1601313749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc46c0b8ae0 con 0x7fc46c13f090 2024-04-24T08:25:48.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.453+0000 7fc469600640 1 -- 172.21.15.88:0/1601313749 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fc454055c70 con 0x7fc46c13f090 2024-04-24T08:25:48.455 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-24T08:25:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.453+0000 7fc473600640 1 -- 172.21.15.88:0/1601313749 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc448068380 msgr2=0x7fc44806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.453+0000 7fc473600640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc448068380 0x7fc44806a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0ad000 tx=0x7fc45c0a6000 comp rx=0 tx=0).stop 2024-04-24T08:25:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.453+0000 7fc473600640 1 -- 172.21.15.88:0/1601313749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc46c13f090 msgr2=0x7fc46c0b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.453+0000 7fc473600640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc46c13f090 0x7fc46c0b8190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc45400c4d0 tx=0x7fc45400c990 comp rx=0 tx=0).stop 2024-04-24T08:25:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.453+0000 7fc473600640 1 -- 172.21.15.88:0/1601313749 shutdown_connections 2024-04-24T08:25:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.453+0000 7fc473600640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc448068380 0x7fc44806a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.453+0000 7fc473600640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc46c0b86d0 0x7fc46c133b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.453+0000 7fc473600640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc46c13f090 0x7fc46c0b8190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.453+0000 7fc473600640 1 --2- 172.21.15.88:0/1601313749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc46c0b01a0 0x7fc46c138800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.457+0000 7fc473600640 1 -- 172.21.15.88:0/1601313749 >> 172.21.15.88:0/1601313749 conn(0x7fc46c0b9690 msgr2=0x7fc46c0b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.457+0000 7fc473600640 1 -- 172.21.15.88:0/1601313749 shutdown_connections 2024-04-24T08:25:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.457+0000 7fc473600640 1 -- 172.21.15.88:0/1601313749 wait complete. 2024-04-24T08:25:48.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.609+0000 7f2d9d000640 1 Processor -- start 2024-04-24T08:25:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.609+0000 7f2d9d000640 1 -- start start 2024-04-24T08:25:48.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.609+0000 7f2d9d000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2d98067a70 0x7f2d980b5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d9d000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2d98148240 0x7f2d98152650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d9d000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d98067e50 con 0x7f2d98147db0 2024-04-24T08:25:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d9d000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2d980af500 con 0x7f2d98067a70 2024-04-24T08:25:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d9d000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2d980b54b0 con 0x7f2d98148240 2024-04-24T08:25:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d95e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2d98067a70 0x7f2d980b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d95e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2d98067a70 0x7f2d980b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59100/0 (socket says 172.21.15.88:59100) 2024-04-24T08:25:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d95e00640 1 -- 172.21.15.88:0/2935258422 learned_addr learned my addr 172.21.15.88:0/2935258422 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d96800640 1 --2- 172.21.15.88:0/2935258422 >> v2:172.21.15.142:3300/0 conn(0x7f2d98148240 0x7f2d98152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d95e00640 1 -- 172.21.15.88:0/2935258422 >> v2:172.21.15.142:3300/0 conn(0x7f2d98148240 msgr2=0x7f2d98152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d95e00640 1 --2- 172.21.15.88:0/2935258422 >> v2:172.21.15.142:3300/0 conn(0x7f2d98148240 0x7f2d98152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d95e00640 1 -- 172.21.15.88:0/2935258422 >> v1:172.21.15.142:6789/0 conn(0x7f2d98147db0 legacy=0x7f2d98144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d95e00640 1 -- 172.21.15.88:0/2935258422 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d980b5ee0 con 0x7f2d98067a70 2024-04-24T08:25:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d95e00640 1 --2- 172.21.15.88:0/2935258422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98067a70 0x7f2d980b5900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2d980b7ba0 tx=0x7f2d8801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6baf103135e577dd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d95400640 1 -- 172.21.15.88:0/2935258422 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d880b0070 con 0x7f2d98067a70 2024-04-24T08:25:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d95400640 1 -- 172.21.15.88:0/2935258422 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d880ab600 con 0x7f2d98067a70 2024-04-24T08:25:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.613+0000 7f2d95400640 1 -- 172.21.15.88:0/2935258422 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d880ab9d0 con 0x7f2d98067a70 2024-04-24T08:25:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 -- 172.21.15.88:0/2935258422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98067a70 msgr2=0x7f2d980b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 --2- 172.21.15.88:0/2935258422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98067a70 0x7f2d980b5900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2d980b7ba0 tx=0x7f2d8801c490 comp rx=0 tx=0).stop 2024-04-24T08:25:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 -- 172.21.15.88:0/2935258422 shutdown_connections 2024-04-24T08:25:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 --2- 172.21.15.88:0/2935258422 >> v2:172.21.15.142:3300/0 conn(0x7f2d98148240 0x7f2d98152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 --2- 172.21.15.88:0/2935258422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98067a70 0x7f2d980b5900 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 -- 172.21.15.88:0/2935258422 >> 172.21.15.88:0/2935258422 conn(0x7f2d9806c380 msgr2=0x7f2d980b9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:48.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 -- 172.21.15.88:0/2935258422 shutdown_connections 2024-04-24T08:25:48.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 -- 172.21.15.88:0/2935258422 wait complete. 2024-04-24T08:25:48.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 Processor -- start 2024-04-24T08:25:48.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 -- start start 2024-04-24T08:25:48.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d98067a70 0x7f2d98072240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d98147db0 0x7f2d981e40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98148240 0x7f2d981e4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2d98155530 con 0x7f2d98148240 2024-04-24T08:25:48.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2d981553b0 con 0x7f2d98147db0 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2d981556b0 con 0x7f2d98067a70 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d96800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98148240 0x7f2d981e4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d96800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98148240 0x7f2d981e4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59114/0 (socket says 172.21.15.88:59114) 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d96800640 1 -- 172.21.15.88:0/2892477886 learned_addr learned my addr 172.21.15.88:0/2892477886 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d95e00640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d98067a70 0x7f2d98072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d8d400640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d98147db0 0x7f2d981e40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d96800640 1 -- 172.21.15.88:0/2892477886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d98067a70 msgr2=0x7f2d98072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d96800640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d98067a70 0x7f2d98072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d96800640 1 -- 172.21.15.88:0/2892477886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d98147db0 msgr2=0x7f2d981e40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d96800640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d98147db0 0x7f2d981e40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d96800640 1 -- 172.21.15.88:0/2892477886 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9814b290 con 0x7f2d98148240 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d8d400640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d98147db0 0x7f2d981e40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d96800640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98148240 0x7f2d981e4630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d90007e70 tx=0x7f2d9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d8ea00640 1 -- 172.21.15.88:0/2892477886 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90014620 con 0x7f2d98148240 2024-04-24T08:25:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d8ea00640 1 -- 172.21.15.88:0/2892477886 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d90019070 con 0x7f2d98148240 2024-04-24T08:25:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d8ea00640 1 -- 172.21.15.88:0/2892477886 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90014a20 con 0x7f2d98148240 2024-04-24T08:25:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.617+0000 7f2d9d000640 1 -- 172.21.15.88:0/2892477886 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d98147740 con 0x7f2d98148240 2024-04-24T08:25:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.621+0000 7f2d9d000640 1 -- 172.21.15.88:0/2892477886 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d98072aa0 con 0x7f2d98148240 2024-04-24T08:25:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.621+0000 7f2d9d000640 1 -- 172.21.15.88:0/2892477886 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d98068b90 con 0x7f2d98148240 2024-04-24T08:25:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.621+0000 7f2d8ea00640 1 -- 172.21.15.88:0/2892477886 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2d90014bc0 con 0x7f2d98148240 2024-04-24T08:25:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.621+0000 7f2d8ea00640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2d74068380 0x7f2d7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.621+0000 7f2d8ea00640 1 -- 172.21.15.88:0/2892477886 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d900870f0 con 0x7f2d98148240 2024-04-24T08:25:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.621+0000 7f2d95e00640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2d74068380 0x7f2d7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.621+0000 7f2d95e00640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2d74068380 0x7f2d7406a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2d880ad000 tx=0x7f2d88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:48.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.625+0000 7f2d8ea00640 1 -- 172.21.15.88:0/2892477886 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d90057740 con 0x7f2d98148240 2024-04-24T08:25:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.781+0000 7f2d9d000640 1 -- 172.21.15.88:0/2892477886 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d980b8d30 con 0x7f2d98148240 2024-04-24T08:25:48.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d8ea00640 1 -- 172.21.15.88:0/2892477886 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f2d90057040 con 0x7f2d98148240 2024-04-24T08:25:48.786 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:48.786 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d9d000640 1 -- 172.21.15.88:0/2892477886 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2d74068380 msgr2=0x7f2d7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d9d000640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2d74068380 0x7f2d7406a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2d880ad000 tx=0x7f2d88008040 comp rx=0 tx=0).stop 2024-04-24T08:25:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d9d000640 1 -- 172.21.15.88:0/2892477886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98148240 msgr2=0x7f2d981e4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d9d000640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98148240 0x7f2d981e4630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d90007e70 tx=0x7f2d9000e4b0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d9d000640 1 -- 172.21.15.88:0/2892477886 shutdown_connections 2024-04-24T08:25:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d9d000640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2d74068380 0x7f2d7406a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d9d000640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d98148240 0x7f2d981e4630 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d9d000640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d98147db0 0x7f2d981e40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d9d000640 1 --2- 172.21.15.88:0/2892477886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d98067a70 0x7f2d98072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d9d000640 1 -- 172.21.15.88:0/2892477886 >> 172.21.15.88:0/2892477886 conn(0x7f2d9806c380 msgr2=0x7f2d980b7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d9d000640 1 -- 172.21.15.88:0/2892477886 shutdown_connections 2024-04-24T08:25:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.785+0000 7f2d9d000640 1 -- 172.21.15.88:0/2892477886 wait complete. 2024-04-24T08:25:48.807 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T08:25:25.116395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T08:25:26.444475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:25:48.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:25:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dcae00640 1 Processor -- start 2024-04-24T08:25:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dcae00640 1 -- start start 2024-04-24T08:25:48.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dcae00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0dc4067a70 0x7f0dc40b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dcae00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc4072fb0 0x7f0dc406c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dcae00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dc40b60d0 con 0x7f0dc414b3b0 2024-04-24T08:25:48.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dcae00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc40b54b0 con 0x7f0dc4067a70 2024-04-24T08:25:48.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dcae00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc40b5010 con 0x7f0dc4072fb0 2024-04-24T08:25:48.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dbb400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0dc414b3b0 0x7f0dc406bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50222/0 (socket says 172.21.15.88:50222) 2024-04-24T08:25:48.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dbb400640 1 -- 172.21.15.88:0/1764270781 learned_addr learned my addr 172.21.15.88:0/1764270781 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:48.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dc8e00640 1 --2- 172.21.15.88:0/1764270781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc4072fb0 0x7f0dc406c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dc3e00640 1 --2- 172.21.15.88:0/1764270781 >> v2:172.21.15.142:3300/0 conn(0x7f0dc4067a70 0x7f0dc40b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dc3400640 1 -- 172.21.15.88:0/1764270781 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3052349639 0 0) 0x7f0dc40b60d0 con 0x7f0dc414b3b0 2024-04-24T08:25:48.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dc3400640 1 -- 172.21.15.88:0/1764270781 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0da8003530 con 0x7f0dc414b3b0 2024-04-24T08:25:48.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dc8e00640 1 -- 172.21.15.88:0/1764270781 >> v2:172.21.15.142:3300/0 conn(0x7f0dc4067a70 msgr2=0x7f0dc40b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:48.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dc8e00640 1 --2- 172.21.15.88:0/1764270781 >> v2:172.21.15.142:3300/0 conn(0x7f0dc4067a70 0x7f0dc40b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dc8e00640 1 -- 172.21.15.88:0/1764270781 >> v1:172.21.15.88:6789/0 conn(0x7f0dc414b3b0 legacy=0x7f0dc406bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.945+0000 7f0dc8e00640 1 -- 172.21.15.88:0/1764270781 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc4067e50 con 0x7f0dc4072fb0 2024-04-24T08:25:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.949+0000 7f0dc8e00640 1 --2- 172.21.15.88:0/1764270781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc4072fb0 0x7f0dc406c1e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009d90 tx=0x7f0dbc01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a91e57f7e9cc105a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:48.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.949+0000 7f0dc3400640 1 -- 172.21.15.88:0/1764270781 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0b2070 con 0x7f0dc4072fb0 2024-04-24T08:25:48.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.949+0000 7f0dc3400640 1 -- 172.21.15.88:0/1764270781 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dbc0a57a0 con 0x7f0dc4072fb0 2024-04-24T08:25:48.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.949+0000 7f0dc3400640 1 -- 172.21.15.88:0/1764270781 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0a5b70 con 0x7f0dc4072fb0 2024-04-24T08:25:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.949+0000 7f0dcae00640 1 -- 172.21.15.88:0/1764270781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc4072fb0 msgr2=0x7f0dc406c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.949+0000 7f0dcae00640 1 --2- 172.21.15.88:0/1764270781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc4072fb0 0x7f0dc406c1e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009d90 tx=0x7f0dbc01c8e0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.949+0000 7f0dcae00640 1 -- 172.21.15.88:0/1764270781 shutdown_connections 2024-04-24T08:25:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.949+0000 7f0dcae00640 1 --2- 172.21.15.88:0/1764270781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc4072fb0 0x7f0dc406c1e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.949+0000 7f0dcae00640 1 --2- 172.21.15.88:0/1764270781 >> v2:172.21.15.142:3300/0 conn(0x7f0dc4067a70 0x7f0dc40b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.949+0000 7f0dcae00640 1 -- 172.21.15.88:0/1764270781 >> 172.21.15.88:0/1764270781 conn(0x7f0dc40b9cf0 msgr2=0x7f0dc40ba100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.949+0000 7f0dcae00640 1 -- 172.21.15.88:0/1764270781 shutdown_connections 2024-04-24T08:25:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.949+0000 7f0dcae00640 1 -- 172.21.15.88:0/1764270781 wait complete. 2024-04-24T08:25:48.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dcae00640 1 Processor -- start 2024-04-24T08:25:48.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dcae00640 1 -- start start 2024-04-24T08:25:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dcae00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc4067a70 0x7f0dc414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dcae00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc4072fb0 0x7f0dc414ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dcae00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dc414b3b0 0x7f0dc414ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dcae00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc406c8a0 con 0x7f0dc4072fb0 2024-04-24T08:25:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dcae00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc406c720 con 0x7f0dc414b3b0 2024-04-24T08:25:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dcae00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc4155180 con 0x7f0dc4067a70 2024-04-24T08:25:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dbb400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc4072fb0 0x7f0dc414ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dbb400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc4072fb0 0x7f0dc414ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59130/0 (socket says 172.21.15.88:59130) 2024-04-24T08:25:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dbb400640 1 -- 172.21.15.88:0/726522491 learned_addr learned my addr 172.21.15.88:0/726522491 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dc8e00640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dc414b3b0 0x7f0dc414ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dc3e00640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc4067a70 0x7f0dc414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dbb400640 1 -- 172.21.15.88:0/726522491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc4067a70 msgr2=0x7f0dc414e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dbb400640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc4067a70 0x7f0dc414e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dbb400640 1 -- 172.21.15.88:0/726522491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dc414b3b0 msgr2=0x7f0dc414ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:48.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dbb400640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dc414b3b0 0x7f0dc414ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:48.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dbb400640 1 -- 172.21.15.88:0/726522491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc41e0750 con 0x7f0dc4072fb0 2024-04-24T08:25:48.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dbb400640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc4072fb0 0x7f0dc414ec40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00c420 tx=0x7f0dac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dc0c00640 1 -- 172.21.15.88:0/726522491 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac017070 con 0x7f0dc4072fb0 2024-04-24T08:25:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dc0c00640 1 -- 172.21.15.88:0/726522491 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dac005d10 con 0x7f0dc4072fb0 2024-04-24T08:25:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dcae00640 1 -- 172.21.15.88:0/726522491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc414f180 con 0x7f0dc4072fb0 2024-04-24T08:25:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dc0c00640 1 -- 172.21.15.88:0/726522491 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac007310 con 0x7f0dc4072fb0 2024-04-24T08:25:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.953+0000 7f0dcae00640 1 -- 172.21.15.88:0/726522491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc41e0cb0 con 0x7f0dc4072fb0 2024-04-24T08:25:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.957+0000 7f0dcae00640 1 -- 172.21.15.88:0/726522491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc4068c00 con 0x7f0dc4072fb0 2024-04-24T08:25:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.957+0000 7f0dc0c00640 1 -- 172.21.15.88:0/726522491 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0dac01a070 con 0x7f0dc4072fb0 2024-04-24T08:25:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.957+0000 7f0dc0c00640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0da00683b0 0x7f0da006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.957+0000 7f0dc0c00640 1 -- 172.21.15.88:0/726522491 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0dac085d20 con 0x7f0dc4072fb0 2024-04-24T08:25:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.957+0000 7f0dc3e00640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0da00683b0 0x7f0da006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.957+0000 7f0dc3e00640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0da00683b0 0x7f0da006a870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009ac0 tx=0x7f0db4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:48.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:48.961+0000 7f0dc0c00640 1 -- 172.21.15.88:0/726522491 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0dc41e0750 con 0x7f0dc4072fb0 2024-04-24T08:25:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.121+0000 7f0dcae00640 1 -- 172.21.15.88:0/726522491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0dc40b7e40 con 0x7f0dc4072fb0 2024-04-24T08:25:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.121+0000 7f0dc0c00640 1 -- 172.21.15.88:0/726522491 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f0dac055d50 con 0x7f0dc4072fb0 2024-04-24T08:25:49.123 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:25:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.121+0000 7f0dcae00640 1 -- 172.21.15.88:0/726522491 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0da00683b0 msgr2=0x7f0da006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.121+0000 7f0dcae00640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0da00683b0 0x7f0da006a870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009ac0 tx=0x7f0db4009190 comp rx=0 tx=0).stop 2024-04-24T08:25:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.121+0000 7f0dcae00640 1 -- 172.21.15.88:0/726522491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc4072fb0 msgr2=0x7f0dc414ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.121+0000 7f0dcae00640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc4072fb0 0x7f0dc414ec40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00c420 tx=0x7f0dac00c8e0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.121+0000 7f0dcae00640 1 -- 172.21.15.88:0/726522491 shutdown_connections 2024-04-24T08:25:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.121+0000 7f0dcae00640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0da00683b0 0x7f0da006a870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.121+0000 7f0dcae00640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dc414b3b0 0x7f0dc414ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.121+0000 7f0dcae00640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc4072fb0 0x7f0dc414ec40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.121+0000 7f0dcae00640 1 --2- 172.21.15.88:0/726522491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc4067a70 0x7f0dc414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.121+0000 7f0dcae00640 1 -- 172.21.15.88:0/726522491 >> 172.21.15.88:0/726522491 conn(0x7f0dc40b9cf0 msgr2=0x7f0dc4146e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.125+0000 7f0dcae00640 1 -- 172.21.15.88:0/726522491 shutdown_connections 2024-04-24T08:25:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.125+0000 7f0dcae00640 1 -- 172.21.15.88:0/726522491 wait complete. 2024-04-24T08:25:49.143 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T08:25:49.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.277+0000 7f0193c00640 1 Processor -- start 2024-04-24T08:25:49.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0193c00640 1 -- start start 2024-04-24T08:25:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0193c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f018c0b4c90 0x7f018c145f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0193c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f018c06e490 0x7f018c1464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0193c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f018c09e090 0x7f018c09e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0193c00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f018c06d2a0 con 0x7f018c06e490 2024-04-24T08:25:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0193c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f018c09ea60 con 0x7f018c09e090 2024-04-24T08:25:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0193c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f018c06d4f0 con 0x7f018c0b4c90 2024-04-24T08:25:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0183e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f018c06e490 0x7f018c1464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0183e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f018c06e490 0x7f018c1464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59136/0 (socket says 172.21.15.88:59136) 2024-04-24T08:25:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0183e00640 1 -- 172.21.15.88:0/54233717 learned_addr learned my addr 172.21.15.88:0/54233717 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0183e00640 1 -- 172.21.15.88:0/54233717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f018c0b4c90 msgr2=0x7f018c145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0191200640 1 --2- 172.21.15.88:0/54233717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f018c0b4c90 0x7f018c145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0191c00640 1 --2- 172.21.15.88:0/54233717 >> v2:172.21.15.142:3300/0 conn(0x7f018c09e090 0x7f018c09e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0183e00640 1 --2- 172.21.15.88:0/54233717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f018c0b4c90 0x7f018c145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0183e00640 1 -- 172.21.15.88:0/54233717 >> v2:172.21.15.142:3300/0 conn(0x7f018c09e090 msgr2=0x7f018c09e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0183e00640 1 --2- 172.21.15.88:0/54233717 >> v2:172.21.15.142:3300/0 conn(0x7f018c09e090 0x7f018c09e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0183e00640 1 -- 172.21.15.88:0/54233717 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c06d7d0 con 0x7f018c06e490 2024-04-24T08:25:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0191200640 1 --2- 172.21.15.88:0/54233717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f018c0b4c90 0x7f018c145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.281+0000 7f0191c00640 1 --2- 172.21.15.88:0/54233717 >> v2:172.21.15.142:3300/0 conn(0x7f018c09e090 0x7f018c09e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f0183e00640 1 --2- 172.21.15.88:0/54233717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f018c06e490 0x7f018c1464c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f018c09ca80 tx=0x7f017401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f13f42851b600cc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f018be00640 1 -- 172.21.15.88:0/54233717 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01740b2070 con 0x7f018c06e490 2024-04-24T08:25:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f018be00640 1 -- 172.21.15.88:0/54233717 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01740a9070 con 0x7f018c06e490 2024-04-24T08:25:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f018be00640 1 -- 172.21.15.88:0/54233717 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01740ad880 con 0x7f018c06e490 2024-04-24T08:25:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f0193c00640 1 -- 172.21.15.88:0/54233717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f018c06e490 msgr2=0x7f018c1464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f0193c00640 1 --2- 172.21.15.88:0/54233717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f018c06e490 0x7f018c1464c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f018c09ca80 tx=0x7f017401c490 comp rx=0 tx=0).stop 2024-04-24T08:25:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f0193c00640 1 -- 172.21.15.88:0/54233717 shutdown_connections 2024-04-24T08:25:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f0193c00640 1 --2- 172.21.15.88:0/54233717 >> v2:172.21.15.142:3300/0 conn(0x7f018c09e090 0x7f018c09e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f0193c00640 1 --2- 172.21.15.88:0/54233717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f018c06e490 0x7f018c1464c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f0193c00640 1 --2- 172.21.15.88:0/54233717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f018c0b4c90 0x7f018c145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f0193c00640 1 -- 172.21.15.88:0/54233717 >> 172.21.15.88:0/54233717 conn(0x7f018c0b9690 msgr2=0x7f018c0b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f0193c00640 1 -- 172.21.15.88:0/54233717 shutdown_connections 2024-04-24T08:25:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f0193c00640 1 -- 172.21.15.88:0/54233717 wait complete. 2024-04-24T08:25:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f0193c00640 1 Processor -- start 2024-04-24T08:25:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.285+0000 7f0193c00640 1 -- start start 2024-04-24T08:25:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0193c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f018c06e490 0x7f018c13f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0193c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f018c09e090 0x7f018c0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0193c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f018c0b4c90 0x7f018c1e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0193c00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f018c149a30 con 0x7f018c09e090 2024-04-24T08:25:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0193c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f018c1498b0 con 0x7f018c0b4c90 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0193c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f018c149bb0 con 0x7f018c06e490 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0183e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f018c09e090 0x7f018c0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0183e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f018c09e090 0x7f018c0af2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59146/0 (socket says 172.21.15.88:59146) 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0183e00640 1 -- 172.21.15.88:0/2973728120 learned_addr learned my addr 172.21.15.88:0/2973728120 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0191200640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f018c06e490 0x7f018c13f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0191c00640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f018c0b4c90 0x7f018c1e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0183e00640 1 -- 172.21.15.88:0/2973728120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f018c06e490 msgr2=0x7f018c13f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0183e00640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f018c06e490 0x7f018c13f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0183e00640 1 -- 172.21.15.88:0/2973728120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f018c0b4c90 msgr2=0x7f018c1e34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0183e00640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f018c0b4c90 0x7f018c1e34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0183e00640 1 -- 172.21.15.88:0/2973728120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c14f550 con 0x7f018c09e090 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0183e00640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f018c09e090 0x7f018c0af2a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f017401ab40 tx=0x7f0174019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0189600640 1 -- 172.21.15.88:0/2973728120 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01740b2040 con 0x7f018c09e090 2024-04-24T08:25:49.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0189600640 1 -- 172.21.15.88:0/2973728120 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01740b6620 con 0x7f018c09e090 2024-04-24T08:25:49.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0193c00640 1 -- 172.21.15.88:0/2973728120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018c0b7510 con 0x7f018c09e090 2024-04-24T08:25:49.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0189600640 1 -- 172.21.15.88:0/2973728120 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01740b6a10 con 0x7f018c09e090 2024-04-24T08:25:49.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0193c00640 1 -- 172.21.15.88:0/2973728120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f018c13c0d0 con 0x7f018c09e090 2024-04-24T08:25:49.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0193c00640 1 -- 172.21.15.88:0/2973728120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f018c068c00 con 0x7f018c09e090 2024-04-24T08:25:49.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.289+0000 7f0189600640 1 -- 172.21.15.88:0/2973728120 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01740ab070 con 0x7f018c09e090 2024-04-24T08:25:49.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.293+0000 7f0189600640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0168068380 0x7f016806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.293+0000 7f0189600640 1 -- 172.21.15.88:0/2973728120 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f01741206c0 con 0x7f018c09e090 2024-04-24T08:25:49.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.293+0000 7f0191200640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0168068380 0x7f016806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.293+0000 7f0191200640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0168068380 0x7f016806a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f017c006fd0 tx=0x7f017c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:49.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.297+0000 7f0189600640 1 -- 172.21.15.88:0/2973728120 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0174016110 con 0x7f018c09e090 2024-04-24T08:25:49.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.453+0000 7f0193c00640 1 -- 172.21.15.88:0/2973728120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f018c0b44c0 con 0x7f018c09e090 2024-04-24T08:25:49.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.453+0000 7f0189600640 1 -- 172.21.15.88:0/2973728120 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f01740f0d90 con 0x7f018c09e090 2024-04-24T08:25:49.457 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-24T08:25:49.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.457+0000 7f0193c00640 1 -- 172.21.15.88:0/2973728120 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0168068380 msgr2=0x7f016806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.457+0000 7f0193c00640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0168068380 0x7f016806a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f017c006fd0 tx=0x7f017c008040 comp rx=0 tx=0).stop 2024-04-24T08:25:49.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.457+0000 7f0193c00640 1 -- 172.21.15.88:0/2973728120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f018c09e090 msgr2=0x7f018c0af2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.457+0000 7f0193c00640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f018c09e090 0x7f018c0af2a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f017401ab40 tx=0x7f0174019230 comp rx=0 tx=0).stop 2024-04-24T08:25:49.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.457+0000 7f0193c00640 1 -- 172.21.15.88:0/2973728120 shutdown_connections 2024-04-24T08:25:49.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.457+0000 7f0193c00640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0168068380 0x7f016806a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.457+0000 7f0193c00640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f018c0b4c90 0x7f018c1e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.457+0000 7f0193c00640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f018c09e090 0x7f018c0af2a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.457+0000 7f0193c00640 1 --2- 172.21.15.88:0/2973728120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f018c06e490 0x7f018c13f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.457+0000 7f0193c00640 1 -- 172.21.15.88:0/2973728120 >> 172.21.15.88:0/2973728120 conn(0x7f018c0b9690 msgr2=0x7f018c14fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:49.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.457+0000 7f0193c00640 1 -- 172.21.15.88:0/2973728120 shutdown_connections 2024-04-24T08:25:49.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.457+0000 7f0193c00640 1 -- 172.21.15.88:0/2973728120 wait complete. 2024-04-24T08:25:49.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T08:25:49.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f0675c00640 1 Processor -- start 2024-04-24T08:25:49.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f0675c00640 1 -- start start 2024-04-24T08:25:49.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f0675c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06700b2b40 0x7f0670142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f0675c00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06700b4c40 con 0x7f06700bbfb0 2024-04-24T08:25:49.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f0675c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06700bc390 con 0x7f06700b7be0 2024-04-24T08:25:49.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f0675c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f06700b6400 con 0x7f06700b2b40 2024-04-24T08:25:49.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066ea00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f06700bbfb0 0x7f06700b4530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50238/0 (socket says 172.21.15.88:50238) 2024-04-24T08:25:49.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066ea00640 1 -- 172.21.15.88:0/661370785 learned_addr learned my addr 172.21.15.88:0/661370785 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:49.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066e000640 1 --2- 172.21.15.88:0/661370785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06700b2b40 0x7f0670142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2945832667 0 0) 0x7f06700b4c40 con 0x7f06700bbfb0 2024-04-24T08:25:49.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0654003530 con 0x7f06700bbfb0 2024-04-24T08:25:49.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516755927 0 0) 0x7f06700bc390 con 0x7f06700b7be0 2024-04-24T08:25:49.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06700b4c40 con 0x7f06700b7be0 2024-04-24T08:25:49.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4213899320 0 0) 0x7f0654003530 con 0x7f06700bbfb0 2024-04-24T08:25:49.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06700b2b40 msgr2=0x7f0670142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:49.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 --2- 172.21.15.88:0/661370785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06700b2b40 0x7f0670142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 >> v1:172.21.15.142:6789/0 conn(0x7f06700b7be0 legacy=0x7f0670150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06700b66e0 con 0x7f06700bbfb0 2024-04-24T08:25:49.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f0660001a00 con 0x7f06700bbfb0 2024-04-24T08:25:49.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 >> v1:172.21.15.88:6789/0 conn(0x7f06700bbfb0 legacy=0x7f06700b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 --2- 172.21.15.88:0/661370785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0654003b80 0x7f0654003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 --2- 172.21.15.88:0/661370785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06700b2b40 0x7f0654004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 --2- 172.21.15.88:0/661370785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654004d50 0x7f06540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f06700b6400 con 0x7f0654003b80 2024-04-24T08:25:49.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f065400bbe0 con 0x7f0654004d50 2024-04-24T08:25:49.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f065400bde0 con 0x7f06700b2b40 2024-04-24T08:25:49.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066ea00640 1 --2- 172.21.15.88:0/661370785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0654003b80 0x7f0654003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066f400640 1 --2- 172.21.15.88:0/661370785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654004d50 0x7f06540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066e000640 1 --2- 172.21.15.88:0/661370785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06700b2b40 0x7f0654004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066ea00640 1 -- 172.21.15.88:0/661370785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06700b2b40 msgr2=0x7f0654004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:49.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066ea00640 1 --2- 172.21.15.88:0/661370785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06700b2b40 0x7f0654004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066ea00640 1 -- 172.21.15.88:0/661370785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654004d50 msgr2=0x7f06540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:49.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066ea00640 1 --2- 172.21.15.88:0/661370785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654004d50 0x7f06540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.613+0000 7f066ea00640 1 -- 172.21.15.88:0/661370785 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0654003530 con 0x7f0654003b80 2024-04-24T08:25:49.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.617+0000 7f066ea00640 1 --2- 172.21.15.88:0/661370785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0654003b80 0x7f0654003f80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f066000a810 tx=0x7f066001d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2068ebeb11d805 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:49.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.617+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066000a430 con 0x7f0654003b80 2024-04-24T08:25:49.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.617+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06600ad650 con 0x7f0654003b80 2024-04-24T08:25:49.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.617+0000 7f066d600640 1 -- 172.21.15.88:0/661370785 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06600ada40 con 0x7f0654003b80 2024-04-24T08:25:49.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.617+0000 7f0675c00640 1 -- 172.21.15.88:0/661370785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0654003b80 msgr2=0x7f0654003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.617+0000 7f0675c00640 1 --2- 172.21.15.88:0/661370785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0654003b80 0x7f0654003f80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f066000a810 tx=0x7f066001d320 comp rx=0 tx=0).stop 2024-04-24T08:25:49.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.617+0000 7f066f400640 1 -- 172.21.15.88:0/661370785 reap_dead start 2024-04-24T08:25:49.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.617+0000 7f0675c00640 1 -- 172.21.15.88:0/661370785 shutdown_connections 2024-04-24T08:25:49.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.617+0000 7f0675c00640 1 -- 172.21.15.88:0/661370785 >> 172.21.15.88:0/661370785 conn(0x7f0670067e40 msgr2=0x7f06700bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:49.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.617+0000 7f0675c00640 1 -- 172.21.15.88:0/661370785 shutdown_connections 2024-04-24T08:25:49.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.617+0000 7f0675c00640 1 -- 172.21.15.88:0/661370785 wait complete. 2024-04-24T08:25:49.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0675c00640 1 Processor -- start 2024-04-24T08:25:49.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0675c00640 1 -- start start 2024-04-24T08:25:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0675c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0654003b80 0x7f0670146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0675c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f067014be40 0x7f067014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0675c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06701504e0 0x7f067013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0675c00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0670151d60 con 0x7f067014be40 2024-04-24T08:25:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0675c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f06700b7550 con 0x7f06701504e0 2024-04-24T08:25:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0675c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0670151ee0 con 0x7f0654003b80 2024-04-24T08:25:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f066e000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f067014be40 0x7f067014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f066e000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f067014be40 0x7f067014ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59168/0 (socket says 172.21.15.88:59168) 2024-04-24T08:25:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f066e000640 1 -- 172.21.15.88:0/2769951439 learned_addr learned my addr 172.21.15.88:0/2769951439 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f066ea00640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0654003b80 0x7f0670146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f066f400640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06701504e0 0x7f067013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f066e000640 1 -- 172.21.15.88:0/2769951439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0654003b80 msgr2=0x7f0670146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f066e000640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0654003b80 0x7f0670146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f066e000640 1 -- 172.21.15.88:0/2769951439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06701504e0 msgr2=0x7f067013b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f066e000640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06701504e0 0x7f067013b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f066e000640 1 -- 172.21.15.88:0/2769951439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0670148280 con 0x7f067014be40 2024-04-24T08:25:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f066e000640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f067014be40 0x7f067014ffa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f065c011610 tx=0x7f065c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:49.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0666a00640 1 -- 172.21.15.88:0/2769951439 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c00f8f0 con 0x7f067014be40 2024-04-24T08:25:49.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0666a00640 1 -- 172.21.15.88:0/2769951439 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f065c00fa90 con 0x7f067014be40 2024-04-24T08:25:49.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0666a00640 1 -- 172.21.15.88:0/2769951439 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c00fe40 con 0x7f067014be40 2024-04-24T08:25:49.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0675c00640 1 -- 172.21.15.88:0/2769951439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067013d710 con 0x7f067014be40 2024-04-24T08:25:49.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.621+0000 7f0675c00640 1 -- 172.21.15.88:0/2769951439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0670151460 con 0x7f067014be40 2024-04-24T08:25:49.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.625+0000 7f0675c00640 1 -- 172.21.15.88:0/2769951439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f067013d500 con 0x7f067014be40 2024-04-24T08:25:49.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.625+0000 7f0666a00640 1 -- 172.21.15.88:0/2769951439 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f065c015460 con 0x7f067014be40 2024-04-24T08:25:49.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.625+0000 7f0666a00640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0650068380 0x7f065006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.625+0000 7f0666a00640 1 -- 172.21.15.88:0/2769951439 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f065c087190 con 0x7f067014be40 2024-04-24T08:25:49.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.625+0000 7f066ea00640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0650068380 0x7f065006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.625+0000 7f066ea00640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0650068380 0x7f065006a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f06600ad000 tx=0x7f0660001d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:49.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.629+0000 7f0666a00640 1 -- 172.21.15.88:0/2769951439 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f065c019030 con 0x7f067014be40 2024-04-24T08:25:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 -- 172.21.15.88:0/2769951439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0670068c00 con 0x7f067014be40 2024-04-24T08:25:49.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0666a00640 1 -- 172.21.15.88:0/2769951439 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f065c057170 con 0x7f067014be40 2024-04-24T08:25:49.787 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-24T08:25:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 -- 172.21.15.88:0/2769951439 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0650068380 msgr2=0x7f065006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0650068380 0x7f065006a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f06600ad000 tx=0x7f0660001d50 comp rx=0 tx=0).stop 2024-04-24T08:25:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 -- 172.21.15.88:0/2769951439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f067014be40 msgr2=0x7f067014ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f067014be40 0x7f067014ffa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f065c011610 tx=0x7f065c011ad0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 -- 172.21.15.88:0/2769951439 shutdown_connections 2024-04-24T08:25:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0650068380 0x7f065006a840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06701504e0 0x7f067013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f067014be40 0x7f067014ffa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 --2- 172.21.15.88:0/2769951439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0654003b80 0x7f0670146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 -- 172.21.15.88:0/2769951439 >> 172.21.15.88:0/2769951439 conn(0x7f0670067e40 msgr2=0x7f0670072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 -- 172.21.15.88:0/2769951439 shutdown_connections 2024-04-24T08:25:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.785+0000 7f0675c00640 1 -- 172.21.15.88:0/2769951439 wait complete. 2024-04-24T08:25:49.854 INFO:tasks.cephfs_test_runner:Starting test: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) Test that when cd is issued with an argument, CWD is changed 2024-04-24T08:25:49.854 INFO:tasks.cephfs_test_runner:test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-24T08:25:49.855 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:49.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbef200640 1 Processor -- start 2024-04-24T08:25:49.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbef200640 1 -- start start 2024-04-24T08:25:49.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbef200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe809be30 0x7fdbe8145f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbef200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdbe806d920 0x7fdbe81504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbef200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe80ba170 con 0x7fdbe80b9d90 2024-04-24T08:25:49.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbef200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe809cd30 con 0x7fdbe806d920 2024-04-24T08:25:49.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbef200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe8146460 con 0x7fdbe809be30 2024-04-24T08:25:49.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbed200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdbe806d920 0x7fdbe81504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbed200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdbe806d920 0x7fdbe81504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59174/0 (socket says 172.21.15.88:59174) 2024-04-24T08:25:49.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbed200640 1 -- 172.21.15.88:0/1356905049 learned_addr learned my addr 172.21.15.88:0/1356905049 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:49.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbe7e00640 1 --1- 172.21.15.88:0/1356905049 >> v1:172.21.15.88:6789/0 conn(0x7fdbe80b9d90 0x7fdbe806d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50252/0 (socket says 172.21.15.88:50252) 2024-04-24T08:25:49.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbdf400640 1 --2- 172.21.15.88:0/1356905049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe809be30 0x7fdbe8145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbed200640 1 -- 172.21.15.88:0/1356905049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe809be30 msgr2=0x7fdbe8145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:49.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbed200640 1 --2- 172.21.15.88:0/1356905049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe809be30 0x7fdbe8145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbed200640 1 -- 172.21.15.88:0/1356905049 >> v1:172.21.15.88:6789/0 conn(0x7fdbe80b9d90 legacy=0x7fdbe806d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.989+0000 7fdbed200640 1 -- 172.21.15.88:0/1356905049 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe814a060 con 0x7fdbe806d920 2024-04-24T08:25:49.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbed200640 1 --2- 172.21.15.88:0/1356905049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbe806d920 0x7fdbe81504e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00098a0 tx=0x7fdbe001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335c71ee270670c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:49.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbe7400640 1 -- 172.21.15.88:0/1356905049 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00b1070 con 0x7fdbe806d920 2024-04-24T08:25:49.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbe7400640 1 -- 172.21.15.88:0/1356905049 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe00ac640 con 0x7fdbe806d920 2024-04-24T08:25:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbe7400640 1 -- 172.21.15.88:0/1356905049 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00aca10 con 0x7fdbe806d920 2024-04-24T08:25:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbef200640 1 -- 172.21.15.88:0/1356905049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbe806d920 msgr2=0x7fdbe81504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbef200640 1 --2- 172.21.15.88:0/1356905049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbe806d920 0x7fdbe81504e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00098a0 tx=0x7fdbe001c420 comp rx=0 tx=0).stop 2024-04-24T08:25:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbef200640 1 -- 172.21.15.88:0/1356905049 shutdown_connections 2024-04-24T08:25:49.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbef200640 1 --2- 172.21.15.88:0/1356905049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbe806d920 0x7fdbe81504e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbef200640 1 --2- 172.21.15.88:0/1356905049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe809be30 0x7fdbe8145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:49.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbef200640 1 -- 172.21.15.88:0/1356905049 >> 172.21.15.88:0/1356905049 conn(0x7fdbe806c0d0 msgr2=0x7fdbe80b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:49.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbef200640 1 -- 172.21.15.88:0/1356905049 shutdown_connections 2024-04-24T08:25:49.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbef200640 1 -- 172.21.15.88:0/1356905049 wait complete. 2024-04-24T08:25:49.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbef200640 1 Processor -- start 2024-04-24T08:25:49.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.993+0000 7fdbef200640 1 -- start start 2024-04-24T08:25:49.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbef200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe806d920 0x7fdbe8148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbef200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe809be30 0x7fdbe81deae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbef200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbe80b9d90 0x7fdbe81df020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:49.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbef200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe80b3fa0 con 0x7fdbe80b9d90 2024-04-24T08:25:49.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbef200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe80b3e20 con 0x7fdbe809be30 2024-04-24T08:25:49.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbef200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe8153240 con 0x7fdbe806d920 2024-04-24T08:25:49.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbed200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbe80b9d90 0x7fdbe81df020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:49.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbed200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbe80b9d90 0x7fdbe81df020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59188/0 (socket says 172.21.15.88:59188) 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbed200640 1 -- 172.21.15.88:0/341960666 learned_addr learned my addr 172.21.15.88:0/341960666 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbdf400640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe809be30 0x7fdbe81deae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbe7e00640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe806d920 0x7fdbe8148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbed200640 1 -- 172.21.15.88:0/341960666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe806d920 msgr2=0x7fdbe8148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbed200640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe806d920 0x7fdbe8148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbed200640 1 -- 172.21.15.88:0/341960666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe809be30 msgr2=0x7fdbe81deae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbed200640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe809be30 0x7fdbe81deae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbed200640 1 -- 172.21.15.88:0/341960666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe80737c0 con 0x7fdbe80b9d90 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbed200640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbe80b9d90 0x7fdbe81df020 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00097f0 tx=0x7fdbe00191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbe4c00640 1 -- 172.21.15.88:0/341960666 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00b1040 con 0x7fdbe80b9d90 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbe4c00640 1 -- 172.21.15.88:0/341960666 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe00b5420 con 0x7fdbe80b9d90 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbe4c00640 1 -- 172.21.15.88:0/341960666 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00b57f0 con 0x7fdbe80b9d90 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbef200640 1 -- 172.21.15.88:0/341960666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe81e25f0 con 0x7fdbe80b9d90 2024-04-24T08:25:50.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbef200640 1 -- 172.21.15.88:0/341960666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe81e2bb0 con 0x7fdbe80b9d90 2024-04-24T08:25:50.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:49.997+0000 7fdbef200640 1 -- 172.21.15.88:0/341960666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe8068b90 con 0x7fdbe80b9d90 2024-04-24T08:25:50.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.001+0000 7fdbe4c00640 1 -- 172.21.15.88:0/341960666 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdbe00b5990 con 0x7fdbe80b9d90 2024-04-24T08:25:50.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.001+0000 7fdbe4c00640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fdbc4068380 0x7fdbc406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:50.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.001+0000 7fdbe4c00640 1 -- 172.21.15.88:0/341960666 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdbe0120590 con 0x7fdbe80b9d90 2024-04-24T08:25:50.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.001+0000 7fdbe7e00640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fdbc4068380 0x7fdbc406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.001+0000 7fdbe7e00640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fdbc4068380 0x7fdbc406a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8007fd0 tx=0x7fdbd8005b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:50.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.005+0000 7fdbe4c00640 1 -- 172.21.15.88:0/341960666 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdbe0016130 con 0x7fdbe80b9d90 2024-04-24T08:25:50.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.165+0000 7fdbef200640 1 -- 172.21.15.88:0/341960666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdbe80b95f0 con 0x7fdbe80b9d90 2024-04-24T08:25:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.165+0000 7fdbe4c00640 1 -- 172.21.15.88:0/341960666 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fdbe00f0be0 con 0x7fdbe80b9d90 2024-04-24T08:25:50.169 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:50.169 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.169+0000 7fdbef200640 1 -- 172.21.15.88:0/341960666 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fdbc4068380 msgr2=0x7fdbc406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.169+0000 7fdbef200640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fdbc4068380 0x7fdbc406a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8007fd0 tx=0x7fdbd8005b80 comp rx=0 tx=0).stop 2024-04-24T08:25:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.169+0000 7fdbef200640 1 -- 172.21.15.88:0/341960666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbe80b9d90 msgr2=0x7fdbe81df020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.169+0000 7fdbef200640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbe80b9d90 0x7fdbe81df020 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00097f0 tx=0x7fdbe00191c0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.169+0000 7fdbef200640 1 -- 172.21.15.88:0/341960666 shutdown_connections 2024-04-24T08:25:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.169+0000 7fdbef200640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fdbc4068380 0x7fdbc406a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.169+0000 7fdbef200640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbe80b9d90 0x7fdbe81df020 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.169+0000 7fdbef200640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe809be30 0x7fdbe81deae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.169+0000 7fdbef200640 1 --2- 172.21.15.88:0/341960666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe806d920 0x7fdbe8148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.169+0000 7fdbef200640 1 -- 172.21.15.88:0/341960666 >> 172.21.15.88:0/341960666 conn(0x7fdbe806c0d0 msgr2=0x7fdbe8145990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.169+0000 7fdbef200640 1 -- 172.21.15.88:0/341960666 shutdown_connections 2024-04-24T08:25:50.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.169+0000 7fdbef200640 1 -- 172.21.15.88:0/341960666 wait complete. 2024-04-24T08:25:50.191 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T08:25:25.116395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T08:25:26.444475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:25:50.191 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:25:50.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.329+0000 7fa53aa00640 1 Processor -- start 2024-04-24T08:25:50.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.329+0000 7fa53aa00640 1 -- start start 2024-04-24T08:25:50.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.329+0000 7fa53aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5340bbfb0 0x7fa5340b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:50.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.329+0000 7fa53aa00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5340bc390 con 0x7fa5341433c0 2024-04-24T08:25:50.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.329+0000 7fa53aa00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5340b6400 con 0x7fa5340b2b40 2024-04-24T08:25:50.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.329+0000 7fa53aa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa5340b66e0 con 0x7fa5340bbfb0 2024-04-24T08:25:50.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.329+0000 7fa538a00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa5341433c0 0x7fa534150430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50266/0 (socket says 172.21.15.88:50266) 2024-04-24T08:25:50.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.329+0000 7fa538a00640 1 -- 172.21.15.88:0/1048296453 learned_addr learned my addr 172.21.15.88:0/1048296453 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:50.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.329+0000 7fa533e00640 1 --2- 172.21.15.88:0/1048296453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5340bbfb0 0x7fa5340b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.329+0000 7fa532a00640 1 -- 172.21.15.88:0/1048296453 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1758466755 0 0) 0x7fa5340bc390 con 0x7fa5341433c0 2024-04-24T08:25:50.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.329+0000 7fa532a00640 1 -- 172.21.15.88:0/1048296453 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa518003530 con 0x7fa5341433c0 2024-04-24T08:25:50.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa533e00640 1 -- 172.21.15.88:0/1048296453 >> v1:172.21.15.142:6789/0 conn(0x7fa5340b2b40 legacy=0x7fa534142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa533e00640 1 -- 172.21.15.88:0/1048296453 >> v1:172.21.15.88:6789/0 conn(0x7fa5341433c0 legacy=0x7fa534150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa533e00640 1 -- 172.21.15.88:0/1048296453 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5340b5070 con 0x7fa5340bbfb0 2024-04-24T08:25:50.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa533e00640 1 --2- 172.21.15.88:0/1048296453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5340bbfb0 0x7fa5340b4530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa5240097f0 tx=0x7fa52401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c20699e176cbcf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:50.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa532a00640 1 -- 172.21.15.88:0/1048296453 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240b0070 con 0x7fa5340bbfb0 2024-04-24T08:25:50.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa532a00640 1 -- 172.21.15.88:0/1048296453 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5240a4e50 con 0x7fa5340bbfb0 2024-04-24T08:25:50.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa532a00640 1 -- 172.21.15.88:0/1048296453 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240ab820 con 0x7fa5340bbfb0 2024-04-24T08:25:50.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa53aa00640 1 -- 172.21.15.88:0/1048296453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5340bbfb0 msgr2=0x7fa5340b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa53aa00640 1 --2- 172.21.15.88:0/1048296453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5340bbfb0 0x7fa5340b4530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa5240097f0 tx=0x7fa52401c3c0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa53aa00640 1 -- 172.21.15.88:0/1048296453 shutdown_connections 2024-04-24T08:25:50.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa53aa00640 1 --2- 172.21.15.88:0/1048296453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5340bbfb0 0x7fa5340b4530 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa53aa00640 1 -- 172.21.15.88:0/1048296453 >> 172.21.15.88:0/1048296453 conn(0x7fa534067e40 msgr2=0x7fa5340bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:50.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.333+0000 7fa53aa00640 1 -- 172.21.15.88:0/1048296453 shutdown_connections 2024-04-24T08:25:50.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa53aa00640 1 -- 172.21.15.88:0/1048296453 wait complete. 2024-04-24T08:25:50.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa53aa00640 1 Processor -- start 2024-04-24T08:25:50.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa53aa00640 1 -- start start 2024-04-24T08:25:50.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa53aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5340b2b40 0x7fa5341e48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:50.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa53aa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5340bbfb0 0x7fa5341489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:50.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa53aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5341433c0 0x7fa53413a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:50.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa53aa00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa5340b7550 con 0x7fa5340bbfb0 2024-04-24T08:25:50.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa53aa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa534154990 con 0x7fa5340b2b40 2024-04-24T08:25:50.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa53aa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa534154b10 con 0x7fa5341433c0 2024-04-24T08:25:50.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa533400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5340bbfb0 0x7fa5341489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa533400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5340bbfb0 0x7fa5341489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59190/0 (socket says 172.21.15.88:59190) 2024-04-24T08:25:50.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa533400640 1 -- 172.21.15.88:0/1221751317 learned_addr learned my addr 172.21.15.88:0/1221751317 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:50.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa533e00640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5340b2b40 0x7fa5341e48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa538a00640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5341433c0 0x7fa53413a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa533400640 1 -- 172.21.15.88:0/1221751317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5341433c0 msgr2=0x7fa53413a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa533400640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5341433c0 0x7fa53413a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa533400640 1 -- 172.21.15.88:0/1221751317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5340b2b40 msgr2=0x7fa5341e48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa533400640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5340b2b40 0x7fa5341e48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa533400640 1 -- 172.21.15.88:0/1221751317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53414e830 con 0x7fa5340bbfb0 2024-04-24T08:25:50.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa533400640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5340bbfb0 0x7fa5341489d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa52000c450 tx=0x7fa52000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:50.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa52be00640 1 -- 172.21.15.88:0/1221751317 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa520016020 con 0x7fa5340bbfb0 2024-04-24T08:25:50.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa52be00640 1 -- 172.21.15.88:0/1221751317 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5200052d0 con 0x7fa5340bbfb0 2024-04-24T08:25:50.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa53aa00640 1 -- 172.21.15.88:0/1221751317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa534149170 con 0x7fa5340bbfb0 2024-04-24T08:25:50.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa52be00640 1 -- 172.21.15.88:0/1221751317 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa520007260 con 0x7fa5340bbfb0 2024-04-24T08:25:50.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.337+0000 7fa53aa00640 1 -- 172.21.15.88:0/1221751317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa534146cf0 con 0x7fa5340bbfb0 2024-04-24T08:25:50.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.341+0000 7fa53aa00640 1 -- 172.21.15.88:0/1221751317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa534068c00 con 0x7fa5340bbfb0 2024-04-24T08:25:50.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.341+0000 7fa52be00640 1 -- 172.21.15.88:0/1221751317 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa520007400 con 0x7fa5340bbfb0 2024-04-24T08:25:50.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.341+0000 7fa52be00640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa514068380 0x7fa51406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:50.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.341+0000 7fa52be00640 1 -- 172.21.15.88:0/1221751317 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa5200862f0 con 0x7fa5340bbfb0 2024-04-24T08:25:50.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.341+0000 7fa533e00640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa514068380 0x7fa51406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.341+0000 7fa533e00640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa514068380 0x7fa51406a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa5240ad000 tx=0x7fa524008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:50.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.349+0000 7fa52be00640 1 -- 172.21.15.88:0/1221751317 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa520020020 con 0x7fa5340bbfb0 2024-04-24T08:25:50.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.509+0000 7fa53aa00640 1 -- 172.21.15.88:0/1221751317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa534144d40 con 0x7fa5340bbfb0 2024-04-24T08:25:50.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa52be00640 1 -- 172.21.15.88:0/1221751317 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fa520005480 con 0x7fa5340bbfb0 2024-04-24T08:25:50.513 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:25:50.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa53aa00640 1 -- 172.21.15.88:0/1221751317 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa514068380 msgr2=0x7fa51406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa53aa00640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa514068380 0x7fa51406a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa5240ad000 tx=0x7fa524008040 comp rx=0 tx=0).stop 2024-04-24T08:25:50.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa53aa00640 1 -- 172.21.15.88:0/1221751317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5340bbfb0 msgr2=0x7fa5341489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa53aa00640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5340bbfb0 0x7fa5341489d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa52000c450 tx=0x7fa52000c910 comp rx=0 tx=0).stop 2024-04-24T08:25:50.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa53aa00640 1 -- 172.21.15.88:0/1221751317 shutdown_connections 2024-04-24T08:25:50.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa53aa00640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa514068380 0x7fa51406a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa53aa00640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5341433c0 0x7fa53413a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa53aa00640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5340bbfb0 0x7fa5341489d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa53aa00640 1 --2- 172.21.15.88:0/1221751317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5340b2b40 0x7fa5341e48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa53aa00640 1 -- 172.21.15.88:0/1221751317 >> 172.21.15.88:0/1221751317 conn(0x7fa534067e40 msgr2=0x7fa5340bb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:50.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa53aa00640 1 -- 172.21.15.88:0/1221751317 shutdown_connections 2024-04-24T08:25:50.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.513+0000 7fa53aa00640 1 -- 172.21.15.88:0/1221751317 wait complete. 2024-04-24T08:25:50.535 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T08:25:50.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24bc800640 1 Processor -- start 2024-04-24T08:25:50.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24bc800640 1 -- start start 2024-04-24T08:25:50.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24bc800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24b40b2b40 0x7f24b4142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:50.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24bc800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24b40b7be0 0x7f24b41431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:50.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24bc800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24b40b4c40 con 0x7f24b40bbfb0 2024-04-24T08:25:50.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24bc800640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f24b40bc390 con 0x7f24b40b2b40 2024-04-24T08:25:50.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24bc800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f24b40b6400 con 0x7f24b40b7be0 2024-04-24T08:25:50.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24b9400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24b40b2b40 0x7f24b4142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24b9400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24b40b2b40 0x7f24b4142cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59198/0 (socket says 172.21.15.88:59198) 2024-04-24T08:25:50.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24b9400640 1 -- 172.21.15.88:0/1887012807 learned_addr learned my addr 172.21.15.88:0/1887012807 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:50.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24b9e00640 1 --1- 172.21.15.88:0/1887012807 >> v1:172.21.15.88:6789/0 conn(0x7f24b40bbfb0 0x7f24b40b4530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50276/0 (socket says 172.21.15.88:50276) 2024-04-24T08:25:50.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24ba800640 1 --2- 172.21.15.88:0/1887012807 >> v2:172.21.15.142:3300/0 conn(0x7f24b40b7be0 0x7f24b41431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24b9400640 1 -- 172.21.15.88:0/1887012807 >> v2:172.21.15.142:3300/0 conn(0x7f24b40b7be0 msgr2=0x7f24b41431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:50.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24b9400640 1 --2- 172.21.15.88:0/1887012807 >> v2:172.21.15.142:3300/0 conn(0x7f24b40b7be0 0x7f24b41431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24b9400640 1 -- 172.21.15.88:0/1887012807 >> v1:172.21.15.88:6789/0 conn(0x7f24b40bbfb0 legacy=0x7f24b40b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.673+0000 7f24b9400640 1 -- 172.21.15.88:0/1887012807 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b40b66e0 con 0x7f24b40b2b40 2024-04-24T08:25:50.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.677+0000 7f24b9400640 1 --2- 172.21.15.88:0/1887012807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b40b2b40 0x7f24b4142cb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f24b40b5ce0 tx=0x7f24a401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abd99b30076cce3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:50.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.677+0000 7f24b8a00640 1 -- 172.21.15.88:0/1887012807 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a40b0070 con 0x7f24b40b2b40 2024-04-24T08:25:50.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.677+0000 7f24b8a00640 1 -- 172.21.15.88:0/1887012807 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a40ab600 con 0x7f24b40b2b40 2024-04-24T08:25:50.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.677+0000 7f24b8a00640 1 -- 172.21.15.88:0/1887012807 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a40ab9d0 con 0x7f24b40b2b40 2024-04-24T08:25:50.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.677+0000 7f24bc800640 1 -- 172.21.15.88:0/1887012807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b40b2b40 msgr2=0x7f24b4142cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.677+0000 7f24bc800640 1 --2- 172.21.15.88:0/1887012807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b40b2b40 0x7f24b4142cb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f24b40b5ce0 tx=0x7f24a401c400 comp rx=0 tx=0).stop 2024-04-24T08:25:50.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.677+0000 7f24bc800640 1 -- 172.21.15.88:0/1887012807 shutdown_connections 2024-04-24T08:25:50.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.677+0000 7f24bc800640 1 --2- 172.21.15.88:0/1887012807 >> v2:172.21.15.142:3300/0 conn(0x7f24b40b7be0 0x7f24b41431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.677+0000 7f24bc800640 1 --2- 172.21.15.88:0/1887012807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b40b2b40 0x7f24b4142cb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.677+0000 7f24bc800640 1 -- 172.21.15.88:0/1887012807 >> 172.21.15.88:0/1887012807 conn(0x7f24b4067e40 msgr2=0x7f24b40bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:50.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.677+0000 7f24bc800640 1 -- 172.21.15.88:0/1887012807 shutdown_connections 2024-04-24T08:25:50.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.677+0000 7f24bc800640 1 -- 172.21.15.88:0/1887012807 wait complete. 2024-04-24T08:25:50.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24bc800640 1 Processor -- start 2024-04-24T08:25:50.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24bc800640 1 -- start start 2024-04-24T08:25:50.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24bc800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24b40b2b40 0x7f24b4149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:50.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24bc800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b40b7be0 0x7f24b406e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24bc800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b40bbfb0 0x7f24b41e3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24bc800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f24b4152e60 con 0x7f24b40bbfb0 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24bc800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f24b40b7550 con 0x7f24b40b2b40 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24bc800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f24b4152fe0 con 0x7f24b40b7be0 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24ba800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b40bbfb0 0x7f24b41e3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24ba800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b40bbfb0 0x7f24b41e3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59212/0 (socket says 172.21.15.88:59212) 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24ba800640 1 -- 172.21.15.88:0/3619174001 learned_addr learned my addr 172.21.15.88:0/3619174001 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24b9e00640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24b40b2b40 0x7f24b4149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24b9400640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b40b7be0 0x7f24b406e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24ba800640 1 -- 172.21.15.88:0/3619174001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b40b7be0 msgr2=0x7f24b406e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24ba800640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b40b7be0 0x7f24b406e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24ba800640 1 -- 172.21.15.88:0/3619174001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24b40b2b40 msgr2=0x7f24b4149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24ba800640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24b40b2b40 0x7f24b4149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24ba800640 1 -- 172.21.15.88:0/3619174001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b413cbd0 con 0x7f24b40bbfb0 2024-04-24T08:25:50.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24ba800640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b40bbfb0 0x7f24b41e3ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f24b0007e40 tx=0x7f24b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:50.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24ae000640 1 -- 172.21.15.88:0/3619174001 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b0014620 con 0x7f24b40bbfb0 2024-04-24T08:25:50.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24ae000640 1 -- 172.21.15.88:0/3619174001 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b0019070 con 0x7f24b40bbfb0 2024-04-24T08:25:50.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24ae000640 1 -- 172.21.15.88:0/3619174001 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b0014a20 con 0x7f24b40bbfb0 2024-04-24T08:25:50.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24bc800640 1 -- 172.21.15.88:0/3619174001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b4143c30 con 0x7f24b40bbfb0 2024-04-24T08:25:50.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.681+0000 7f24bc800640 1 -- 172.21.15.88:0/3619174001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b41e3590 con 0x7f24b40bbfb0 2024-04-24T08:25:50.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.685+0000 7f24bc800640 1 -- 172.21.15.88:0/3619174001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b4068c00 con 0x7f24b40bbfb0 2024-04-24T08:25:50.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.685+0000 7f24ae000640 1 -- 172.21.15.88:0/3619174001 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f24b0014bc0 con 0x7f24b40bbfb0 2024-04-24T08:25:50.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.685+0000 7f24ae000640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2498068380 0x7f249806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:50.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.685+0000 7f24ae000640 1 -- 172.21.15.88:0/3619174001 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f24b0087180 con 0x7f24b40bbfb0 2024-04-24T08:25:50.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.685+0000 7f24b9e00640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2498068380 0x7f249806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:50.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.685+0000 7f24b9e00640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2498068380 0x7f249806a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f24b4149bd0 tx=0x7f24a8007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:50.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.693+0000 7f24ae000640 1 -- 172.21.15.88:0/3619174001 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f24b00570e0 con 0x7f24b40bbfb0 2024-04-24T08:25:50.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.861+0000 7f24bc800640 1 -- 172.21.15.88:0/3619174001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f24b41e37d0 con 0x7f24b40bbfb0 2024-04-24T08:25:50.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.861+0000 7f24ae000640 1 -- 172.21.15.88:0/3619174001 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f24b005b3e0 con 0x7f24b40bbfb0 2024-04-24T08:25:50.863 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-24T08:25:50.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.865+0000 7f24bc800640 1 -- 172.21.15.88:0/3619174001 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2498068380 msgr2=0x7f249806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.865+0000 7f24bc800640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2498068380 0x7f249806a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f24b4149bd0 tx=0x7f24a8007e90 comp rx=0 tx=0).stop 2024-04-24T08:25:50.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.865+0000 7f24bc800640 1 -- 172.21.15.88:0/3619174001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b40bbfb0 msgr2=0x7f24b41e3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:50.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.865+0000 7f24bc800640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b40bbfb0 0x7f24b41e3ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f24b0007e40 tx=0x7f24b000e4b0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.865+0000 7f24bc800640 1 -- 172.21.15.88:0/3619174001 shutdown_connections 2024-04-24T08:25:50.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.865+0000 7f24bc800640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2498068380 0x7f249806a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.865+0000 7f24bc800640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24b40bbfb0 0x7f24b41e3ab0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.865+0000 7f24bc800640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b40b7be0 0x7f24b406e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.865+0000 7f24bc800640 1 --2- 172.21.15.88:0/3619174001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24b40b2b40 0x7f24b4149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:50.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.865+0000 7f24bc800640 1 -- 172.21.15.88:0/3619174001 >> 172.21.15.88:0/3619174001 conn(0x7f24b4067e40 msgr2=0x7f24b4141910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:50.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.865+0000 7f24bc800640 1 -- 172.21.15.88:0/3619174001 shutdown_connections 2024-04-24T08:25:50.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:50.865+0000 7f24bc800640 1 -- 172.21.15.88:0/3619174001 wait complete. 2024-04-24T08:25:50.884 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T08:25:51.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1539200640 1 Processor -- start 2024-04-24T08:25:51.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1539200640 1 -- start start 2024-04-24T08:25:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1539200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15340bbfb0 0x7f15340b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1539200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 0x7f1534142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1539200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15340bc390 con 0x7f15340b7be0 2024-04-24T08:25:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1539200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f15340b6400 con 0x7f15340bbfb0 2024-04-24T08:25:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1539200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f15340b66e0 con 0x7f15340b2b40 2024-04-24T08:25:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1531e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15340bbfb0 0x7f15340b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1529400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 0x7f1534142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1529400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 0x7f1534142cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:60022/0 (socket says 172.21.15.88:60022) 2024-04-24T08:25:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1529400640 1 -- 172.21.15.88:0/1244236367 learned_addr learned my addr 172.21.15.88:0/1244236367 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1532800640 1 --1- 172.21.15.88:0/1244236367 >> v1:172.21.15.142:6789/0 conn(0x7f15340b7be0 0x7f1534072690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:50212/0 (socket says 172.21.15.88:50212) 2024-04-24T08:25:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1529400640 1 -- 172.21.15.88:0/1244236367 >> v2:172.21.15.142:3300/0 conn(0x7f15340bbfb0 msgr2=0x7f15340b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1529400640 1 --2- 172.21.15.88:0/1244236367 >> v2:172.21.15.142:3300/0 conn(0x7f15340bbfb0 0x7f15340b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1529400640 1 -- 172.21.15.88:0/1244236367 >> v1:172.21.15.142:6789/0 conn(0x7f15340b7be0 legacy=0x7f1534072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.021+0000 7f1529400640 1 -- 172.21.15.88:0/1244236367 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15340b5070 con 0x7f15340b2b40 2024-04-24T08:25:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.025+0000 7f1529400640 1 --2- 172.21.15.88:0/1244236367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 0x7f1534142cb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f151c009870 tx=0x7f151c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ef418241aea6bed server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.025+0000 7f1531400640 1 -- 172.21.15.88:0/1244236367 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c0b0070 con 0x7f15340b2b40 2024-04-24T08:25:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.025+0000 7f1531400640 1 -- 172.21.15.88:0/1244236367 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f151c0ab600 con 0x7f15340b2b40 2024-04-24T08:25:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.025+0000 7f1531400640 1 -- 172.21.15.88:0/1244236367 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c0ab9d0 con 0x7f15340b2b40 2024-04-24T08:25:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.025+0000 7f1539200640 1 -- 172.21.15.88:0/1244236367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 msgr2=0x7f1534142cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.025+0000 7f1539200640 1 --2- 172.21.15.88:0/1244236367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 0x7f1534142cb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f151c009870 tx=0x7f151c01c440 comp rx=0 tx=0).stop 2024-04-24T08:25:51.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.025+0000 7f1539200640 1 -- 172.21.15.88:0/1244236367 shutdown_connections 2024-04-24T08:25:51.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.025+0000 7f1539200640 1 --2- 172.21.15.88:0/1244236367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 0x7f1534142cb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.025+0000 7f1539200640 1 --2- 172.21.15.88:0/1244236367 >> v2:172.21.15.142:3300/0 conn(0x7f15340bbfb0 0x7f15340b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.025+0000 7f1539200640 1 -- 172.21.15.88:0/1244236367 >> 172.21.15.88:0/1244236367 conn(0x7f1534067e40 msgr2=0x7f15340bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:51.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.025+0000 7f1539200640 1 -- 172.21.15.88:0/1244236367 shutdown_connections 2024-04-24T08:25:51.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.025+0000 7f1539200640 1 -- 172.21.15.88:0/1244236367 wait complete. 2024-04-24T08:25:51.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1539200640 1 Processor -- start 2024-04-24T08:25:51.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1539200640 1 -- start start 2024-04-24T08:25:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1539200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 0x7f15340ba6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1539200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15340b7be0 0x7f15341e1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1539200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15340bbfb0 0x7f15341e1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1539200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f15340b7550 con 0x7f15340b7be0 2024-04-24T08:25:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1539200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1534143600 con 0x7f15340bbfb0 2024-04-24T08:25:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1539200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1534153660 con 0x7f15340b2b40 2024-04-24T08:25:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1529400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15340b7be0 0x7f15341e1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1529400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15340b7be0 0x7f15341e1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59224/0 (socket says 172.21.15.88:59224) 2024-04-24T08:25:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1529400640 1 -- 172.21.15.88:0/2587660365 learned_addr learned my addr 172.21.15.88:0/2587660365 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1531e00640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 0x7f15340ba6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1529400640 1 -- 172.21.15.88:0/2587660365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 msgr2=0x7f15340ba6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1532800640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15340bbfb0 0x7f15341e1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1529400640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 0x7f15340ba6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1529400640 1 -- 172.21.15.88:0/2587660365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15340bbfb0 msgr2=0x7f15341e1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1529400640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15340bbfb0 0x7f15341e1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1529400640 1 -- 172.21.15.88:0/2587660365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15340aa530 con 0x7f15340b7be0 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1531e00640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 0x7f15340ba6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1532800640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15340bbfb0 0x7f15341e1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1529400640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15340b7be0 0x7f15341e1150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f151c0ae040 tx=0x7f151c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f152aa00640 1 -- 172.21.15.88:0/2587660365 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c0b0040 con 0x7f15340b7be0 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f152aa00640 1 -- 172.21.15.88:0/2587660365 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f151c0b4420 con 0x7f15340b7be0 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f152aa00640 1 -- 172.21.15.88:0/2587660365 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c0b4810 con 0x7f15340b7be0 2024-04-24T08:25:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1539200640 1 -- 172.21.15.88:0/2587660365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1534149f00 con 0x7f15340b7be0 2024-04-24T08:25:51.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.029+0000 7f1539200640 1 -- 172.21.15.88:0/2587660365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15341e0c30 con 0x7f15340b7be0 2024-04-24T08:25:51.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.033+0000 7f1539200640 1 -- 172.21.15.88:0/2587660365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1534068c00 con 0x7f15340b7be0 2024-04-24T08:25:51.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.033+0000 7f152aa00640 1 -- 172.21.15.88:0/2587660365 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f151c0b49b0 con 0x7f15340b7be0 2024-04-24T08:25:51.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.033+0000 7f152aa00640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1510068380 0x7f151006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:51.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.033+0000 7f152aa00640 1 -- 172.21.15.88:0/2587660365 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f151c120610 con 0x7f15340b7be0 2024-04-24T08:25:51.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.033+0000 7f1531e00640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1510068380 0x7f151006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:51.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.033+0000 7f1531e00640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1510068380 0x7f151006a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1524009a40 tx=0x7f1524008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:51.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.037+0000 7f152aa00640 1 -- 172.21.15.88:0/2587660365 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f151c016150 con 0x7f15340b7be0 2024-04-24T08:25:51.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 -- 172.21.15.88:0/2587660365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f15341423d0 con 0x7f15340b7be0 2024-04-24T08:25:51.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f152aa00640 1 -- 172.21.15.88:0/2587660365 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f151c0f0bc0 con 0x7f15340b7be0 2024-04-24T08:25:51.198 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-24T08:25:51.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 -- 172.21.15.88:0/2587660365 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1510068380 msgr2=0x7f151006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:51.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1510068380 0x7f151006a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1524009a40 tx=0x7f1524008040 comp rx=0 tx=0).stop 2024-04-24T08:25:51.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 -- 172.21.15.88:0/2587660365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15340b7be0 msgr2=0x7f15341e1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:51.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15340b7be0 0x7f15341e1150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f151c0ae040 tx=0x7f151c0191e0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 -- 172.21.15.88:0/2587660365 shutdown_connections 2024-04-24T08:25:51.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1510068380 0x7f151006a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15340bbfb0 0x7f15341e1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15340b7be0 0x7f15341e1150 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 --2- 172.21.15.88:0/2587660365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15340b2b40 0x7f15340ba6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 -- 172.21.15.88:0/2587660365 >> 172.21.15.88:0/2587660365 conn(0x7f1534067e40 msgr2=0x7f15340b87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:51.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 -- 172.21.15.88:0/2587660365 shutdown_connections 2024-04-24T08:25:51.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.197+0000 7f1539200640 1 -- 172.21.15.88:0/2587660365 wait complete. 2024-04-24T08:25:51.219 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args' 2024-04-24T08:25:51.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa297600640 1 Processor -- start 2024-04-24T08:25:51.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa297600640 1 -- start start 2024-04-24T08:25:51.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa297600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa290067a70 0x7fa2900b5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:51.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa297600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa290148240 0x7fa290152650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:51.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa297600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa290067e50 con 0x7fa290147db0 2024-04-24T08:25:51.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa297600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa2900af500 con 0x7fa290067a70 2024-04-24T08:25:51.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa297600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa2900b54b0 con 0x7fa290148240 2024-04-24T08:25:51.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa294c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa290067a70 0x7fa2900b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:51.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa295600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa290148240 0x7fa290152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:51.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa294c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa290067a70 0x7fa2900b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59230/0 (socket says 172.21.15.88:59230) 2024-04-24T08:25:51.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa294c00640 1 -- 172.21.15.88:0/3623467702 learned_addr learned my addr 172.21.15.88:0/3623467702 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:51.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa294c00640 1 -- 172.21.15.88:0/3623467702 >> v2:172.21.15.142:3300/0 conn(0x7fa290148240 msgr2=0x7fa290152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:51.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa294c00640 1 --2- 172.21.15.88:0/3623467702 >> v2:172.21.15.142:3300/0 conn(0x7fa290148240 0x7fa290152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa294c00640 1 -- 172.21.15.88:0/3623467702 >> v1:172.21.15.142:6789/0 conn(0x7fa290147db0 legacy=0x7fa290144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:51.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.353+0000 7fa294c00640 1 -- 172.21.15.88:0/3623467702 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2900b5ee0 con 0x7fa290067a70 2024-04-24T08:25:51.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.357+0000 7fa294c00640 1 --2- 172.21.15.88:0/3623467702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa290067a70 0x7fa2900b5900 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2900b7ba0 tx=0x7fa28001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0df4e2de59b698 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:51.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.357+0000 7fa28fe00640 1 -- 172.21.15.88:0/3623467702 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2800b0070 con 0x7fa290067a70 2024-04-24T08:25:51.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.357+0000 7fa28fe00640 1 -- 172.21.15.88:0/3623467702 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2800ab600 con 0x7fa290067a70 2024-04-24T08:25:51.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.357+0000 7fa28fe00640 1 -- 172.21.15.88:0/3623467702 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2800ab9d0 con 0x7fa290067a70 2024-04-24T08:25:51.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.357+0000 7fa297600640 1 -- 172.21.15.88:0/3623467702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa290067a70 msgr2=0x7fa2900b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:51.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.357+0000 7fa297600640 1 --2- 172.21.15.88:0/3623467702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa290067a70 0x7fa2900b5900 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2900b7ba0 tx=0x7fa28001c490 comp rx=0 tx=0).stop 2024-04-24T08:25:51.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.357+0000 7fa297600640 1 -- 172.21.15.88:0/3623467702 shutdown_connections 2024-04-24T08:25:51.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.357+0000 7fa297600640 1 --2- 172.21.15.88:0/3623467702 >> v2:172.21.15.142:3300/0 conn(0x7fa290148240 0x7fa290152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.357+0000 7fa297600640 1 --2- 172.21.15.88:0/3623467702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa290067a70 0x7fa2900b5900 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.357+0000 7fa297600640 1 -- 172.21.15.88:0/3623467702 >> 172.21.15.88:0/3623467702 conn(0x7fa29006c380 msgr2=0x7fa2900b9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:51.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.357+0000 7fa297600640 1 -- 172.21.15.88:0/3623467702 shutdown_connections 2024-04-24T08:25:51.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.357+0000 7fa297600640 1 -- 172.21.15.88:0/3623467702 wait complete. 2024-04-24T08:25:51.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa297600640 1 Processor -- start 2024-04-24T08:25:51.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa297600640 1 -- start start 2024-04-24T08:25:51.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa297600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa290067a70 0x7fa290072240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa297600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa290147db0 0x7fa2901e40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa297600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa290148240 0x7fa2901e4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa297600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa290155530 con 0x7fa290067a70 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa297600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa2901553b0 con 0x7fa290147db0 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa297600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa2901556b0 con 0x7fa290148240 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa294c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa290067a70 0x7fa290072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa294c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa290067a70 0x7fa290072240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59242/0 (socket says 172.21.15.88:59242) 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa294c00640 1 -- 172.21.15.88:0/737277296 learned_addr learned my addr 172.21.15.88:0/737277296 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa287e00640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa290147db0 0x7fa2901e40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa295600640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa290148240 0x7fa2901e4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa294c00640 1 -- 172.21.15.88:0/737277296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa290148240 msgr2=0x7fa2901e4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa294c00640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa290148240 0x7fa2901e4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa294c00640 1 -- 172.21.15.88:0/737277296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa290147db0 msgr2=0x7fa2901e40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:51.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa294c00640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa290147db0 0x7fa2901e40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa294c00640 1 -- 172.21.15.88:0/737277296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29014b290 con 0x7fa290067a70 2024-04-24T08:25:51.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa294c00640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa290067a70 0x7fa290072240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa2800190a0 tx=0x7fa280019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:51.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa28d600640 1 -- 172.21.15.88:0/737277296 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2800abe60 con 0x7fa290067a70 2024-04-24T08:25:51.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa28d600640 1 -- 172.21.15.88:0/737277296 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2800b4620 con 0x7fa290067a70 2024-04-24T08:25:51.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa297600640 1 -- 172.21.15.88:0/737277296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa290147740 con 0x7fa290067a70 2024-04-24T08:25:51.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa28d600640 1 -- 172.21.15.88:0/737277296 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2800b0040 con 0x7fa290067a70 2024-04-24T08:25:51.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.361+0000 7fa297600640 1 -- 172.21.15.88:0/737277296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa290072aa0 con 0x7fa290067a70 2024-04-24T08:25:51.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.365+0000 7fa297600640 1 -- 172.21.15.88:0/737277296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa290068b90 con 0x7fa290067a70 2024-04-24T08:25:51.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.365+0000 7fa28d600640 1 -- 172.21.15.88:0/737277296 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa2800ab4c0 con 0x7fa290067a70 2024-04-24T08:25:51.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.365+0000 7fa28d600640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa26c068380 0x7fa26c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:51.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.365+0000 7fa28d600640 1 -- 172.21.15.88:0/737277296 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa2801203e0 con 0x7fa290067a70 2024-04-24T08:25:51.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.365+0000 7fa287e00640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa26c068380 0x7fa26c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:51.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.365+0000 7fa287e00640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa26c068380 0x7fa26c06a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa290072eb0 tx=0x7fa278009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:51.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.369+0000 7fa28d600640 1 -- 172.21.15.88:0/737277296 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa280016110 con 0x7fa290067a70 2024-04-24T08:25:51.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.581+0000 7fa297600640 1 -- 172.21.15.88:0/737277296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]} v 0) -- 0x7fa2900b8d30 con 0x7fa290067a70 2024-04-24T08:25:51.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.869+0000 7fa28d600640 1 -- 172.21.15.88:0/737277296 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]}]=0 v49) ==== 137+0+0 (secure 0 0 0) 0x7fa2800f0990 con 0x7fa290067a70 2024-04-24T08:25:51.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.873+0000 7fa297600640 1 -- 172.21.15.88:0/737277296 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa26c068380 msgr2=0x7fa26c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.873+0000 7fa297600640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa26c068380 0x7fa26c06a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa290072eb0 tx=0x7fa278009040 comp rx=0 tx=0).stop 2024-04-24T08:25:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.873+0000 7fa297600640 1 -- 172.21.15.88:0/737277296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa290067a70 msgr2=0x7fa290072240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.873+0000 7fa297600640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa290067a70 0x7fa290072240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa2800190a0 tx=0x7fa280019230 comp rx=0 tx=0).stop 2024-04-24T08:25:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.873+0000 7fa297600640 1 -- 172.21.15.88:0/737277296 shutdown_connections 2024-04-24T08:25:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.873+0000 7fa297600640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa26c068380 0x7fa26c06a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.873+0000 7fa297600640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa290148240 0x7fa2901e4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.873+0000 7fa297600640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa290147db0 0x7fa2901e40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.873+0000 7fa297600640 1 --2- 172.21.15.88:0/737277296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa290067a70 0x7fa290072240 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.873+0000 7fa297600640 1 -- 172.21.15.88:0/737277296 >> 172.21.15.88:0/737277296 conn(0x7fa29006c380 msgr2=0x7fa2900b7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.873+0000 7fa297600640 1 -- 172.21.15.88:0/737277296 shutdown_connections 2024-04-24T08:25:51.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:51.873+0000 7fa297600640 1 -- 172.21.15.88:0/737277296 wait complete. 2024-04-24T08:25:51.892 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-24T08:25:52.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.029+0000 7f9d28000640 1 Processor -- start 2024-04-24T08:25:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.029+0000 7f9d28000640 1 -- start start 2024-04-24T08:25:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.029+0000 7f9d28000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d2006e490 0x7f9d20151420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.029+0000 7f9d28000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d2006d4f0 con 0x7f9d20146690 2024-04-24T08:25:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.029+0000 7f9d28000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d2006d7d0 con 0x7f9d200b4c90 2024-04-24T08:25:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.029+0000 7f9d28000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f9d2006d2a0 con 0x7f9d2006e490 2024-04-24T08:25:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.029+0000 7f9d26000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d2006e490 0x7f9d20151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.029+0000 7f9d26000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d2006e490 0x7f9d20151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59256/0 (socket says 172.21.15.88:59256) 2024-04-24T08:25:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.029+0000 7f9d26000640 1 -- 172.21.15.88:0/1701260490 learned_addr learned my addr 172.21.15.88:0/1701260490 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.029+0000 7f9d24c00640 1 --1- 172.21.15.88:0/1701260490 >> v1:172.21.15.88:6789/0 conn(0x7f9d20146690 0x7f9d2009e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50282/0 (socket says 172.21.15.88:50282) 2024-04-24T08:25:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d26000640 1 -- 172.21.15.88:0/1701260490 >> v1:172.21.15.142:6789/0 conn(0x7f9d200b4c90 legacy=0x7f9d20145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d26000640 1 -- 172.21.15.88:0/1701260490 >> v1:172.21.15.88:6789/0 conn(0x7f9d20146690 legacy=0x7f9d2009e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d26000640 1 -- 172.21.15.88:0/1701260490 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2009c570 con 0x7f9d2006e490 2024-04-24T08:25:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d1fe00640 1 -- 172.21.15.88:0/1701260490 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2270434878 0 0) 0x7f9d2006d4f0 con 0x7f9d20146690 2024-04-24T08:25:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d26000640 1 --2- 172.21.15.88:0/1701260490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d2006e490 0x7f9d20151420 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009e50 tx=0x7f9d1801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4d8543d99c7bf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d1fe00640 1 -- 172.21.15.88:0/1701260490 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d180a5660 con 0x7f9d2006e490 2024-04-24T08:25:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d1fe00640 1 -- 172.21.15.88:0/1701260490 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d180a5800 con 0x7f9d2006e490 2024-04-24T08:25:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d1fe00640 1 -- 172.21.15.88:0/1701260490 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d180a5bd0 con 0x7f9d2006e490 2024-04-24T08:25:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d28000640 1 -- 172.21.15.88:0/1701260490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d2006e490 msgr2=0x7f9d20151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d28000640 1 --2- 172.21.15.88:0/1701260490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d2006e490 0x7f9d20151420 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009e50 tx=0x7f9d1801c9a0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d28000640 1 -- 172.21.15.88:0/1701260490 shutdown_connections 2024-04-24T08:25:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d28000640 1 --2- 172.21.15.88:0/1701260490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d2006e490 0x7f9d20151420 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.033+0000 7f9d28000640 1 -- 172.21.15.88:0/1701260490 >> 172.21.15.88:0/1701260490 conn(0x7f9d200b9690 msgr2=0x7f9d200b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d28000640 1 -- 172.21.15.88:0/1701260490 shutdown_connections 2024-04-24T08:25:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d28000640 1 -- 172.21.15.88:0/1701260490 wait complete. 2024-04-24T08:25:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d28000640 1 Processor -- start 2024-04-24T08:25:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d28000640 1 -- start start 2024-04-24T08:25:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d28000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d2006e490 0x7f9d20142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d28000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d200b4c90 0x7f9d20140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d28000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d20146690 0x7f9d201e4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d28000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9d20154920 con 0x7f9d200b4c90 2024-04-24T08:25:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d28000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9d201547a0 con 0x7f9d2006e490 2024-04-24T08:25:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d28000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9d20154aa0 con 0x7f9d20146690 2024-04-24T08:25:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d24c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d200b4c90 0x7f9d20140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d24c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d200b4c90 0x7f9d20140cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59260/0 (socket says 172.21.15.88:59260) 2024-04-24T08:25:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d24c00640 1 -- 172.21.15.88:0/323192374 learned_addr learned my addr 172.21.15.88:0/323192374 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d25600640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d2006e490 0x7f9d20142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d26000640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d20146690 0x7f9d201e4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d24c00640 1 -- 172.21.15.88:0/323192374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d20146690 msgr2=0x7f9d201e4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d24c00640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d20146690 0x7f9d201e4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d24c00640 1 -- 172.21.15.88:0/323192374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d2006e490 msgr2=0x7f9d20142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d24c00640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d2006e490 0x7f9d20142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d24c00640 1 -- 172.21.15.88:0/323192374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d20140540 con 0x7f9d200b4c90 2024-04-24T08:25:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d24c00640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d200b4c90 0x7f9d20140cd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00c410 tx=0x7f9d0c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d1d600640 1 -- 172.21.15.88:0/323192374 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c0074e0 con 0x7f9d200b4c90 2024-04-24T08:25:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d1d600640 1 -- 172.21.15.88:0/323192374 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d0c0047f0 con 0x7f9d200b4c90 2024-04-24T08:25:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d28000640 1 -- 172.21.15.88:0/323192374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d200b1970 con 0x7f9d200b4c90 2024-04-24T08:25:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d1d600640 1 -- 172.21.15.88:0/323192374 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c007680 con 0x7f9d200b4c90 2024-04-24T08:25:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.037+0000 7f9d28000640 1 -- 172.21.15.88:0/323192374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d200b1590 con 0x7f9d200b4c90 2024-04-24T08:25:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.041+0000 7f9d28000640 1 -- 172.21.15.88:0/323192374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d20068c00 con 0x7f9d200b4c90 2024-04-24T08:25:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.041+0000 7f9d1d600640 1 -- 172.21.15.88:0/323192374 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d0c011070 con 0x7f9d200b4c90 2024-04-24T08:25:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.041+0000 7f9d1d600640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9d00068380 0x7f9d0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.041+0000 7f9d1d600640 1 -- 172.21.15.88:0/323192374 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9d0c086450 con 0x7f9d200b4c90 2024-04-24T08:25:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.041+0000 7f9d25600640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9d00068380 0x7f9d0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.041+0000 7f9d25600640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9d00068380 0x7f9d0006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d14007fd0 tx=0x7f9d14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:52.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.045+0000 7f9d1d600640 1 -- 172.21.15.88:0/323192374 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9d200b1970 con 0x7f9d200b4c90 2024-04-24T08:25:52.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.205+0000 7f9d28000640 1 -- 172.21.15.88:0/323192374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9d200b44c0 con 0x7f9d200b4c90 2024-04-24T08:25:52.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.209+0000 7f9d1d600640 1 -- 172.21.15.88:0/323192374 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f9d0c0563b0 con 0x7f9d200b4c90 2024-04-24T08:25:52.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.213+0000 7f9d28000640 1 -- 172.21.15.88:0/323192374 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9d00068380 msgr2=0x7f9d0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.213+0000 7f9d28000640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9d00068380 0x7f9d0006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d14007fd0 tx=0x7f9d14009040 comp rx=0 tx=0).stop 2024-04-24T08:25:52.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.213+0000 7f9d28000640 1 -- 172.21.15.88:0/323192374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d200b4c90 msgr2=0x7f9d20140cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.213+0000 7f9d28000640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d200b4c90 0x7f9d20140cd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00c410 tx=0x7f9d0c00c8d0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.213+0000 7f9d28000640 1 -- 172.21.15.88:0/323192374 shutdown_connections 2024-04-24T08:25:52.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.213+0000 7f9d28000640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9d00068380 0x7f9d0006a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.213+0000 7f9d28000640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d20146690 0x7f9d201e4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.213+0000 7f9d28000640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d200b4c90 0x7f9d20140cd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.213+0000 7f9d28000640 1 --2- 172.21.15.88:0/323192374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d2006e490 0x7f9d20142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.213+0000 7f9d28000640 1 -- 172.21.15.88:0/323192374 >> 172.21.15.88:0/323192374 conn(0x7f9d200b9690 msgr2=0x7f9d2009b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:52.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.213+0000 7f9d28000640 1 -- 172.21.15.88:0/323192374 shutdown_connections 2024-04-24T08:25:52.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.213+0000 7f9d28000640 1 -- 172.21.15.88:0/323192374 wait complete. 2024-04-24T08:25:52.233 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T08:25:52.233 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T08:25:52.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T08:25:52.363 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T08:25:52.363 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:25:52.363 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T08:25:52.371 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:25:52.372 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T08:25:52.420 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:52.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f817d200640 1 Processor -- start 2024-04-24T08:25:52.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f817d200640 1 -- start start 2024-04-24T08:25:52.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f817d200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f817813ffa0 0x7f81781514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f817d200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f817809bd90 con 0x7f81780b6a50 2024-04-24T08:25:52.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f817d200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f817806c110 con 0x7f817806bd30 2024-04-24T08:25:52.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f817d200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f817809aed0 con 0x7f817813ffa0 2024-04-24T08:25:52.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8175400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f81780b6a50 0x7f817813f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50296/0 (socket says 172.21.15.88:50296) 2024-04-24T08:25:52.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8175400640 1 -- 172.21.15.88:0/3339086943 learned_addr learned my addr 172.21.15.88:0/3339086943 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:52.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8176800640 1 --2- 172.21.15.88:0/3339086943 >> v2:172.21.15.142:3300/0 conn(0x7f817813ffa0 0x7f81781514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699675128 0 0) 0x7f817809bd90 con 0x7f81780b6a50 2024-04-24T08:25:52.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f815c003530 con 0x7f81780b6a50 2024-04-24T08:25:52.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 854175122 0 0) 0x7f815c003530 con 0x7f81780b6a50 2024-04-24T08:25:52.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 >> v2:172.21.15.142:3300/0 conn(0x7f817813ffa0 msgr2=0x7f81781514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:52.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 --2- 172.21.15.88:0/3339086943 >> v2:172.21.15.142:3300/0 conn(0x7f817813ffa0 0x7f81781514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 >> v1:172.21.15.142:6789/0 conn(0x7f817806bd30 legacy=0x7f817809c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817809abf0 con 0x7f81780b6a50 2024-04-24T08:25:52.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f8164001680 con 0x7f81780b6a50 2024-04-24T08:25:52.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 >> v1:172.21.15.88:6789/0 conn(0x7f81780b6a50 legacy=0x7f817813f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 --2- 172.21.15.88:0/3339086943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f815c0039c0 0x7f815c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 --2- 172.21.15.88:0/3339086943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f815c0043c0 0x7f815c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 --2- 172.21.15.88:0/3339086943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f815c005130 0x7f815c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f817809aed0 con 0x7f815c0039c0 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f815c00c070 con 0x7f815c0043c0 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f815c00c270 con 0x7f815c005130 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8175e00640 1 --2- 172.21.15.88:0/3339086943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f815c0039c0 0x7f815c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8175400640 1 --2- 172.21.15.88:0/3339086943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f815c0043c0 0x7f815c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8176800640 1 --2- 172.21.15.88:0/3339086943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f815c005130 0x7f815c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8175e00640 1 -- 172.21.15.88:0/3339086943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f815c005130 msgr2=0x7f815c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8175e00640 1 --2- 172.21.15.88:0/3339086943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f815c005130 0x7f815c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8175e00640 1 -- 172.21.15.88:0/3339086943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f815c0043c0 msgr2=0x7f815c004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8175e00640 1 --2- 172.21.15.88:0/3339086943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f815c0043c0 0x7f815c004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8175e00640 1 -- 172.21.15.88:0/3339086943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815c003530 con 0x7f815c0039c0 2024-04-24T08:25:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8176800640 1 --2- 172.21.15.88:0/3339086943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f815c005130 0x7f815c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:52.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.597+0000 7f8176800640 1 -- 172.21.15.88:0/3339086943 reap_dead start 2024-04-24T08:25:52.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.601+0000 7f8175e00640 1 --2- 172.21.15.88:0/3339086943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f815c0039c0 0x7f815c003da0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8168001910 tx=0x7f816801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7665b47444f7704 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:52.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.601+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81680b0070 con 0x7f815c0039c0 2024-04-24T08:25:52.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.601+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81680ab620 con 0x7f815c0039c0 2024-04-24T08:25:52.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.601+0000 7f8174a00640 1 -- 172.21.15.88:0/3339086943 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8168001510 con 0x7f815c0039c0 2024-04-24T08:25:52.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.601+0000 7f817d200640 1 -- 172.21.15.88:0/3339086943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f815c0039c0 msgr2=0x7f815c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.601+0000 7f817d200640 1 --2- 172.21.15.88:0/3339086943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f815c0039c0 0x7f815c003da0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8168001910 tx=0x7f816801c560 comp rx=0 tx=0).stop 2024-04-24T08:25:52.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.601+0000 7f817d200640 1 -- 172.21.15.88:0/3339086943 shutdown_connections 2024-04-24T08:25:52.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.601+0000 7f817d200640 1 --2- 172.21.15.88:0/3339086943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f815c0039c0 0x7f815c003da0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.601+0000 7f817d200640 1 -- 172.21.15.88:0/3339086943 >> 172.21.15.88:0/3339086943 conn(0x7f81780b6fd0 msgr2=0x7f81780b73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:52.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.601+0000 7f817d200640 1 -- 172.21.15.88:0/3339086943 shutdown_connections 2024-04-24T08:25:52.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.601+0000 7f817d200640 1 -- 172.21.15.88:0/3339086943 wait complete. 2024-04-24T08:25:52.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f817d200640 1 Processor -- start 2024-04-24T08:25:52.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f817d200640 1 -- start start 2024-04-24T08:25:52.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f817d200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f815c0039c0 0x7f8178141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f817d200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81781dc330 0x7f81781dc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f817d200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817813e6c0 0x7f817813eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f817d200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f81780b1500 con 0x7f81781dc330 2024-04-24T08:25:52.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f817d200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f81781403b0 con 0x7f815c0039c0 2024-04-24T08:25:52.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f817d200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f81780737a0 con 0x7f817813e6c0 2024-04-24T08:25:52.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f8175400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81781dc330 0x7f81781dc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f8175400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81781dc330 0x7f81781dc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59274/0 (socket says 172.21.15.88:59274) 2024-04-24T08:25:52.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f8175400640 1 -- 172.21.15.88:0/147454207 learned_addr learned my addr 172.21.15.88:0/147454207 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:52.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f8175e00640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f815c0039c0 0x7f8178141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f8176800640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817813e6c0 0x7f817813eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f8175400640 1 -- 172.21.15.88:0/147454207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817813e6c0 msgr2=0x7f817813eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f8175400640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817813e6c0 0x7f817813eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f8175400640 1 -- 172.21.15.88:0/147454207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f815c0039c0 msgr2=0x7f8178141440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f8175400640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f815c0039c0 0x7f8178141440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f8175400640 1 -- 172.21.15.88:0/147454207 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81781dccd0 con 0x7f81781dc330 2024-04-24T08:25:52.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f8175400640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81781dc330 0x7f81781dc790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f816400e530 tx=0x7f816400e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:52.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f816e000640 1 -- 172.21.15.88:0/147454207 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164012590 con 0x7f81781dc330 2024-04-24T08:25:52.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f816e000640 1 -- 172.21.15.88:0/147454207 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8164018070 con 0x7f81781dc330 2024-04-24T08:25:52.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f817d200640 1 -- 172.21.15.88:0/147454207 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817813f080 con 0x7f81781dc330 2024-04-24T08:25:52.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f816e000640 1 -- 172.21.15.88:0/147454207 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164012990 con 0x7f81781dc330 2024-04-24T08:25:52.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.605+0000 7f817d200640 1 -- 172.21.15.88:0/147454207 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8178143090 con 0x7f81781dc330 2024-04-24T08:25:52.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.609+0000 7f817d200640 1 -- 172.21.15.88:0/147454207 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8178068b90 con 0x7f81781dc330 2024-04-24T08:25:52.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.609+0000 7f816e000640 1 -- 172.21.15.88:0/147454207 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8164012b30 con 0x7f81781dc330 2024-04-24T08:25:52.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.609+0000 7f816e000640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8158068380 0x7f815806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.609+0000 7f816e000640 1 -- 172.21.15.88:0/147454207 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8164086500 con 0x7f81781dc330 2024-04-24T08:25:52.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.609+0000 7f8175e00640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8158068380 0x7f815806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.609+0000 7f8175e00640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8158068380 0x7f815806a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f81680ad000 tx=0x7f8168001330 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:52.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.613+0000 7f816e000640 1 -- 172.21.15.88:0/147454207 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8164056460 con 0x7f81781dc330 2024-04-24T08:25:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.769+0000 7f817d200640 1 -- 172.21.15.88:0/147454207 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f817806c110 con 0x7f81781dc330 2024-04-24T08:25:52.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.769+0000 7f816e000640 1 -- 172.21.15.88:0/147454207 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f816405a760 con 0x7f81781dc330 2024-04-24T08:25:52.772 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:52.772 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:52.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.773+0000 7f817d200640 1 -- 172.21.15.88:0/147454207 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8158068380 msgr2=0x7f815806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.773+0000 7f817d200640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8158068380 0x7f815806a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f81680ad000 tx=0x7f8168001330 comp rx=0 tx=0).stop 2024-04-24T08:25:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.773+0000 7f817d200640 1 -- 172.21.15.88:0/147454207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81781dc330 msgr2=0x7f81781dc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.773+0000 7f817d200640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81781dc330 0x7f81781dc790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f816400e530 tx=0x7f816400e9f0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.773+0000 7f817d200640 1 -- 172.21.15.88:0/147454207 shutdown_connections 2024-04-24T08:25:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.773+0000 7f817d200640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8158068380 0x7f815806a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.773+0000 7f817d200640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817813e6c0 0x7f817813eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.773+0000 7f817d200640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81781dc330 0x7f81781dc790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.773+0000 7f817d200640 1 --2- 172.21.15.88:0/147454207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f815c0039c0 0x7f8178141440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.773+0000 7f817d200640 1 -- 172.21.15.88:0/147454207 >> 172.21.15.88:0/147454207 conn(0x7f81780b6fd0 msgr2=0x7f8178144d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.773+0000 7f817d200640 1 -- 172.21.15.88:0/147454207 shutdown_connections 2024-04-24T08:25:52.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.773+0000 7f817d200640 1 -- 172.21.15.88:0/147454207 wait complete. 2024-04-24T08:25:52.794 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T08:25:25.116395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T08:25:26.444475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:25:52.794 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:25:52.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.929+0000 7fc71c400640 1 Processor -- start 2024-04-24T08:25:52.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc71c400640 1 -- start start 2024-04-24T08:25:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc71c400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc7140b4c90 0x7fc714145f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc71c400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc71406e490 0x7fc7141464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc71c400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc71406d4f0 con 0x7fc71409e090 2024-04-24T08:25:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc71c400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc71406d2a0 con 0x7fc7140b4c90 2024-04-24T08:25:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc71c400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc71406d7d0 con 0x7fc71406e490 2024-04-24T08:25:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc719a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc7140b4c90 0x7fc714145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc71a400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc71409e090 0x7fc71409e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50312/0 (socket says 172.21.15.88:50312) 2024-04-24T08:25:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc71a400640 1 -- 172.21.15.88:0/3827400340 learned_addr learned my addr 172.21.15.88:0/3827400340 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc719000640 1 --2- 172.21.15.88:0/3827400340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc71406e490 0x7fc7141464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc719a00640 1 -- 172.21.15.88:0/3827400340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc71406e490 msgr2=0x7fc7141464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc719a00640 1 --2- 172.21.15.88:0/3827400340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc71406e490 0x7fc7141464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc719a00640 1 -- 172.21.15.88:0/3827400340 >> v1:172.21.15.88:6789/0 conn(0x7fc71409e090 legacy=0x7fc71409e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc719a00640 1 -- 172.21.15.88:0/3827400340 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71409c570 con 0x7fc7140b4c90 2024-04-24T08:25:52.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.933+0000 7fc713e00640 1 -- 172.21.15.88:0/3827400340 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567512946 0 0) 0x7fc71406d4f0 con 0x7fc71409e090 2024-04-24T08:25:52.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc719a00640 1 --2- 172.21.15.88:0/3827400340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7140b4c90 0x7fc714145f80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc7080097c0 tx=0x7fc70801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd39f8941cf94bd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:52.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc713e00640 1 -- 172.21.15.88:0/3827400340 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080b0070 con 0x7fc7140b4c90 2024-04-24T08:25:52.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc713e00640 1 -- 172.21.15.88:0/3827400340 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7080ab600 con 0x7fc7140b4c90 2024-04-24T08:25:52.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc713e00640 1 -- 172.21.15.88:0/3827400340 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080ab9d0 con 0x7fc7140b4c90 2024-04-24T08:25:52.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 -- 172.21.15.88:0/3827400340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7140b4c90 msgr2=0x7fc714145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 --2- 172.21.15.88:0/3827400340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7140b4c90 0x7fc714145f80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc7080097c0 tx=0x7fc70801c410 comp rx=0 tx=0).stop 2024-04-24T08:25:52.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 -- 172.21.15.88:0/3827400340 shutdown_connections 2024-04-24T08:25:52.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 --2- 172.21.15.88:0/3827400340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc71406e490 0x7fc7141464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 --2- 172.21.15.88:0/3827400340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7140b4c90 0x7fc714145f80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 -- 172.21.15.88:0/3827400340 >> 172.21.15.88:0/3827400340 conn(0x7fc7140b9690 msgr2=0x7fc7140b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:52.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 -- 172.21.15.88:0/3827400340 shutdown_connections 2024-04-24T08:25:52.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 -- 172.21.15.88:0/3827400340 wait complete. 2024-04-24T08:25:52.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 Processor -- start 2024-04-24T08:25:52.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 -- start start 2024-04-24T08:25:52.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc71406e490 0x7fc7140b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc71409e090 0x7fc7141e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7140b4c90 0x7fc7141e0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.937+0000 7fc71c400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc714152fc0 con 0x7fc7140b4c90 2024-04-24T08:25:52.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71c400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc714152e40 con 0x7fc71409e090 2024-04-24T08:25:52.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71c400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc714153140 con 0x7fc71406e490 2024-04-24T08:25:52.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71a400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7140b4c90 0x7fc7141e0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71a400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7140b4c90 0x7fc7141e0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59300/0 (socket says 172.21.15.88:59300) 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71a400640 1 -- 172.21.15.88:0/2116118725 learned_addr learned my addr 172.21.15.88:0/2116118725 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc719a00640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc71406e490 0x7fc7140b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc719000640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc71409e090 0x7fc7141e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71a400640 1 -- 172.21.15.88:0/2116118725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc71406e490 msgr2=0x7fc7140b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71a400640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc71406e490 0x7fc7140b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71a400640 1 -- 172.21.15.88:0/2116118725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc71409e090 msgr2=0x7fc7141e0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71a400640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc71409e090 0x7fc7141e0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71a400640 1 -- 172.21.15.88:0/2116118725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc714147220 con 0x7fc7140b4c90 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc719000640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc71409e090 0x7fc7141e0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71a400640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7140b4c90 0x7fc7141e0f60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00c7a0 tx=0x7fc70c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc711600640 1 -- 172.21.15.88:0/2116118725 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c018070 con 0x7fc7140b4c90 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc711600640 1 -- 172.21.15.88:0/2116118725 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c00a640 con 0x7fc7140b4c90 2024-04-24T08:25:52.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc711600640 1 -- 172.21.15.88:0/2116118725 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c00aab0 con 0x7fc7140b4c90 2024-04-24T08:25:52.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71c400640 1 -- 172.21.15.88:0/2116118725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc714073290 con 0x7fc7140b4c90 2024-04-24T08:25:52.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71c400640 1 -- 172.21.15.88:0/2116118725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc714146f40 con 0x7fc7140b4c90 2024-04-24T08:25:52.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc71c400640 1 -- 172.21.15.88:0/2116118725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc714068c00 con 0x7fc7140b4c90 2024-04-24T08:25:52.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.941+0000 7fc711600640 1 -- 172.21.15.88:0/2116118725 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc70c00ac50 con 0x7fc7140b4c90 2024-04-24T08:25:52.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.945+0000 7fc711600640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc6f4068380 0x7fc6f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:52.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.945+0000 7fc711600640 1 -- 172.21.15.88:0/2116118725 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc70c085f10 con 0x7fc7140b4c90 2024-04-24T08:25:52.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.945+0000 7fc719a00640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc6f4068380 0x7fc6f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:52.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.945+0000 7fc719a00640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc6f4068380 0x7fc6f406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7080ad000 tx=0x7fc7080a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:52.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:52.949+0000 7fc711600640 1 -- 172.21.15.88:0/2116118725 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc70c055e70 con 0x7fc7140b4c90 2024-04-24T08:25:53.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 -- 172.21.15.88:0/2116118725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc7140b44c0 con 0x7fc7140b4c90 2024-04-24T08:25:53.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc711600640 1 -- 172.21.15.88:0/2116118725 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc70c05a170 con 0x7fc7140b4c90 2024-04-24T08:25:53.110 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:25:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 -- 172.21.15.88:0/2116118725 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc6f4068380 msgr2=0x7fc6f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc6f4068380 0x7fc6f406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7080ad000 tx=0x7fc7080a6000 comp rx=0 tx=0).stop 2024-04-24T08:25:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 -- 172.21.15.88:0/2116118725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7140b4c90 msgr2=0x7fc7141e0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7140b4c90 0x7fc7141e0f60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00c7a0 tx=0x7fc70c00cc60 comp rx=0 tx=0).stop 2024-04-24T08:25:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 -- 172.21.15.88:0/2116118725 shutdown_connections 2024-04-24T08:25:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc6f4068380 0x7fc6f406a840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7140b4c90 0x7fc7141e0f60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc71409e090 0x7fc7141e0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 --2- 172.21.15.88:0/2116118725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc71406e490 0x7fc7140b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 -- 172.21.15.88:0/2116118725 >> 172.21.15.88:0/2116118725 conn(0x7fc7140b9690 msgr2=0x7fc71414fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 -- 172.21.15.88:0/2116118725 shutdown_connections 2024-04-24T08:25:53.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.109+0000 7fc71c400640 1 -- 172.21.15.88:0/2116118725 wait complete. 2024-04-24T08:25:53.132 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T08:25:53.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9d1e00640 1 Processor -- start 2024-04-24T08:25:53.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9d1e00640 1 -- start start 2024-04-24T08:25:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9d1e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b4c90 0x7fb9cc145f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9d1e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9cc06e490 0x7fb9cc1464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9d1e00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9cc06d4f0 con 0x7fb9cc09e090 2024-04-24T08:25:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9d1e00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb9cc06d2a0 con 0x7fb9cc06e490 2024-04-24T08:25:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9d1e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb9cc06d7d0 con 0x7fb9cc0b4c90 2024-04-24T08:25:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9c2000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9cc06e490 0x7fb9cc1464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9cb400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb9cc09e090 0x7fb9cc09e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50314/0 (socket says 172.21.15.88:50314) 2024-04-24T08:25:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9cb400640 1 -- 172.21.15.88:0/321112444 learned_addr learned my addr 172.21.15.88:0/321112444 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9caa00640 1 --2- 172.21.15.88:0/321112444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b4c90 0x7fb9cc145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9c2000640 1 -- 172.21.15.88:0/321112444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b4c90 msgr2=0x7fb9cc145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9c2000640 1 --2- 172.21.15.88:0/321112444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b4c90 0x7fb9cc145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9c2000640 1 -- 172.21.15.88:0/321112444 >> v1:172.21.15.88:6789/0 conn(0x7fb9cc09e090 legacy=0x7fb9cc09e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9c2000640 1 -- 172.21.15.88:0/321112444 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9cc09c570 con 0x7fb9cc06e490 2024-04-24T08:25:53.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.269+0000 7fb9ca000640 1 -- 172.21.15.88:0/321112444 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 781640953 0 0) 0x7fb9cc06d4f0 con 0x7fb9cc09e090 2024-04-24T08:25:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9c2000640 1 --2- 172.21.15.88:0/321112444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc06e490 0x7fb9cc1464c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40097c0 tx=0x7fb9b401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab462546675c96c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9ca000640 1 -- 172.21.15.88:0/321112444 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40b0070 con 0x7fb9cc06e490 2024-04-24T08:25:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9ca000640 1 -- 172.21.15.88:0/321112444 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b40ab600 con 0x7fb9cc06e490 2024-04-24T08:25:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9ca000640 1 -- 172.21.15.88:0/321112444 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40ab9d0 con 0x7fb9cc06e490 2024-04-24T08:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9d1e00640 1 -- 172.21.15.88:0/321112444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc06e490 msgr2=0x7fb9cc1464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9d1e00640 1 --2- 172.21.15.88:0/321112444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc06e490 0x7fb9cc1464c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40097c0 tx=0x7fb9b401c410 comp rx=0 tx=0).stop 2024-04-24T08:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9d1e00640 1 -- 172.21.15.88:0/321112444 shutdown_connections 2024-04-24T08:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9d1e00640 1 --2- 172.21.15.88:0/321112444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc06e490 0x7fb9cc1464c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9d1e00640 1 --2- 172.21.15.88:0/321112444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b4c90 0x7fb9cc145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9d1e00640 1 -- 172.21.15.88:0/321112444 >> 172.21.15.88:0/321112444 conn(0x7fb9cc0b9690 msgr2=0x7fb9cc0b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9d1e00640 1 -- 172.21.15.88:0/321112444 shutdown_connections 2024-04-24T08:25:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9d1e00640 1 -- 172.21.15.88:0/321112444 wait complete. 2024-04-24T08:25:53.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9d1e00640 1 Processor -- start 2024-04-24T08:25:53.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9d1e00640 1 -- start start 2024-04-24T08:25:53.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9d1e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc06e490 0x7fb9cc13d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.273+0000 7fb9d1e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc09e090 0x7fb9cc0b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9d1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9cc0b4c90 0x7fb9cc0af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9d1e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc152fc0 con 0x7fb9cc09e090 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9d1e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc152e40 con 0x7fb9cc0b4c90 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9d1e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb9cc153140 con 0x7fb9cc06e490 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c2000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc09e090 0x7fb9cc0b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c2000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc09e090 0x7fb9cc0b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59332/0 (socket says 172.21.15.88:59332) 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c2000640 1 -- 172.21.15.88:0/2428761184 learned_addr learned my addr 172.21.15.88:0/2428761184 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9caa00640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc06e490 0x7fb9cc13d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9cb400640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9cc0b4c90 0x7fb9cc0af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c2000640 1 -- 172.21.15.88:0/2428761184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc06e490 msgr2=0x7fb9cc13d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c2000640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc06e490 0x7fb9cc13d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c2000640 1 -- 172.21.15.88:0/2428761184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9cc0b4c90 msgr2=0x7fb9cc0af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c2000640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9cc0b4c90 0x7fb9cc0af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c2000640 1 -- 172.21.15.88:0/2428761184 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9cc13e690 con 0x7fb9cc09e090 2024-04-24T08:25:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c2000640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc09e090 0x7fb9cc0b0060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9b401a040 tx=0x7fb9b40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c3e00640 1 -- 172.21.15.88:0/2428761184 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40ba070 con 0x7fb9cc09e090 2024-04-24T08:25:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c3e00640 1 -- 172.21.15.88:0/2428761184 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b40b43f0 con 0x7fb9cc09e090 2024-04-24T08:25:53.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c3e00640 1 -- 172.21.15.88:0/2428761184 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40b0040 con 0x7fb9cc09e090 2024-04-24T08:25:53.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9d1e00640 1 -- 172.21.15.88:0/2428761184 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9cc0ae570 con 0x7fb9cc09e090 2024-04-24T08:25:53.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9d1e00640 1 -- 172.21.15.88:0/2428761184 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9cc13f260 con 0x7fb9cc09e090 2024-04-24T08:25:53.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9d1e00640 1 -- 172.21.15.88:0/2428761184 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9cc13ed90 con 0x7fb9cc09e090 2024-04-24T08:25:53.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c3e00640 1 -- 172.21.15.88:0/2428761184 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb9b40b47c0 con 0x7fb9cc09e090 2024-04-24T08:25:53.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.277+0000 7fb9c3e00640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb9a8068380 0x7fb9a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.281+0000 7fb9c3e00640 1 -- 172.21.15.88:0/2428761184 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb9b411faa0 con 0x7fb9cc09e090 2024-04-24T08:25:53.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.281+0000 7fb9caa00640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb9a8068380 0x7fb9a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.281+0000 7fb9caa00640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb9a8068380 0x7fb9a806a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0073f0 tx=0x7fb9bc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:53.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.281+0000 7fb9c3e00640 1 -- 172.21.15.88:0/2428761184 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb9b4016090 con 0x7fb9cc09e090 2024-04-24T08:25:53.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 -- 172.21.15.88:0/2428761184 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb9cc068c00 con 0x7fb9cc09e090 2024-04-24T08:25:53.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9c3e00640 1 -- 172.21.15.88:0/2428761184 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fb9b40effc0 con 0x7fb9cc09e090 2024-04-24T08:25:53.443 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-24T08:25:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 -- 172.21.15.88:0/2428761184 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb9a8068380 msgr2=0x7fb9a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb9a8068380 0x7fb9a806a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0073f0 tx=0x7fb9bc00b040 comp rx=0 tx=0).stop 2024-04-24T08:25:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 -- 172.21.15.88:0/2428761184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc09e090 msgr2=0x7fb9cc0b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc09e090 0x7fb9cc0b0060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9b401a040 tx=0x7fb9b40191b0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 -- 172.21.15.88:0/2428761184 shutdown_connections 2024-04-24T08:25:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb9a8068380 0x7fb9a806a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9cc0b4c90 0x7fb9cc0af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc09e090 0x7fb9cc0b0060 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 --2- 172.21.15.88:0/2428761184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc06e490 0x7fb9cc13d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 -- 172.21.15.88:0/2428761184 >> 172.21.15.88:0/2428761184 conn(0x7fb9cc0b9690 msgr2=0x7fb9cc0b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:53.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 -- 172.21.15.88:0/2428761184 shutdown_connections 2024-04-24T08:25:53.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.441+0000 7fb9d1e00640 1 -- 172.21.15.88:0/2428761184 wait complete. 2024-04-24T08:25:53.464 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T08:25:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7467e00640 1 Processor -- start 2024-04-24T08:25:53.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7467e00640 1 -- start start 2024-04-24T08:25:53.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7467e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600ae4e0 0x7f746013e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7467e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f74600737c0 0x7f746013eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7467e00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74600b0580 con 0x7f74600b01a0 2024-04-24T08:25:53.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7467e00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f74600b59d0 con 0x7f74600737c0 2024-04-24T08:25:53.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7467e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f74600ae970 con 0x7f74600ae4e0 2024-04-24T08:25:53.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7465400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f74600b01a0 0x7f746006d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50330/0 (socket says 172.21.15.88:50330) 2024-04-24T08:25:53.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7465400640 1 -- 172.21.15.88:0/3077039827 learned_addr learned my addr 172.21.15.88:0/3077039827 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:53.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7465e00640 1 --2- 172.21.15.88:0/3077039827 >> v2:172.21.15.88:3300/0 conn(0x7f74600737c0 0x7f746013eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7464a00640 1 --2- 172.21.15.88:0/3077039827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600ae4e0 0x7f746013e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7465e00640 1 -- 172.21.15.88:0/3077039827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600ae4e0 msgr2=0x7f746013e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:53.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7465e00640 1 --2- 172.21.15.88:0/3077039827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600ae4e0 0x7f746013e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7465e00640 1 -- 172.21.15.88:0/3077039827 >> v1:172.21.15.88:6789/0 conn(0x7f74600b01a0 legacy=0x7f746006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.601+0000 7f7465e00640 1 -- 172.21.15.88:0/3077039827 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74600b53a0 con 0x7f74600737c0 2024-04-24T08:25:53.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f7465e00640 1 --2- 172.21.15.88:0/3077039827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74600737c0 0x7f746013eec0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7458009d90 tx=0x7f745801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2861c4fab40fcca1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:53.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f745fe00640 1 -- 172.21.15.88:0/3077039827 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74580b2070 con 0x7f74600737c0 2024-04-24T08:25:53.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f745fe00640 1 -- 172.21.15.88:0/3077039827 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74580a5820 con 0x7f74600737c0 2024-04-24T08:25:53.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f745fe00640 1 -- 172.21.15.88:0/3077039827 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746006e470 con 0x7f74600737c0 2024-04-24T08:25:53.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f7467e00640 1 -- 172.21.15.88:0/3077039827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74600737c0 msgr2=0x7f746013eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f7467e00640 1 --2- 172.21.15.88:0/3077039827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74600737c0 0x7f746013eec0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7458009d90 tx=0x7f745801c850 comp rx=0 tx=0).stop 2024-04-24T08:25:53.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f7467e00640 1 -- 172.21.15.88:0/3077039827 shutdown_connections 2024-04-24T08:25:53.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f7467e00640 1 --2- 172.21.15.88:0/3077039827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74600737c0 0x7f746013eec0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f7467e00640 1 --2- 172.21.15.88:0/3077039827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600ae4e0 0x7f746013e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f7467e00640 1 -- 172.21.15.88:0/3077039827 >> 172.21.15.88:0/3077039827 conn(0x7f74600b9690 msgr2=0x7f74600b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:53.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f7467e00640 1 -- 172.21.15.88:0/3077039827 shutdown_connections 2024-04-24T08:25:53.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f7467e00640 1 -- 172.21.15.88:0/3077039827 wait complete. 2024-04-24T08:25:53.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f7467e00640 1 Processor -- start 2024-04-24T08:25:53.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.605+0000 7f7467e00640 1 -- start start 2024-04-24T08:25:53.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7467e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600737c0 0x7f74601366c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7467e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74600b01a0 0x7f7460139f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7467e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f746013a450 0x7f74601387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7467e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7460151fe0 con 0x7f746013a450 2024-04-24T08:25:53.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7467e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7460151e60 con 0x7f74600b01a0 2024-04-24T08:25:53.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7467e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7460152160 con 0x7f74600737c0 2024-04-24T08:25:53.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7465e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f746013a450 0x7f74601387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7465e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f746013a450 0x7f74601387f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59348/0 (socket says 172.21.15.88:59348) 2024-04-24T08:25:53.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7465e00640 1 -- 172.21.15.88:0/3860314783 learned_addr learned my addr 172.21.15.88:0/3860314783 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:53.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7465400640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600737c0 0x7f74601366c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7464a00640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74600b01a0 0x7f7460139f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7465e00640 1 -- 172.21.15.88:0/3860314783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600737c0 msgr2=0x7f74601366c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7465e00640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600737c0 0x7f74601366c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7465e00640 1 -- 172.21.15.88:0/3860314783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74600b01a0 msgr2=0x7f7460139f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7465e00640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74600b01a0 0x7f7460139f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7465e00640 1 -- 172.21.15.88:0/3860314783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746013a8a0 con 0x7f746013a450 2024-04-24T08:25:53.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7464a00640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74600b01a0 0x7f7460139f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:53.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7465e00640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f746013a450 0x7f74601387f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f74580b0040 tx=0x7f74580195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:53.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f745d600640 1 -- 172.21.15.88:0/3860314783 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74580b2050 con 0x7f746013a450 2024-04-24T08:25:53.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f745d600640 1 -- 172.21.15.88:0/3860314783 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74580be070 con 0x7f746013a450 2024-04-24T08:25:53.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f745d600640 1 -- 172.21.15.88:0/3860314783 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74580ada70 con 0x7f746013a450 2024-04-24T08:25:53.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7467e00640 1 -- 172.21.15.88:0/3860314783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746013ab30 con 0x7f746013a450 2024-04-24T08:25:53.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7467e00640 1 -- 172.21.15.88:0/3860314783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746009e160 con 0x7f746013a450 2024-04-24T08:25:53.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f7467e00640 1 -- 172.21.15.88:0/3860314783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7460068c00 con 0x7f746013a450 2024-04-24T08:25:53.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.609+0000 7f745d600640 1 -- 172.21.15.88:0/3860314783 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f74580adc10 con 0x7f746013a450 2024-04-24T08:25:53.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.613+0000 7f745d600640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7440068400 0x7f744006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.613+0000 7f745d600640 1 -- 172.21.15.88:0/3860314783 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7458121a80 con 0x7f746013a450 2024-04-24T08:25:53.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.613+0000 7f7465400640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7440068400 0x7f744006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.613+0000 7f7465400640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7440068400 0x7f744006a8c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7460136e10 tx=0x7f7454009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:53.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.617+0000 7f745d600640 1 -- 172.21.15.88:0/3860314783 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7458123e20 con 0x7f746013a450 2024-04-24T08:25:53.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.769+0000 7f7467e00640 1 -- 172.21.15.88:0/3860314783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f746013d1e0 con 0x7f746013a450 2024-04-24T08:25:53.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.769+0000 7f745d600640 1 -- 172.21.15.88:0/3860314783 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f7458016560 con 0x7f746013a450 2024-04-24T08:25:53.773 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-24T08:25:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.773+0000 7f7467e00640 1 -- 172.21.15.88:0/3860314783 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7440068400 msgr2=0x7f744006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.773+0000 7f7467e00640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7440068400 0x7f744006a8c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7460136e10 tx=0x7f7454009040 comp rx=0 tx=0).stop 2024-04-24T08:25:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.773+0000 7f7467e00640 1 -- 172.21.15.88:0/3860314783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f746013a450 msgr2=0x7f74601387f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.773+0000 7f7467e00640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f746013a450 0x7f74601387f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f74580b0040 tx=0x7f74580195f0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.773+0000 7f7467e00640 1 -- 172.21.15.88:0/3860314783 shutdown_connections 2024-04-24T08:25:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.773+0000 7f7467e00640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7440068400 0x7f744006a8c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.773+0000 7f7467e00640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f746013a450 0x7f74601387f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.773+0000 7f7467e00640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74600b01a0 0x7f7460139f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.773+0000 7f7467e00640 1 --2- 172.21.15.88:0/3860314783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600737c0 0x7f74601366c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.773+0000 7f7467e00640 1 -- 172.21.15.88:0/3860314783 >> 172.21.15.88:0/3860314783 conn(0x7f74600b9690 msgr2=0x7f746013bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:53.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.773+0000 7f7467e00640 1 -- 172.21.15.88:0/3860314783 shutdown_connections 2024-04-24T08:25:53.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.773+0000 7f7467e00640 1 -- 172.21.15.88:0/3860314783 wait complete. 2024-04-24T08:25:53.794 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T08:25:53.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed8200640 1 Processor -- start 2024-04-24T08:25:53.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed8200640 1 -- start start 2024-04-24T08:25:53.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed8200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 0x7f7ed00b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed8200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ed00b44b0 0x7f7ed00b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed8200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed00b0ab0 con 0x7f7ed0141e80 2024-04-24T08:25:53.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed8200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed00afdb0 con 0x7f7ed00b44b0 2024-04-24T08:25:53.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed8200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed0067e50 con 0x7f7ed0067a70 2024-04-24T08:25:53.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed5800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 0x7f7ed00b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed4e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ed00b44b0 0x7f7ed00b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed6200640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7ed0141e80 0x7f7ed006bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:50246/0 (socket says 172.21.15.88:50246) 2024-04-24T08:25:53.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed6200640 1 -- 172.21.15.88:0/1610152983 learned_addr learned my addr 172.21.15.88:0/1610152983 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:53.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed5800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 0x7f7ed00b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:60138/0 (socket says 172.21.15.88:60138) 2024-04-24T08:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.929+0000 7f7ed4e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ed00b44b0 0x7f7ed00b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:43196/0 (socket says 172.21.15.88:43196) 2024-04-24T08:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.933+0000 7f7ed5800640 1 -- 172.21.15.88:0/1610152983 >> v2:172.21.15.142:3300/0 conn(0x7f7ed00b44b0 msgr2=0x7f7ed00b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.933+0000 7f7ecfe00640 1 -- 172.21.15.88:0/1610152983 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885543702 0 0) 0x7f7ed00b0ab0 con 0x7f7ed0141e80 2024-04-24T08:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.933+0000 7f7ed5800640 1 --2- 172.21.15.88:0/1610152983 >> v2:172.21.15.142:3300/0 conn(0x7f7ed00b44b0 0x7f7ed00b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.933+0000 7f7ed5800640 1 -- 172.21.15.88:0/1610152983 >> v1:172.21.15.142:6789/0 conn(0x7f7ed0141e80 legacy=0x7f7ed006bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.933+0000 7f7ed5800640 1 -- 172.21.15.88:0/1610152983 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed00b5b60 con 0x7f7ed0067a70 2024-04-24T08:25:53.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.933+0000 7f7ed5800640 1 --2- 172.21.15.88:0/1610152983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 0x7f7ed00b5560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009d90 tx=0x7f7ec401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b037913b5f7b026 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:53.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.933+0000 7f7ecfe00640 1 -- 172.21.15.88:0/1610152983 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40b2070 con 0x7f7ed0067a70 2024-04-24T08:25:53.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.933+0000 7f7ecfe00640 1 -- 172.21.15.88:0/1610152983 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec40a5830 con 0x7f7ed0067a70 2024-04-24T08:25:53.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.933+0000 7f7ecfe00640 1 -- 172.21.15.88:0/1610152983 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40a5c00 con 0x7f7ed0067a70 2024-04-24T08:25:53.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 -- 172.21.15.88:0/1610152983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 msgr2=0x7f7ed00b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 --2- 172.21.15.88:0/1610152983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 0x7f7ed00b5560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009d90 tx=0x7f7ec401c970 comp rx=0 tx=0).stop 2024-04-24T08:25:53.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 -- 172.21.15.88:0/1610152983 shutdown_connections 2024-04-24T08:25:53.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 --2- 172.21.15.88:0/1610152983 >> v2:172.21.15.142:3300/0 conn(0x7f7ed00b44b0 0x7f7ed00b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 --2- 172.21.15.88:0/1610152983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 0x7f7ed00b5560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 -- 172.21.15.88:0/1610152983 >> 172.21.15.88:0/1610152983 conn(0x7f7ed00b9c80 msgr2=0x7f7ed00ba090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:53.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 -- 172.21.15.88:0/1610152983 shutdown_connections 2024-04-24T08:25:53.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 -- 172.21.15.88:0/1610152983 wait complete. 2024-04-24T08:25:53.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 Processor -- start 2024-04-24T08:25:53.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 -- start start 2024-04-24T08:25:53.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 0x7f7ed0149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ed00b44b0 0x7f7ed014b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed0141e80 0x7f7ed01347c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01557a0 con 0x7f7ed00b44b0 2024-04-24T08:25:53.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed009fee0 con 0x7f7ed0141e80 2024-04-24T08:25:53.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed0155920 con 0x7f7ed0067a70 2024-04-24T08:25:53.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed4e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ed00b44b0 0x7f7ed014b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed4e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ed00b44b0 0x7f7ed014b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59356/0 (socket says 172.21.15.88:59356) 2024-04-24T08:25:53.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed4e00640 1 -- 172.21.15.88:0/225769580 learned_addr learned my addr 172.21.15.88:0/225769580 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:53.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed5800640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 0x7f7ed0149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed6200640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed0141e80 0x7f7ed01347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed4e00640 1 -- 172.21.15.88:0/225769580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 msgr2=0x7f7ed0149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed4e00640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 0x7f7ed0149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed4e00640 1 -- 172.21.15.88:0/225769580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed0141e80 msgr2=0x7f7ed01347c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:53.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed4e00640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed0141e80 0x7f7ed01347c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:53.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed4e00640 1 -- 172.21.15.88:0/225769580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed01e12b0 con 0x7f7ed00b44b0 2024-04-24T08:25:53.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed5800640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 0x7f7ed0149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:53.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed6200640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed0141e80 0x7f7ed01347c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:53.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed4e00640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ed00b44b0 0x7f7ed014b350 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00e900 tx=0x7f7ebc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:53.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ecd600640 1 -- 172.21.15.88:0/225769580 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc017070 con 0x7f7ed00b44b0 2024-04-24T08:25:53.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ecd600640 1 -- 172.21.15.88:0/225769580 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ebc00ca00 con 0x7f7ed00b44b0 2024-04-24T08:25:53.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 -- 172.21.15.88:0/225769580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed01e1a70 con 0x7f7ed00b44b0 2024-04-24T08:25:53.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ecd600640 1 -- 172.21.15.88:0/225769580 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc00cdf0 con 0x7f7ed00b44b0 2024-04-24T08:25:53.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.937+0000 7f7ed8200640 1 -- 172.21.15.88:0/225769580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed00b3b50 con 0x7f7ed00b44b0 2024-04-24T08:25:53.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.941+0000 7f7ed8200640 1 -- 172.21.15.88:0/225769580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed006cd50 con 0x7f7ed00b44b0 2024-04-24T08:25:53.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.941+0000 7f7ecd600640 1 -- 172.21.15.88:0/225769580 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ebc01a070 con 0x7f7ed00b44b0 2024-04-24T08:25:53.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.941+0000 7f7ecd600640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7eb0068380 0x7f7eb006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:53.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.941+0000 7f7ecd600640 1 -- 172.21.15.88:0/225769580 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7ebc0869f0 con 0x7f7ed00b44b0 2024-04-24T08:25:53.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.941+0000 7f7ed5800640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7eb0068380 0x7f7eb006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:53.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.941+0000 7f7ed5800640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7eb0068380 0x7f7eb006a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7ec40af000 tx=0x7f7ec40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:53.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:53.945+0000 7f7ecd600640 1 -- 172.21.15.88:0/225769580 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7ebc056fa0 con 0x7f7ed00b44b0 2024-04-24T08:25:54.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.113+0000 7f7ed8200640 1 -- 172.21.15.88:0/225769580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7ed0068b20 con 0x7f7ed00b44b0 2024-04-24T08:25:54.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ecd600640 1 -- 172.21.15.88:0/225769580 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f7ebc0568a0 con 0x7f7ed00b44b0 2024-04-24T08:25:54.117 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2024-04-24T08:25:54.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ed8200640 1 -- 172.21.15.88:0/225769580 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7eb0068380 msgr2=0x7f7eb006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ed8200640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7eb0068380 0x7f7eb006a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7ec40af000 tx=0x7f7ec40a7070 comp rx=0 tx=0).stop 2024-04-24T08:25:54.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ed8200640 1 -- 172.21.15.88:0/225769580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ed00b44b0 msgr2=0x7f7ed014b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ed8200640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ed00b44b0 0x7f7ed014b350 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00e900 tx=0x7f7ebc00edc0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ed8200640 1 -- 172.21.15.88:0/225769580 shutdown_connections 2024-04-24T08:25:54.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ed8200640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7eb0068380 0x7f7eb006a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ed8200640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed0141e80 0x7f7ed01347c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ed8200640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ed00b44b0 0x7f7ed014b350 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ed8200640 1 --2- 172.21.15.88:0/225769580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed0067a70 0x7f7ed0149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ed8200640 1 -- 172.21.15.88:0/225769580 >> 172.21.15.88:0/225769580 conn(0x7f7ed00b9c80 msgr2=0x7f7ed0070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:54.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ed8200640 1 -- 172.21.15.88:0/225769580 shutdown_connections 2024-04-24T08:25:54.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.117+0000 7f7ed8200640 1 -- 172.21.15.88:0/225769580 wait complete. 2024-04-24T08:25:54.139 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:25:54.139 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T08:25:54.147 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:54.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8273800640 1 Processor -- start 2024-04-24T08:25:54.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8273800640 1 -- start start 2024-04-24T08:25:54.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8273800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f826c06e720 0x7f826c0b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8273800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f826c06cbe0 0x7f826c0b7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8273800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c14c2c0 0x7f826c0b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8273800640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f826c14be30 con 0x7f826c06e720 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8273800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f826c06eb00 con 0x7f826c06cbe0 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8273800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f826c14b7e0 con 0x7f826c14c2c0 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8270e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f826c06e720 0x7f826c0b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8270e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f826c06e720 0x7f826c0b7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59370/0 (socket says 172.21.15.88:59370) 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8270e00640 1 -- 172.21.15.88:0/3847700694 learned_addr learned my addr 172.21.15.88:0/3847700694 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f826be00640 1 --2- 172.21.15.88:0/3847700694 >> v2:172.21.15.142:3300/0 conn(0x7f826c06cbe0 0x7f826c0b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8271800640 1 --2- 172.21.15.88:0/3847700694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c14c2c0 0x7f826c0b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8270e00640 1 -- 172.21.15.88:0/3847700694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c14c2c0 msgr2=0x7f826c0b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8270e00640 1 --2- 172.21.15.88:0/3847700694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c14c2c0 0x7f826c0b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8270e00640 1 -- 172.21.15.88:0/3847700694 >> v2:172.21.15.142:3300/0 conn(0x7f826c06cbe0 msgr2=0x7f826c0b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:54.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8270e00640 1 --2- 172.21.15.88:0/3847700694 >> v2:172.21.15.142:3300/0 conn(0x7f826c06cbe0 0x7f826c0b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.321+0000 7f8270e00640 1 -- 172.21.15.88:0/3847700694 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c14bac0 con 0x7f826c06e720 2024-04-24T08:25:54.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f8270e00640 1 --2- 172.21.15.88:0/3847700694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c06e720 0x7f826c0b7010 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f826c0bc620 tx=0x7f825c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10577c467de2524b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:54.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f826b400640 1 -- 172.21.15.88:0/3847700694 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c0b0070 con 0x7f826c06e720 2024-04-24T08:25:54.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f826b400640 1 -- 172.21.15.88:0/3847700694 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825c0ab600 con 0x7f826c06e720 2024-04-24T08:25:54.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f826b400640 1 -- 172.21.15.88:0/3847700694 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c0ab9d0 con 0x7f826c06e720 2024-04-24T08:25:54.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f8273800640 1 -- 172.21.15.88:0/3847700694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c06e720 msgr2=0x7f826c0b7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f8273800640 1 --2- 172.21.15.88:0/3847700694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c06e720 0x7f826c0b7010 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f826c0bc620 tx=0x7f825c01c400 comp rx=0 tx=0).stop 2024-04-24T08:25:54.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f8273800640 1 -- 172.21.15.88:0/3847700694 shutdown_connections 2024-04-24T08:25:54.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f8273800640 1 --2- 172.21.15.88:0/3847700694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c14c2c0 0x7f826c0b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f8273800640 1 --2- 172.21.15.88:0/3847700694 >> v2:172.21.15.142:3300/0 conn(0x7f826c06cbe0 0x7f826c0b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f8273800640 1 --2- 172.21.15.88:0/3847700694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c06e720 0x7f826c0b7010 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f8273800640 1 -- 172.21.15.88:0/3847700694 >> 172.21.15.88:0/3847700694 conn(0x7f826c067810 msgr2=0x7f826c067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:54.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f8273800640 1 -- 172.21.15.88:0/3847700694 shutdown_connections 2024-04-24T08:25:54.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f8273800640 1 -- 172.21.15.88:0/3847700694 wait complete. 2024-04-24T08:25:54.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.325+0000 7f8273800640 1 Processor -- start 2024-04-24T08:25:54.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8273800640 1 -- start start 2024-04-24T08:25:54.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8273800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c06cbe0 0x7f826c144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8273800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f826c06e720 0x7f826c145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8273800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c14c2c0 0x7f826c142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8273800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f826c148d20 con 0x7f826c06cbe0 2024-04-24T08:25:54.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8273800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f826c148ba0 con 0x7f826c06e720 2024-04-24T08:25:54.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8273800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f826c148ea0 con 0x7f826c14c2c0 2024-04-24T08:25:54.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8270e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c06cbe0 0x7f826c144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8270e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c06cbe0 0x7f826c144510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59374/0 (socket says 172.21.15.88:59374) 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8270e00640 1 -- 172.21.15.88:0/1143876682 learned_addr learned my addr 172.21.15.88:0/1143876682 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f826be00640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f826c06e720 0x7f826c145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8271800640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c14c2c0 0x7f826c142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8270e00640 1 -- 172.21.15.88:0/1143876682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c14c2c0 msgr2=0x7f826c142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8270e00640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c14c2c0 0x7f826c142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8270e00640 1 -- 172.21.15.88:0/1143876682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f826c06e720 msgr2=0x7f826c145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8270e00640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f826c06e720 0x7f826c145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8270e00640 1 -- 172.21.15.88:0/1143876682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c0aebc0 con 0x7f826c06cbe0 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8270e00640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c06cbe0 0x7f826c144510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f825c01aab0 tx=0x7f825c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8268c00640 1 -- 172.21.15.88:0/1143876682 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c0b0040 con 0x7f826c06cbe0 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8268c00640 1 -- 172.21.15.88:0/1143876682 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825c0b9070 con 0x7f826c06cbe0 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8268c00640 1 -- 172.21.15.88:0/1143876682 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c0b4840 con 0x7f826c06cbe0 2024-04-24T08:25:54.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8273800640 1 -- 172.21.15.88:0/1143876682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826c144bb0 con 0x7f826c06cbe0 2024-04-24T08:25:54.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8273800640 1 -- 172.21.15.88:0/1143876682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f826c145b70 con 0x7f826c06cbe0 2024-04-24T08:25:54.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.329+0000 7f8273800640 1 -- 172.21.15.88:0/1143876682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f826c068b90 con 0x7f826c06cbe0 2024-04-24T08:25:54.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.333+0000 7f8268c00640 1 -- 172.21.15.88:0/1143876682 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f825c0b49e0 con 0x7f826c06cbe0 2024-04-24T08:25:54.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.333+0000 7f8268c00640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f824c068380 0x7f824c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.333+0000 7f8268c00640 1 -- 172.21.15.88:0/1143876682 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f825c120680 con 0x7f826c06cbe0 2024-04-24T08:25:54.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.333+0000 7f826be00640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f824c068380 0x7f824c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.333+0000 7f826be00640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f824c068380 0x7f824c06a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f826c146080 tx=0x7f8258008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:54.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.337+0000 7f8268c00640 1 -- 172.21.15.88:0/1143876682 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f825c016110 con 0x7f826c06cbe0 2024-04-24T08:25:54.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.493+0000 7f8273800640 1 -- 172.21.15.88:0/1143876682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f826c1e41a0 con 0x7f826c06cbe0 2024-04-24T08:25:54.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.493+0000 7f8268c00640 1 -- 172.21.15.88:0/1143876682 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f825c0f0df0 con 0x7f826c06cbe0 2024-04-24T08:25:54.495 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:54.496 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:54.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.497+0000 7f8273800640 1 -- 172.21.15.88:0/1143876682 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f824c068380 msgr2=0x7f824c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.497+0000 7f8273800640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f824c068380 0x7f824c06a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f826c146080 tx=0x7f8258008040 comp rx=0 tx=0).stop 2024-04-24T08:25:54.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.497+0000 7f8273800640 1 -- 172.21.15.88:0/1143876682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c06cbe0 msgr2=0x7f826c144510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.497+0000 7f8273800640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c06cbe0 0x7f826c144510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f825c01aab0 tx=0x7f825c0191a0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.497+0000 7f8273800640 1 -- 172.21.15.88:0/1143876682 shutdown_connections 2024-04-24T08:25:54.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.497+0000 7f8273800640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f824c068380 0x7f824c06a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.497+0000 7f8273800640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c14c2c0 0x7f826c142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.497+0000 7f8273800640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f826c06e720 0x7f826c145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.497+0000 7f8273800640 1 --2- 172.21.15.88:0/1143876682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c06cbe0 0x7f826c144510 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.497+0000 7f8273800640 1 -- 172.21.15.88:0/1143876682 >> 172.21.15.88:0/1143876682 conn(0x7f826c067810 msgr2=0x7f826c0ba130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:54.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.497+0000 7f8273800640 1 -- 172.21.15.88:0/1143876682 shutdown_connections 2024-04-24T08:25:54.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.497+0000 7f8273800640 1 -- 172.21.15.88:0/1143876682 wait complete. 2024-04-24T08:25:54.517 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T08:25:25.116395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T08:25:26.444475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:25:54.517 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:25:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37fa600640 1 Processor -- start 2024-04-24T08:25:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37fa600640 1 -- start start 2024-04-24T08:25:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37fa600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37f4148330 0x7f37f4148780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37fa600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37f4148cc0 con 0x7f37f40b1560 2024-04-24T08:25:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37fa600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37f409b360 con 0x7f37f40b1180 2024-04-24T08:25:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37fa600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f37f40b6d70 con 0x7f37f4148330 2024-04-24T08:25:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2a00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f37f40b1560 0x7f37f409aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50340/0 (socket says 172.21.15.88:50340) 2024-04-24T08:25:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2a00640 1 -- 172.21.15.88:0/891763295 learned_addr learned my addr 172.21.15.88:0/891763295 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f3e00640 1 --2- 172.21.15.88:0/891763295 >> v2:172.21.15.142:3300/0 conn(0x7f37f4148330 0x7f37f4148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420782839 0 0) 0x7f37f4148cc0 con 0x7f37f40b1560 2024-04-24T08:25:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37d8003530 con 0x7f37f40b1560 2024-04-24T08:25:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 921656227 0 0) 0x7f37d8003530 con 0x7f37f40b1560 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 >> v2:172.21.15.142:3300/0 conn(0x7f37f4148330 msgr2=0x7f37f4148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 --2- 172.21.15.88:0/891763295 >> v2:172.21.15.142:3300/0 conn(0x7f37f4148330 0x7f37f4148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 >> v1:172.21.15.142:6789/0 conn(0x7f37f40b1180 legacy=0x7f37f40b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f409b640 con 0x7f37f40b1560 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f37e0001680 con 0x7f37f40b1560 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 >> v1:172.21.15.88:6789/0 conn(0x7f37f40b1560 legacy=0x7f37f409aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 --2- 172.21.15.88:0/891763295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37d80039c0 0x7f37d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 --2- 172.21.15.88:0/891763295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37d8004810 0x7f37d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 --2- 172.21.15.88:0/891763295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 0x7f37d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f37d800c190 con 0x7f37d80052f0 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f37d800c340 con 0x7f37d80039c0 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f37d800c540 con 0x7f37d8004810 2024-04-24T08:25:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f3e00640 1 --2- 172.21.15.88:0/891763295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 0x7f37d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f3400640 1 --2- 172.21.15.88:0/891763295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37d80039c0 0x7f37d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f2a00640 1 --2- 172.21.15.88:0/891763295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37d8004810 0x7f37d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f3e00640 1 -- 172.21.15.88:0/891763295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37d8004810 msgr2=0x7f37d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:54.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f3e00640 1 --2- 172.21.15.88:0/891763295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37d8004810 0x7f37d8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f3e00640 1 -- 172.21.15.88:0/891763295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37d80039c0 msgr2=0x7f37d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:54.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f3e00640 1 --2- 172.21.15.88:0/891763295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37d80039c0 0x7f37d8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.653+0000 7f37f3e00640 1 -- 172.21.15.88:0/891763295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d8003530 con 0x7f37d80052f0 2024-04-24T08:25:54.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.657+0000 7f37f3e00640 1 -- 172.21.15.88:0/891763295 reap_dead start 2024-04-24T08:25:54.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.657+0000 7f37f3e00640 1 --2- 172.21.15.88:0/891763295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 0x7f37d800b9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009f90 tx=0x7f37ec01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736be8bf154cc2d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:54.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.657+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec009c10 con 0x7f37d80052f0 2024-04-24T08:25:54.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.657+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ec003ba0 con 0x7f37d80052f0 2024-04-24T08:25:54.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.657+0000 7f37f2000640 1 -- 172.21.15.88:0/891763295 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec0a5770 con 0x7f37d80052f0 2024-04-24T08:25:54.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.657+0000 7f37fa600640 1 -- 172.21.15.88:0/891763295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 msgr2=0x7f37d800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.657+0000 7f37fa600640 1 --2- 172.21.15.88:0/891763295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 0x7f37d800b9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009f90 tx=0x7f37ec01cc80 comp rx=0 tx=0).stop 2024-04-24T08:25:54.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.657+0000 7f37fa600640 1 -- 172.21.15.88:0/891763295 shutdown_connections 2024-04-24T08:25:54.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.657+0000 7f37fa600640 1 --2- 172.21.15.88:0/891763295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 0x7f37d800b9d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.657+0000 7f37fa600640 1 -- 172.21.15.88:0/891763295 >> 172.21.15.88:0/891763295 conn(0x7f37f409c360 msgr2=0x7f37f409c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:54.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.657+0000 7f37fa600640 1 -- 172.21.15.88:0/891763295 shutdown_connections 2024-04-24T08:25:54.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.657+0000 7f37fa600640 1 -- 172.21.15.88:0/891763295 wait complete. 2024-04-24T08:25:54.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37fa600640 1 Processor -- start 2024-04-24T08:25:54.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37fa600640 1 -- start start 2024-04-24T08:25:54.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37fa600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 0x7f37f40727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37fa600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37f414e930 0x7f37f41e36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37fa600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37f414edb0 0x7f37f41e3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37fa600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f37f4148ad0 con 0x7f37d80052f0 2024-04-24T08:25:54.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37fa600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f37f4148950 con 0x7f37f414e930 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37fa600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f37f40b5690 con 0x7f37f414edb0 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37f3400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 0x7f37f40727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37f3400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 0x7f37f40727a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59396/0 (socket says 172.21.15.88:59396) 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37f3400640 1 -- 172.21.15.88:0/658305818 learned_addr learned my addr 172.21.15.88:0/658305818 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37f3e00640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37f414edb0 0x7f37f41e3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37f2a00640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37f414e930 0x7f37f41e36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37f3400640 1 -- 172.21.15.88:0/658305818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37f414edb0 msgr2=0x7f37f41e3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37f3400640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37f414edb0 0x7f37f41e3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37f3400640 1 -- 172.21.15.88:0/658305818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37f414e930 msgr2=0x7f37f41e36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37f3400640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37f414e930 0x7f37f41e36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37f3400640 1 -- 172.21.15.88:0/658305818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f409e4b0 con 0x7f37d80052f0 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37f2a00640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37f414e930 0x7f37f41e36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:54.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37f3400640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 0x7f37f40727a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f37e400f850 tx=0x7f37e400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:54.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37eb400640 1 -- 172.21.15.88:0/658305818 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4001cf0 con 0x7f37d80052f0 2024-04-24T08:25:54.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37eb400640 1 -- 172.21.15.88:0/658305818 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e4018070 con 0x7f37d80052f0 2024-04-24T08:25:54.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37eb400640 1 -- 172.21.15.88:0/658305818 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e400d730 con 0x7f37d80052f0 2024-04-24T08:25:54.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37fa600640 1 -- 172.21.15.88:0/658305818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f4072fe0 con 0x7f37d80052f0 2024-04-24T08:25:54.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.661+0000 7f37fa600640 1 -- 172.21.15.88:0/658305818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f4150070 con 0x7f37d80052f0 2024-04-24T08:25:54.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.665+0000 7f37fa600640 1 -- 172.21.15.88:0/658305818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f4068c00 con 0x7f37d80052f0 2024-04-24T08:25:54.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.665+0000 7f37eb400640 1 -- 172.21.15.88:0/658305818 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f37e400d8d0 con 0x7f37d80052f0 2024-04-24T08:25:54.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.665+0000 7f37eb400640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f37d4068380 0x7f37d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.665+0000 7f37eb400640 1 -- 172.21.15.88:0/658305818 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f37e40867d0 con 0x7f37d80052f0 2024-04-24T08:25:54.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.665+0000 7f37f2a00640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f37d4068380 0x7f37d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.665+0000 7f37f2a00640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f37d4068380 0x7f37d406a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f37f4141c20 tx=0x7f37e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:54.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.669+0000 7f37eb400640 1 -- 172.21.15.88:0/658305818 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f37e4056cf0 con 0x7f37d80052f0 2024-04-24T08:25:54.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.825+0000 7f37fa600640 1 -- 172.21.15.88:0/658305818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f37f4148ed0 con 0x7f37d80052f0 2024-04-24T08:25:54.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.825+0000 7f37eb400640 1 -- 172.21.15.88:0/658305818 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f37e40565f0 con 0x7f37d80052f0 2024-04-24T08:25:54.828 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:25:54.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.829+0000 7f37fa600640 1 -- 172.21.15.88:0/658305818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f37d4068380 msgr2=0x7f37d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.829+0000 7f37fa600640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f37d4068380 0x7f37d406a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f37f4141c20 tx=0x7f37e0009040 comp rx=0 tx=0).stop 2024-04-24T08:25:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.829+0000 7f37fa600640 1 -- 172.21.15.88:0/658305818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 msgr2=0x7f37f40727a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.829+0000 7f37fa600640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 0x7f37f40727a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f37e400f850 tx=0x7f37e400fd10 comp rx=0 tx=0).stop 2024-04-24T08:25:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.829+0000 7f37fa600640 1 -- 172.21.15.88:0/658305818 shutdown_connections 2024-04-24T08:25:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.829+0000 7f37fa600640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f37d4068380 0x7f37d406a840 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.829+0000 7f37fa600640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37f414edb0 0x7f37f41e3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.829+0000 7f37fa600640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37f414e930 0x7f37f41e36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.829+0000 7f37fa600640 1 --2- 172.21.15.88:0/658305818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37d80052f0 0x7f37f40727a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.829+0000 7f37fa600640 1 -- 172.21.15.88:0/658305818 >> 172.21.15.88:0/658305818 conn(0x7f37f409c360 msgr2=0x7f37f4074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.829+0000 7f37fa600640 1 -- 172.21.15.88:0/658305818 shutdown_connections 2024-04-24T08:25:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.829+0000 7f37fa600640 1 -- 172.21.15.88:0/658305818 wait complete. 2024-04-24T08:25:54.848 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T08:25:54.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa625a00640 1 Processor -- start 2024-04-24T08:25:54.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa625a00640 1 -- start start 2024-04-24T08:25:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa625a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6200b4c90 0x7fa620145f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa625a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62009e7a0 0x7fa6201464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa625a00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62006d4f0 con 0x7fa62006e490 2024-04-24T08:25:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa625a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa62006d2a0 con 0x7fa6200b4c90 2024-04-24T08:25:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa625a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa62006d7d0 con 0x7fa62009e7a0 2024-04-24T08:25:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa61e000640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa62006e490 0x7fa62009e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50350/0 (socket says 172.21.15.88:50350) 2024-04-24T08:25:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa61e000640 1 -- 172.21.15.88:0/1761242518 learned_addr learned my addr 172.21.15.88:0/1761242518 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa61ea00640 1 --2- 172.21.15.88:0/1761242518 >> v2:172.21.15.142:3300/0 conn(0x7fa6200b4c90 0x7fa620145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa61f400640 1 --2- 172.21.15.88:0/1761242518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62009e7a0 0x7fa6201464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa61d600640 1 -- 172.21.15.88:0/1761242518 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975401320 0 0) 0x7fa62006d4f0 con 0x7fa62006e490 2024-04-24T08:25:54.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa61d600640 1 -- 172.21.15.88:0/1761242518 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa604003530 con 0x7fa62006e490 2024-04-24T08:25:54.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa61ea00640 1 -- 172.21.15.88:0/1761242518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62009e7a0 msgr2=0x7fa6201464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:54.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa61ea00640 1 --2- 172.21.15.88:0/1761242518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62009e7a0 0x7fa6201464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa61ea00640 1 -- 172.21.15.88:0/1761242518 >> v1:172.21.15.88:6789/0 conn(0x7fa62006e490 legacy=0x7fa62009e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa61d600640 1 -- 172.21.15.88:0/1761242518 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4127755215 0 0) 0x7fa604003530 con 0x7fa62006e490 2024-04-24T08:25:54.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa61ea00640 1 -- 172.21.15.88:0/1761242518 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62009c570 con 0x7fa6200b4c90 2024-04-24T08:25:54.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.985+0000 7fa61f400640 1 --2- 172.21.15.88:0/1761242518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62009e7a0 0x7fa6201464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:54.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.989+0000 7fa61ea00640 1 --2- 172.21.15.88:0/1761242518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6200b4c90 0x7fa620145f80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6100097c0 tx=0x7fa61001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31d8b0b6cb117054 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:54.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.989+0000 7fa61d600640 1 -- 172.21.15.88:0/1761242518 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6100b0070 con 0x7fa6200b4c90 2024-04-24T08:25:54.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.989+0000 7fa61d600640 1 -- 172.21.15.88:0/1761242518 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6100ab400 con 0x7fa6200b4c90 2024-04-24T08:25:54.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.989+0000 7fa61d600640 1 -- 172.21.15.88:0/1761242518 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c001680 con 0x7fa6200b4c90 2024-04-24T08:25:54.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 -- 172.21.15.88:0/1761242518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6200b4c90 msgr2=0x7fa620145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 --2- 172.21.15.88:0/1761242518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6200b4c90 0x7fa620145f80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6100097c0 tx=0x7fa61001c330 comp rx=0 tx=0).stop 2024-04-24T08:25:54.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 -- 172.21.15.88:0/1761242518 shutdown_connections 2024-04-24T08:25:54.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 --2- 172.21.15.88:0/1761242518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62009e7a0 0x7fa6201464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 --2- 172.21.15.88:0/1761242518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6200b4c90 0x7fa620145f80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 -- 172.21.15.88:0/1761242518 >> 172.21.15.88:0/1761242518 conn(0x7fa6200b9690 msgr2=0x7fa6200b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:54.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 -- 172.21.15.88:0/1761242518 shutdown_connections 2024-04-24T08:25:54.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 -- 172.21.15.88:0/1761242518 wait complete. 2024-04-24T08:25:54.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 Processor -- start 2024-04-24T08:25:54.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 -- start start 2024-04-24T08:25:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa62006e490 0x7fa620149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62009e7a0 0x7fa6201488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6200b4c90 0x7fa620147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa620152fc0 con 0x7fa62006e490 2024-04-24T08:25:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa620152e40 con 0x7fa6200b4c90 2024-04-24T08:25:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa620153140 con 0x7fa62009e7a0 2024-04-24T08:25:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa61ea00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa62006e490 0x7fa620149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:54.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa61ea00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa62006e490 0x7fa620149750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59408/0 (socket says 172.21.15.88:59408) 2024-04-24T08:25:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa61ea00640 1 -- 172.21.15.88:0/3743814925 learned_addr learned my addr 172.21.15.88:0/3743814925 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa61ea00640 1 -- 172.21.15.88:0/3743814925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62009e7a0 msgr2=0x7fa6201488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa61ea00640 1 --2- 172.21.15.88:0/3743814925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62009e7a0 0x7fa6201488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa61ea00640 1 -- 172.21.15.88:0/3743814925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6200b4c90 msgr2=0x7fa620147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa61ea00640 1 --2- 172.21.15.88:0/3743814925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6200b4c90 0x7fa620147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:54.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa61ea00640 1 -- 172.21.15.88:0/3743814925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa620149c90 con 0x7fa62006e490 2024-04-24T08:25:54.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa61ea00640 1 --2- 172.21.15.88:0/3743814925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa62006e490 0x7fa620149750 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa61001a9e0 tx=0x7fa6100190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:54.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa616a00640 1 -- 172.21.15.88:0/3743814925 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6100b9020 con 0x7fa62006e490 2024-04-24T08:25:54.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa616a00640 1 -- 172.21.15.88:0/3743814925 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa610003820 con 0x7fa62006e490 2024-04-24T08:25:54.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa616a00640 1 -- 172.21.15.88:0/3743814925 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6100b0040 con 0x7fa62006e490 2024-04-24T08:25:54.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.993+0000 7fa625a00640 1 -- 172.21.15.88:0/3743814925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6201405d0 con 0x7fa62006e490 2024-04-24T08:25:54.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.997+0000 7fa625a00640 1 -- 172.21.15.88:0/3743814925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa620148df0 con 0x7fa62006e490 2024-04-24T08:25:54.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.997+0000 7fa625a00640 1 -- 172.21.15.88:0/3743814925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa620149080 con 0x7fa62006e490 2024-04-24T08:25:54.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.997+0000 7fa616a00640 1 -- 172.21.15.88:0/3743814925 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6100bc020 con 0x7fa62006e490 2024-04-24T08:25:54.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.997+0000 7fa616a00640 1 --2- 172.21.15.88:0/3743814925 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa600068380 0x7fa60006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:54.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.997+0000 7fa616a00640 1 -- 172.21.15.88:0/3743814925 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa610120680 con 0x7fa62006e490 2024-04-24T08:25:55.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.997+0000 7fa61e000640 1 --2- 172.21.15.88:0/3743814925 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa600068380 0x7fa60006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:55.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:54.997+0000 7fa61e000640 1 --2- 172.21.15.88:0/3743814925 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa600068380 0x7fa60006a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa60c001ec0 tx=0x7fa60c001a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:55.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.001+0000 7fa616a00640 1 -- 172.21.15.88:0/3743814925 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa6100c3030 con 0x7fa62006e490 2024-04-24T08:25:55.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.157+0000 7fa625a00640 1 -- 172.21.15.88:0/3743814925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa620068c00 con 0x7fa62006e490 2024-04-24T08:25:55.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa616a00640 1 -- 172.21.15.88:0/3743814925 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fa620149c90 con 0x7fa62006e490 2024-04-24T08:25:55.161 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-24T08:25:55.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa625a00640 1 -- 172.21.15.88:0/3743814925 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa600068380 msgr2=0x7fa60006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa625a00640 1 --2- 172.21.15.88:0/3743814925 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa600068380 0x7fa60006a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa60c001ec0 tx=0x7fa60c001a50 comp rx=0 tx=0).stop 2024-04-24T08:25:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa625a00640 1 -- 172.21.15.88:0/3743814925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa62006e490 msgr2=0x7fa620149750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa625a00640 1 --2- 172.21.15.88:0/3743814925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa62006e490 0x7fa620149750 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa61001a9e0 tx=0x7fa6100190d0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa625a00640 1 -- 172.21.15.88:0/3743814925 shutdown_connections 2024-04-24T08:25:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa625a00640 1 --2- 172.21.15.88:0/3743814925 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa600068380 0x7fa60006a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa625a00640 1 --2- 172.21.15.88:0/3743814925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6200b4c90 0x7fa620147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa625a00640 1 --2- 172.21.15.88:0/3743814925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62009e7a0 0x7fa6201488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa625a00640 1 --2- 172.21.15.88:0/3743814925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa62006e490 0x7fa620149750 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa625a00640 1 -- 172.21.15.88:0/3743814925 >> 172.21.15.88:0/3743814925 conn(0x7fa6200b9690 msgr2=0x7fa620143d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa625a00640 1 -- 172.21.15.88:0/3743814925 shutdown_connections 2024-04-24T08:25:55.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.161+0000 7fa625a00640 1 -- 172.21.15.88:0/3743814925 wait complete. 2024-04-24T08:25:55.183 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T08:25:55.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.317+0000 7fc192a00640 1 Processor -- start 2024-04-24T08:25:55.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.317+0000 7fc192a00640 1 -- start start 2024-04-24T08:25:55.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.317+0000 7fc192a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc18c0bbfb0 0x7fc18c0b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:55.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.317+0000 7fc192a00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc18c0bc390 con 0x7fc18c142060 2024-04-24T08:25:55.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.317+0000 7fc192a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc18c06e640 con 0x7fc18c06cbe0 2024-04-24T08:25:55.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.317+0000 7fc192a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c06e920 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.321+0000 7fc190a00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc18c142060 0x7fc18c1525e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50364/0 (socket says 172.21.15.88:50364) 2024-04-24T08:25:55.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.321+0000 7fc190a00640 1 -- 172.21.15.88:0/2944514384 learned_addr learned my addr 172.21.15.88:0/2944514384 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:55.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.321+0000 7fc18be00640 1 --2- 172.21.15.88:0/2944514384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc18c0bbfb0 0x7fc18c0b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:55.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.321+0000 7fc18aa00640 1 -- 172.21.15.88:0/2944514384 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793489114 0 0) 0x7fc18c0bc390 con 0x7fc18c142060 2024-04-24T08:25:55.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.321+0000 7fc18aa00640 1 -- 172.21.15.88:0/2944514384 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc170003530 con 0x7fc18c142060 2024-04-24T08:25:55.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.321+0000 7fc18aa00640 1 -- 172.21.15.88:0/2944514384 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581380272 0 0) 0x7fc18c06e640 con 0x7fc18c06cbe0 2024-04-24T08:25:55.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.321+0000 7fc18aa00640 1 -- 172.21.15.88:0/2944514384 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc18c0bc390 con 0x7fc18c06cbe0 2024-04-24T08:25:55.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.321+0000 7fc18be00640 1 -- 172.21.15.88:0/2944514384 >> v1:172.21.15.142:6789/0 conn(0x7fc18c06cbe0 legacy=0x7fc18c141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.321+0000 7fc18be00640 1 -- 172.21.15.88:0/2944514384 >> v1:172.21.15.88:6789/0 conn(0x7fc18c142060 legacy=0x7fc18c1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.321+0000 7fc18aa00640 1 -- 172.21.15.88:0/2944514384 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 169246423 0 0) 0x7fc170003530 con 0x7fc18c142060 2024-04-24T08:25:55.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.321+0000 7fc18be00640 1 -- 172.21.15.88:0/2944514384 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c06e2d0 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.321+0000 7fc18be00640 1 --2- 172.21.15.88:0/2944514384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc18c0bbfb0 0x7fc18c0b7210 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0097f0 tx=0x7fc17c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f28aa5590eb421a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:55.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18aa00640 1 -- 172.21.15.88:0/2944514384 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0b0070 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18aa00640 1 -- 172.21.15.88:0/2944514384 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc17c0ab400 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18aa00640 1 -- 172.21.15.88:0/2944514384 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc184001a00 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 -- 172.21.15.88:0/2944514384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc18c0bbfb0 msgr2=0x7fc18c0b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 --2- 172.21.15.88:0/2944514384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc18c0bbfb0 0x7fc18c0b7210 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0097f0 tx=0x7fc17c01c400 comp rx=0 tx=0).stop 2024-04-24T08:25:55.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 -- 172.21.15.88:0/2944514384 shutdown_connections 2024-04-24T08:25:55.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 --2- 172.21.15.88:0/2944514384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc18c0bbfb0 0x7fc18c0b7210 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 -- 172.21.15.88:0/2944514384 >> 172.21.15.88:0/2944514384 conn(0x7fc18c067e40 msgr2=0x7fc18c0bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:55.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 -- 172.21.15.88:0/2944514384 shutdown_connections 2024-04-24T08:25:55.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 -- 172.21.15.88:0/2944514384 wait complete. 2024-04-24T08:25:55.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 Processor -- start 2024-04-24T08:25:55.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 -- start start 2024-04-24T08:25:55.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc18c06cbe0 0x7fc18c13e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:55.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc18c0bbfb0 0x7fc18c1435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:55.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc18c142060 0x7fc18c13b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:55.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c1568b0 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c156730 con 0x7fc18c142060 2024-04-24T08:25:55.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc192a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c156a30 con 0x7fc18c06cbe0 2024-04-24T08:25:55.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18b400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc18c0bbfb0 0x7fc18c1435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:55.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18b400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc18c0bbfb0 0x7fc18c1435a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59410/0 (socket says 172.21.15.88:59410) 2024-04-24T08:25:55.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18b400640 1 -- 172.21.15.88:0/3834089852 learned_addr learned my addr 172.21.15.88:0/3834089852 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:55.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18be00640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc18c06cbe0 0x7fc18c13e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:55.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc190a00640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc18c142060 0x7fc18c13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:55.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18b400640 1 -- 172.21.15.88:0/3834089852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc18c06cbe0 msgr2=0x7fc18c13e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18b400640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc18c06cbe0 0x7fc18c13e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18b400640 1 -- 172.21.15.88:0/3834089852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc18c142060 msgr2=0x7fc18c13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18b400640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc18c142060 0x7fc18c13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18b400640 1 -- 172.21.15.88:0/3834089852 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c13f8b0 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.325+0000 7fc18be00640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc18c06cbe0 0x7fc18c13e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:55.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.329+0000 7fc18b400640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc18c0bbfb0 0x7fc18c1435a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c490 tx=0x7fc17800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:55.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.329+0000 7fc183e00640 1 -- 172.21.15.88:0/3834089852 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1780052d0 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.329+0000 7fc183e00640 1 -- 172.21.15.88:0/3834089852 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc178005470 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.329+0000 7fc192a00640 1 -- 172.21.15.88:0/3834089852 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc18c0b5c30 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.329+0000 7fc183e00640 1 -- 172.21.15.88:0/3834089852 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc178012870 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.329+0000 7fc192a00640 1 -- 172.21.15.88:0/3834089852 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18c14c2e0 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.329+0000 7fc192a00640 1 -- 172.21.15.88:0/3834089852 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc18c13d4a0 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.329+0000 7fc183e00640 1 -- 172.21.15.88:0/3834089852 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc178012a10 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.329+0000 7fc183e00640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc16c0683b0 0x7fc16c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:55.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.329+0000 7fc183e00640 1 -- 172.21.15.88:0/3834089852 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc178086640 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.329+0000 7fc18be00640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc16c0683b0 0x7fc16c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:55.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.333+0000 7fc18be00640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc16c0683b0 0x7fc16c06a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0ad000 tx=0x7fc17c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:55.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.333+0000 7fc183e00640 1 -- 172.21.15.88:0/3834089852 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc18c13f8b0 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.489+0000 7fc192a00640 1 -- 172.21.15.88:0/3834089852 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc18c140640 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.489+0000 7fc183e00640 1 -- 172.21.15.88:0/3834089852 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fc178056bf0 con 0x7fc18c0bbfb0 2024-04-24T08:25:55.493 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-24T08:25:55.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.493+0000 7fc192a00640 1 -- 172.21.15.88:0/3834089852 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc16c0683b0 msgr2=0x7fc16c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.493+0000 7fc192a00640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc16c0683b0 0x7fc16c06a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0ad000 tx=0x7fc17c0a6000 comp rx=0 tx=0).stop 2024-04-24T08:25:55.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.493+0000 7fc192a00640 1 -- 172.21.15.88:0/3834089852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc18c0bbfb0 msgr2=0x7fc18c1435a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.493+0000 7fc192a00640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc18c0bbfb0 0x7fc18c1435a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c490 tx=0x7fc17800c950 comp rx=0 tx=0).stop 2024-04-24T08:25:55.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.493+0000 7fc192a00640 1 -- 172.21.15.88:0/3834089852 shutdown_connections 2024-04-24T08:25:55.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.493+0000 7fc192a00640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc16c0683b0 0x7fc16c06a870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.493+0000 7fc192a00640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc18c142060 0x7fc18c13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.493+0000 7fc192a00640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc18c0bbfb0 0x7fc18c1435a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.493+0000 7fc192a00640 1 --2- 172.21.15.88:0/3834089852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc18c06cbe0 0x7fc18c13e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.493+0000 7fc192a00640 1 -- 172.21.15.88:0/3834089852 >> 172.21.15.88:0/3834089852 conn(0x7fc18c067e40 msgr2=0x7fc18c1485a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:55.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.493+0000 7fc192a00640 1 -- 172.21.15.88:0/3834089852 shutdown_connections 2024-04-24T08:25:55.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.493+0000 7fc192a00640 1 -- 172.21.15.88:0/3834089852 wait complete. 2024-04-24T08:25:55.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T08:25:55.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69bca00640 1 Processor -- start 2024-04-24T08:25:55.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69bca00640 1 -- start start 2024-04-24T08:25:55.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69bca00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f69b80b7b90 0x7f69b8148290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:55.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69bca00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f69b81487d0 0x7f69b8152650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:55.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69bca00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b806eb30 con 0x7f69b806e750 2024-04-24T08:25:55.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69bca00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f69b806dfd0 con 0x7f69b81487d0 2024-04-24T08:25:55.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69bca00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f69b8147d90 con 0x7f69b80b7b90 2024-04-24T08:25:55.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69b5e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f69b806e750 0x7f69b80b1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50380/0 (socket says 172.21.15.88:50380) 2024-04-24T08:25:55.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69b5e00640 1 -- 172.21.15.88:0/2561542800 learned_addr learned my addr 172.21.15.88:0/2561542800 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:55.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69b6800640 1 --2- 172.21.15.88:0/2561542800 >> v2:172.21.15.88:3300/0 conn(0x7f69b81487d0 0x7f69b8152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:55.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69ad400640 1 --2- 172.21.15.88:0/2561542800 >> v2:172.21.15.142:3300/0 conn(0x7f69b80b7b90 0x7f69b8148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:55.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69b5400640 1 -- 172.21.15.88:0/2561542800 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162440783 0 0) 0x7f69b806eb30 con 0x7f69b806e750 2024-04-24T08:25:55.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69b5400640 1 -- 172.21.15.88:0/2561542800 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f699c003530 con 0x7f69b806e750 2024-04-24T08:25:55.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69b6800640 1 -- 172.21.15.88:0/2561542800 >> v2:172.21.15.142:3300/0 conn(0x7f69b80b7b90 msgr2=0x7f69b8148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:55.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69b6800640 1 --2- 172.21.15.88:0/2561542800 >> v2:172.21.15.142:3300/0 conn(0x7f69b80b7b90 0x7f69b8148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69b6800640 1 -- 172.21.15.88:0/2561542800 >> v1:172.21.15.88:6789/0 conn(0x7f69b806e750 legacy=0x7f69b80b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.649+0000 7f69b6800640 1 -- 172.21.15.88:0/2561542800 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b806cd80 con 0x7f69b81487d0 2024-04-24T08:25:55.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.653+0000 7f69b6800640 1 --2- 172.21.15.88:0/2561542800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b81487d0 0x7f69b8152650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f69b8073fe0 tx=0x7f69b001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe12e3a11c2d2f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:55.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.653+0000 7f69b5400640 1 -- 172.21.15.88:0/2561542800 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b00b0070 con 0x7f69b81487d0 2024-04-24T08:25:55.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.653+0000 7f69b5400640 1 -- 172.21.15.88:0/2561542800 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b00ab600 con 0x7f69b81487d0 2024-04-24T08:25:55.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.653+0000 7f69b5400640 1 -- 172.21.15.88:0/2561542800 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b00ab9d0 con 0x7f69b81487d0 2024-04-24T08:25:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.653+0000 7f69bca00640 1 -- 172.21.15.88:0/2561542800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b81487d0 msgr2=0x7f69b8152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.653+0000 7f69bca00640 1 --2- 172.21.15.88:0/2561542800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b81487d0 0x7f69b8152650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f69b8073fe0 tx=0x7f69b001c3f0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.653+0000 7f69bca00640 1 -- 172.21.15.88:0/2561542800 shutdown_connections 2024-04-24T08:25:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.653+0000 7f69bca00640 1 --2- 172.21.15.88:0/2561542800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b81487d0 0x7f69b8152650 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.653+0000 7f69bca00640 1 --2- 172.21.15.88:0/2561542800 >> v2:172.21.15.142:3300/0 conn(0x7f69b80b7b90 0x7f69b8148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.653+0000 7f69bca00640 1 -- 172.21.15.88:0/2561542800 >> 172.21.15.88:0/2561542800 conn(0x7f69b80bb4d0 msgr2=0x7f69b80bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.653+0000 7f69bca00640 1 -- 172.21.15.88:0/2561542800 shutdown_connections 2024-04-24T08:25:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.653+0000 7f69bca00640 1 -- 172.21.15.88:0/2561542800 wait complete. 2024-04-24T08:25:55.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69bca00640 1 Processor -- start 2024-04-24T08:25:55.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69bca00640 1 -- start start 2024-04-24T08:25:55.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69bca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b806e750 0x7f69b814a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:55.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69bca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b80b7b90 0x7f69b814bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:55.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69bca00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b81487d0 0x7f69b8142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:55.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69bca00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f69b80b2750 con 0x7f69b81487d0 2024-04-24T08:25:55.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69bca00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f69b80b25d0 con 0x7f69b806e750 2024-04-24T08:25:55.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69bca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f69b81553b0 con 0x7f69b80b7b90 2024-04-24T08:25:55.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69b6800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b81487d0 0x7f69b8142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:55.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69b6800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b81487d0 0x7f69b8142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59432/0 (socket says 172.21.15.88:59432) 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69b6800640 1 -- 172.21.15.88:0/283238169 learned_addr learned my addr 172.21.15.88:0/283238169 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69ad400640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b80b7b90 0x7f69b814bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69b5e00640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b806e750 0x7f69b814a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69b6800640 1 -- 172.21.15.88:0/283238169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b80b7b90 msgr2=0x7f69b814bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69b6800640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b80b7b90 0x7f69b814bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69b6800640 1 -- 172.21.15.88:0/283238169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b806e750 msgr2=0x7f69b814a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69b6800640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b806e750 0x7f69b814a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69b6800640 1 -- 172.21.15.88:0/283238169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b81432e0 con 0x7f69b81487d0 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69b5e00640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b806e750 0x7f69b814a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69b6800640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b81487d0 0x7f69b8142b60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f69b0019000 tx=0x7f69b0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69aea00640 1 -- 172.21.15.88:0/283238169 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b00b0040 con 0x7f69b81487d0 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69aea00640 1 -- 172.21.15.88:0/283238169 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b00b9070 con 0x7f69b81487d0 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69aea00640 1 -- 172.21.15.88:0/283238169 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b00b4650 con 0x7f69b81487d0 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69bca00640 1 -- 172.21.15.88:0/283238169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b81435c0 con 0x7f69b81487d0 2024-04-24T08:25:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69bca00640 1 -- 172.21.15.88:0/283238169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b8149630 con 0x7f69b81487d0 2024-04-24T08:25:55.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.657+0000 7f69bca00640 1 -- 172.21.15.88:0/283238169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b814b400 con 0x7f69b81487d0 2024-04-24T08:25:55.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.661+0000 7f69aea00640 1 -- 172.21.15.88:0/283238169 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f69b00b47f0 con 0x7f69b81487d0 2024-04-24T08:25:55.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.661+0000 7f69aea00640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6994068380 0x7f699406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:55.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.661+0000 7f69aea00640 1 -- 172.21.15.88:0/283238169 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f69b0120780 con 0x7f69b81487d0 2024-04-24T08:25:55.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.661+0000 7f69b5e00640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6994068380 0x7f699406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:55.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.661+0000 7f69b5e00640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6994068380 0x7f699406a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f69a8005c10 tx=0x7f69a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:55.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.665+0000 7f69aea00640 1 -- 172.21.15.88:0/283238169 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f69b0016070 con 0x7f69b81487d0 2024-04-24T08:25:55.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 -- 172.21.15.88:0/283238169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f69b8068b20 con 0x7f69b81487d0 2024-04-24T08:25:55.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69aea00640 1 -- 172.21.15.88:0/283238169 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f69b00f0dd0 con 0x7f69b81487d0 2024-04-24T08:25:55.834 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2024-04-24T08:25:55.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 -- 172.21.15.88:0/283238169 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6994068380 msgr2=0x7f699406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6994068380 0x7f699406a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f69a8005c10 tx=0x7f69a8009040 comp rx=0 tx=0).stop 2024-04-24T08:25:55.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 -- 172.21.15.88:0/283238169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b81487d0 msgr2=0x7f69b8142b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:55.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b81487d0 0x7f69b8142b60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f69b0019000 tx=0x7f69b0019190 comp rx=0 tx=0).stop 2024-04-24T08:25:55.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 -- 172.21.15.88:0/283238169 shutdown_connections 2024-04-24T08:25:55.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6994068380 0x7f699406a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69b81487d0 0x7f69b8142b60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b80b7b90 0x7f69b814bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 --2- 172.21.15.88:0/283238169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b806e750 0x7f69b814a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:55.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 -- 172.21.15.88:0/283238169 >> 172.21.15.88:0/283238169 conn(0x7f69b80bb4d0 msgr2=0x7f69b80b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:55.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 -- 172.21.15.88:0/283238169 shutdown_connections 2024-04-24T08:25:55.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:55.833+0000 7f69bca00640 1 -- 172.21.15.88:0/283238169 wait complete. 2024-04-24T08:25:55.855 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2024-04-24T08:25:55.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:55.856 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-24T08:25:55.889 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:25:55.890 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:25:55.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:25:55.890 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T08:25:55.952 INFO:tasks.cephfs.cephfs_test_case:[] 2024-04-24T08:25:55.952 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:25:56.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.125+0000 7f6dbce00640 1 Processor -- start 2024-04-24T08:25:56.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.125+0000 7f6dbce00640 1 -- start start 2024-04-24T08:25:56.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.125+0000 7f6dbce00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6db80b9d90 0x7f6db806d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.125+0000 7f6dbce00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6db8145f20 0x7f6db81504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.125+0000 7f6dbce00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6db80ba170 con 0x7f6db809be30 2024-04-24T08:25:56.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.125+0000 7f6dbce00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6db809cd30 con 0x7f6db80b9d90 2024-04-24T08:25:56.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.125+0000 7f6dbce00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6db814a060 con 0x7f6db8145f20 2024-04-24T08:25:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.129+0000 7f6db6800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6db8145f20 0x7f6db81504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.129+0000 7f6db5e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6db80b9d90 0x7f6db806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.129+0000 7f6db5e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6db80b9d90 0x7f6db806d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:43306/0 (socket says 172.21.15.88:43306) 2024-04-24T08:25:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.129+0000 7f6db5e00640 1 -- 172.21.15.88:0/2268441031 learned_addr learned my addr 172.21.15.88:0/2268441031 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.129+0000 7f6db6800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6db8145f20 0x7f6db81504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:60240/0 (socket says 172.21.15.88:60240) 2024-04-24T08:25:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.129+0000 7f6dad400640 1 --1- 172.21.15.88:0/2268441031 >> v1:172.21.15.142:6789/0 conn(0x7f6db809be30 0x7f6db806d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:50274/0 (socket says 172.21.15.88:50274) 2024-04-24T08:25:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.129+0000 7f6db5e00640 1 -- 172.21.15.88:0/2268441031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6db8145f20 msgr2=0x7f6db81504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.129+0000 7f6db5e00640 1 --2- 172.21.15.88:0/2268441031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6db8145f20 0x7f6db81504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.129+0000 7f6db5e00640 1 -- 172.21.15.88:0/2268441031 >> v1:172.21.15.142:6789/0 conn(0x7f6db809be30 legacy=0x7f6db806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.129+0000 7f6db5e00640 1 -- 172.21.15.88:0/2268441031 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db8149860 con 0x7f6db80b9d90 2024-04-24T08:25:56.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.129+0000 7f6db5e00640 1 --2- 172.21.15.88:0/2268441031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6db80b9d90 0x7f6db806d210 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009e50 tx=0x7f6da801c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=360a5d94ece306cd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:56.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6db5400640 1 -- 172.21.15.88:0/2268441031 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da80a56a0 con 0x7f6db80b9d90 2024-04-24T08:25:56.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6db5400640 1 -- 172.21.15.88:0/2268441031 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da80a5840 con 0x7f6db80b9d90 2024-04-24T08:25:56.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6db5400640 1 -- 172.21.15.88:0/2268441031 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da80a5c10 con 0x7f6db80b9d90 2024-04-24T08:25:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 -- 172.21.15.88:0/2268441031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6db80b9d90 msgr2=0x7f6db806d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 --2- 172.21.15.88:0/2268441031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6db80b9d90 0x7f6db806d210 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009e50 tx=0x7f6da801c910 comp rx=0 tx=0).stop 2024-04-24T08:25:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 -- 172.21.15.88:0/2268441031 shutdown_connections 2024-04-24T08:25:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 --2- 172.21.15.88:0/2268441031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6db8145f20 0x7f6db81504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 --2- 172.21.15.88:0/2268441031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6db80b9d90 0x7f6db806d210 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 -- 172.21.15.88:0/2268441031 >> 172.21.15.88:0/2268441031 conn(0x7f6db806c0d0 msgr2=0x7f6db80b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 -- 172.21.15.88:0/2268441031 shutdown_connections 2024-04-24T08:25:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 -- 172.21.15.88:0/2268441031 wait complete. 2024-04-24T08:25:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 Processor -- start 2024-04-24T08:25:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 -- start start 2024-04-24T08:25:56.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6db809be30 0x7f6db813db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6db80b9d90 0x7f6db813f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6db8145f20 0x7f6db81e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6db80b3fa0 con 0x7f6db80b9d90 2024-04-24T08:25:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6db80b3e20 con 0x7f6db809be30 2024-04-24T08:25:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dbce00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6db806de60 con 0x7f6db8145f20 2024-04-24T08:25:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dad400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6db80b9d90 0x7f6db813f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dad400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6db80b9d90 0x7f6db813f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59436/0 (socket says 172.21.15.88:59436) 2024-04-24T08:25:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6dad400640 1 -- 172.21.15.88:0/3908315236 learned_addr learned my addr 172.21.15.88:0/3908315236 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6db5e00640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6db809be30 0x7f6db813db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.133+0000 7f6db6800640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6db8145f20 0x7f6db81e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6dad400640 1 -- 172.21.15.88:0/3908315236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6db8145f20 msgr2=0x7f6db81e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6dad400640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6db8145f20 0x7f6db81e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6dad400640 1 -- 172.21.15.88:0/3908315236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6db809be30 msgr2=0x7f6db813db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6dad400640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6db809be30 0x7f6db813db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6dad400640 1 -- 172.21.15.88:0/3908315236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db809b160 con 0x7f6db80b9d90 2024-04-24T08:25:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6dad400640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6db80b9d90 0x7f6db813f990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6da000c420 tx=0x7f6da000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6daea00640 1 -- 172.21.15.88:0/3908315236 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da00074e0 con 0x7f6db80b9d90 2024-04-24T08:25:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6daea00640 1 -- 172.21.15.88:0/3908315236 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da0007680 con 0x7f6db80b9d90 2024-04-24T08:25:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6daea00640 1 -- 172.21.15.88:0/3908315236 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0004a30 con 0x7f6db80b9d90 2024-04-24T08:25:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6dbce00640 1 -- 172.21.15.88:0/3908315236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db8144820 con 0x7f6db80b9d90 2024-04-24T08:25:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6dbce00640 1 -- 172.21.15.88:0/3908315236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db8141530 con 0x7f6db80b9d90 2024-04-24T08:25:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6dbce00640 1 -- 172.21.15.88:0/3908315236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db8068b90 con 0x7f6db80b9d90 2024-04-24T08:25:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6daea00640 1 -- 172.21.15.88:0/3908315236 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6da001a020 con 0x7f6db80b9d90 2024-04-24T08:25:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6daea00640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6d94068380 0x7f6d9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6daea00640 1 -- 172.21.15.88:0/3908315236 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6da0086030 con 0x7f6db80b9d90 2024-04-24T08:25:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.137+0000 7f6db5e00640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6d94068380 0x7f6d9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.141+0000 7f6db5e00640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6d94068380 0x7f6d9406a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6da80ae000 tx=0x7f6da80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.145+0000 7f6daea00640 1 -- 172.21.15.88:0/3908315236 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6da0056030 con 0x7f6db80b9d90 2024-04-24T08:25:56.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.329+0000 7f6dbce00640 1 -- 172.21.15.88:0/3908315236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6db8140eb0 con 0x7f6db80b9d90 2024-04-24T08:25:56.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.329+0000 7f6daea00640 1 -- 172.21.15.88:0/3908315236 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7f6da005a330 con 0x7f6db80b9d90 2024-04-24T08:25:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:56.333 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1421585339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1421585339},{"type":"v1","addr":"172.21.15.142:6833","nonce":1421585339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:25:27.478065+0000","modified":"2024-04-24T08:25:30.500783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2851985776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2851985776},{"type":"v1","addr":"172.21.15.88:6835","nonce":2851985776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-24T08:25:56.333 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2024-04-24T08:25:56.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.333+0000 7f6dbce00640 1 -- 172.21.15.88:0/3908315236 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6d94068380 msgr2=0x7f6d9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.333+0000 7f6dbce00640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6d94068380 0x7f6d9406a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6da80ae000 tx=0x7f6da80a7070 comp rx=0 tx=0).stop 2024-04-24T08:25:56.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.333+0000 7f6dbce00640 1 -- 172.21.15.88:0/3908315236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6db80b9d90 msgr2=0x7f6db813f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.333+0000 7f6dbce00640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6db80b9d90 0x7f6db813f990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6da000c420 tx=0x7f6da000c8e0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.333+0000 7f6dbce00640 1 -- 172.21.15.88:0/3908315236 shutdown_connections 2024-04-24T08:25:56.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.333+0000 7f6dbce00640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6d94068380 0x7f6d9406a840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.333+0000 7f6dbce00640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6db8145f20 0x7f6db81e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.333+0000 7f6dbce00640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6db80b9d90 0x7f6db813f990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.333+0000 7f6dbce00640 1 --2- 172.21.15.88:0/3908315236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6db809be30 0x7f6db813db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.333+0000 7f6dbce00640 1 -- 172.21.15.88:0/3908315236 >> 172.21.15.88:0/3908315236 conn(0x7f6db806c0d0 msgr2=0x7f6db809d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:56.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.333+0000 7f6dbce00640 1 -- 172.21.15.88:0/3908315236 shutdown_connections 2024-04-24T08:25:56.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.333+0000 7f6dbce00640 1 -- 172.21.15.88:0/3908315236 wait complete. 2024-04-24T08:25:56.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:56.358 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T08:25:56.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T08:25:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.485+0000 7f7581800640 1 Processor -- start 2024-04-24T08:25:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.485+0000 7f7581800640 1 -- start start 2024-04-24T08:25:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.489+0000 7f7581800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f757c09c4d0 0x7f757c09dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.489+0000 7f7581800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757c0ba170 con 0x7f757c14c080 2024-04-24T08:25:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.489+0000 7f7581800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757c14f810 con 0x7f757c0b9d90 2024-04-24T08:25:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.489+0000 7f7581800640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f757c14faf0 con 0x7f757c09c4d0 2024-04-24T08:25:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.489+0000 7f757b400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f757c14c080 0x7f757c145e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50392/0 (socket says 172.21.15.88:50392) 2024-04-24T08:25:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.489+0000 7f757b400640 1 -- 172.21.15.88:0/1592912076 learned_addr learned my addr 172.21.15.88:0/1592912076 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.489+0000 7f757a000640 1 --2- 172.21.15.88:0/1592912076 >> v2:172.21.15.88:3300/0 conn(0x7f757c09c4d0 0x7f757c09dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.489+0000 7f757a000640 1 -- 172.21.15.88:0/1592912076 >> v1:172.21.15.142:6789/0 conn(0x7f757c0b9d90 legacy=0x7f757c150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.489+0000 7f757a000640 1 -- 172.21.15.88:0/1592912076 >> v1:172.21.15.88:6789/0 conn(0x7f757c14c080 legacy=0x7f757c145e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.489+0000 7f757a000640 1 -- 172.21.15.88:0/1592912076 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c09e160 con 0x7f757c09c4d0 2024-04-24T08:25:56.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.489+0000 7f7579600640 1 -- 172.21.15.88:0/1592912076 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898847883 0 0) 0x7f757c0ba170 con 0x7f757c14c080 2024-04-24T08:25:56.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f757a000640 1 --2- 172.21.15.88:0/1592912076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757c09c4d0 0x7f757c09dc20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f75640097c0 tx=0x7f756401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ed3276556604a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:56.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7579600640 1 -- 172.21.15.88:0/1592912076 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75640b0070 con 0x7f757c09c4d0 2024-04-24T08:25:56.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7579600640 1 -- 172.21.15.88:0/1592912076 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75640ab600 con 0x7f757c09c4d0 2024-04-24T08:25:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7579600640 1 -- 172.21.15.88:0/1592912076 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75640ab9d0 con 0x7f757c09c4d0 2024-04-24T08:25:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 -- 172.21.15.88:0/1592912076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757c09c4d0 msgr2=0x7f757c09dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 --2- 172.21.15.88:0/1592912076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757c09c4d0 0x7f757c09dc20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f75640097c0 tx=0x7f756401c4a0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 -- 172.21.15.88:0/1592912076 shutdown_connections 2024-04-24T08:25:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 --2- 172.21.15.88:0/1592912076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757c09c4d0 0x7f757c09dc20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 -- 172.21.15.88:0/1592912076 >> 172.21.15.88:0/1592912076 conn(0x7f757c06c0d0 msgr2=0x7f757c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 -- 172.21.15.88:0/1592912076 shutdown_connections 2024-04-24T08:25:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 -- 172.21.15.88:0/1592912076 wait complete. 2024-04-24T08:25:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 Processor -- start 2024-04-24T08:25:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 -- start start 2024-04-24T08:25:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f757c09c4d0 0x7f757c0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757c0b9d90 0x7f757c1e7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f757c14c080 0x7f757c1e84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f757c074060 con 0x7f757c0b9d90 2024-04-24T08:25:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f757c073ee0 con 0x7f757c09c4d0 2024-04-24T08:25:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f7581800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f757c15aa30 con 0x7f757c14c080 2024-04-24T08:25:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f757a000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757c0b9d90 0x7f757c1e7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f757a000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757c0b9d90 0x7f757c1e7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59452/0 (socket says 172.21.15.88:59452) 2024-04-24T08:25:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f757a000640 1 -- 172.21.15.88:0/3513954660 learned_addr learned my addr 172.21.15.88:0/3513954660 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f757b400640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f757c14c080 0x7f757c1e84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.493+0000 7f757aa00640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f757c09c4d0 0x7f757c0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f757a000640 1 -- 172.21.15.88:0/3513954660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f757c14c080 msgr2=0x7f757c1e84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f757a000640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f757c14c080 0x7f757c1e84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f757a000640 1 -- 172.21.15.88:0/3513954660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f757c09c4d0 msgr2=0x7f757c0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f757a000640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f757c09c4d0 0x7f757c0720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f757a000640 1 -- 172.21.15.88:0/3513954660 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c071e00 con 0x7f757c0b9d90 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f757aa00640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f757c09c4d0 0x7f757c0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f757a000640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757c0b9d90 0x7f757c1e7f80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f75640ae040 tx=0x7f7564019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f7572a00640 1 -- 172.21.15.88:0/3513954660 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75640b0040 con 0x7f757c0b9d90 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f7572a00640 1 -- 172.21.15.88:0/3513954660 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75640b9070 con 0x7f757c0b9d90 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f7581800640 1 -- 172.21.15.88:0/3513954660 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757c0728c0 con 0x7f757c0b9d90 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f7572a00640 1 -- 172.21.15.88:0/3513954660 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75640aaa30 con 0x7f757c0b9d90 2024-04-24T08:25:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f7581800640 1 -- 172.21.15.88:0/3513954660 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f757c071840 con 0x7f757c0b9d90 2024-04-24T08:25:56.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f7581800640 1 -- 172.21.15.88:0/3513954660 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f757c068b90 con 0x7f757c0b9d90 2024-04-24T08:25:56.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f7572a00640 1 -- 172.21.15.88:0/3513954660 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f75640aabd0 con 0x7f757c0b9d90 2024-04-24T08:25:56.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f7572a00640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7558068380 0x7f755806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f7572a00640 1 -- 172.21.15.88:0/3513954660 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7564120ba0 con 0x7f757c0b9d90 2024-04-24T08:25:56.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.497+0000 7f757aa00640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7558068380 0x7f755806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.501+0000 7f757aa00640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7558068380 0x7f755806a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f756c0012f0 tx=0x7f756c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.501+0000 7f7572a00640 1 -- 172.21.15.88:0/3513954660 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7564016090 con 0x7f757c0b9d90 2024-04-24T08:25:56.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.661+0000 7f7581800640 1 -- 172.21.15.88:0/3513954660 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f757c0b86e0 con 0x7f757c0b9d90 2024-04-24T08:25:56.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7572a00640 1 -- 172.21.15.88:0/3513954660 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f75640f1150 con 0x7f757c0b9d90 2024-04-24T08:25:56.666 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:56.666 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:56.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7581800640 1 -- 172.21.15.88:0/3513954660 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7558068380 msgr2=0x7f755806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7581800640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7558068380 0x7f755806a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f756c0012f0 tx=0x7f756c009040 comp rx=0 tx=0).stop 2024-04-24T08:25:56.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7581800640 1 -- 172.21.15.88:0/3513954660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757c0b9d90 msgr2=0x7f757c1e7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7581800640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757c0b9d90 0x7f757c1e7f80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f75640ae040 tx=0x7f7564019240 comp rx=0 tx=0).stop 2024-04-24T08:25:56.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7581800640 1 -- 172.21.15.88:0/3513954660 shutdown_connections 2024-04-24T08:25:56.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7581800640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7558068380 0x7f755806a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7581800640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f757c14c080 0x7f757c1e84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7581800640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757c0b9d90 0x7f757c1e7f80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7581800640 1 --2- 172.21.15.88:0/3513954660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f757c09c4d0 0x7f757c0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7581800640 1 -- 172.21.15.88:0/3513954660 >> 172.21.15.88:0/3513954660 conn(0x7f757c06c0d0 msgr2=0x7f757c074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:56.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7581800640 1 -- 172.21.15.88:0/3513954660 shutdown_connections 2024-04-24T08:25:56.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.665+0000 7f7581800640 1 -- 172.21.15.88:0/3513954660 wait complete. 2024-04-24T08:25:56.686 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T08:25:25.116395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T08:25:26.444475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:25:56.687 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:25:56.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326f600640 1 Processor -- start 2024-04-24T08:25:56.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326f600640 1 -- start start 2024-04-24T08:25:56.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326f600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32680b4c90 0x7f3268145f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326f600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f326809e7a0 0x7f32681464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326f600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f326806d4f0 con 0x7f326806e490 2024-04-24T08:25:56.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326f600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f326806d2a0 con 0x7f326809e7a0 2024-04-24T08:25:56.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326f600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f326806d7d0 con 0x7f32680b4c90 2024-04-24T08:25:56.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326d600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f326809e7a0 0x7f32681464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326d600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f326809e7a0 0x7f32681464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59458/0 (socket says 172.21.15.88:59458) 2024-04-24T08:25:56.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326d600640 1 -- 172.21.15.88:0/1171735582 learned_addr learned my addr 172.21.15.88:0/1171735582 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:56.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326cc00640 1 --2- 172.21.15.88:0/1171735582 >> v2:172.21.15.142:3300/0 conn(0x7f32680b4c90 0x7f3268145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326d600640 1 -- 172.21.15.88:0/1171735582 >> v2:172.21.15.142:3300/0 conn(0x7f32680b4c90 msgr2=0x7f3268145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:56.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326d600640 1 --2- 172.21.15.88:0/1171735582 >> v2:172.21.15.142:3300/0 conn(0x7f32680b4c90 0x7f3268145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326d600640 1 -- 172.21.15.88:0/1171735582 >> v1:172.21.15.142:6789/0 conn(0x7f326806e490 legacy=0x7f326809e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:56.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.869+0000 7f326d600640 1 -- 172.21.15.88:0/1171735582 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f326809c570 con 0x7f326809e7a0 2024-04-24T08:25:56.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.873+0000 7f326d600640 1 --2- 172.21.15.88:0/1171735582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326809e7a0 0x7f32681464c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f326809bff0 tx=0x7f326001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b7cf126218b923 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:56.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.873+0000 7f3267400640 1 -- 172.21.15.88:0/1171735582 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32600a56f0 con 0x7f326809e7a0 2024-04-24T08:25:56.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.873+0000 7f3267400640 1 -- 172.21.15.88:0/1171735582 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32600a5890 con 0x7f326809e7a0 2024-04-24T08:25:56.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.873+0000 7f3267400640 1 -- 172.21.15.88:0/1171735582 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32600a5c60 con 0x7f326809e7a0 2024-04-24T08:25:56.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.873+0000 7f326f600640 1 -- 172.21.15.88:0/1171735582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326809e7a0 msgr2=0x7f32681464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.873+0000 7f326f600640 1 --2- 172.21.15.88:0/1171735582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326809e7a0 0x7f32681464c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f326809bff0 tx=0x7f326001c920 comp rx=0 tx=0).stop 2024-04-24T08:25:56.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.873+0000 7f326f600640 1 -- 172.21.15.88:0/1171735582 shutdown_connections 2024-04-24T08:25:56.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.873+0000 7f326f600640 1 --2- 172.21.15.88:0/1171735582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326809e7a0 0x7f32681464c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.873+0000 7f326f600640 1 --2- 172.21.15.88:0/1171735582 >> v2:172.21.15.142:3300/0 conn(0x7f32680b4c90 0x7f3268145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.873+0000 7f326f600640 1 -- 172.21.15.88:0/1171735582 >> 172.21.15.88:0/1171735582 conn(0x7f32680b9690 msgr2=0x7f32680b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:56.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.873+0000 7f326f600640 1 -- 172.21.15.88:0/1171735582 shutdown_connections 2024-04-24T08:25:56.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.873+0000 7f326f600640 1 -- 172.21.15.88:0/1171735582 wait complete. 2024-04-24T08:25:56.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326f600640 1 Processor -- start 2024-04-24T08:25:56.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326f600640 1 -- start start 2024-04-24T08:25:56.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326f600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806e490 0x7f32681e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326f600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f326809e7a0 0x7f32680af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326f600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32680b4c90 0x7f326813c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326f600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3268152fc0 con 0x7f326806e490 2024-04-24T08:25:56.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326f600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3268152e40 con 0x7f326809e7a0 2024-04-24T08:25:56.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326f600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3268153140 con 0x7f32680b4c90 2024-04-24T08:25:56.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326cc00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806e490 0x7f32681e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326cc00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806e490 0x7f32681e3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59462/0 (socket says 172.21.15.88:59462) 2024-04-24T08:25:56.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326cc00640 1 -- 172.21.15.88:0/3120903918 learned_addr learned my addr 172.21.15.88:0/3120903918 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:56.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326d600640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32680b4c90 0x7f326813c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f3267e00640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f326809e7a0 0x7f32680af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326cc00640 1 -- 172.21.15.88:0/3120903918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32680b4c90 msgr2=0x7f326813c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326cc00640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32680b4c90 0x7f326813c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326cc00640 1 -- 172.21.15.88:0/3120903918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f326809e7a0 msgr2=0x7f32680af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:56.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326cc00640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f326809e7a0 0x7f32680af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:56.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326cc00640 1 -- 172.21.15.88:0/3120903918 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32681e4400 con 0x7f326806e490 2024-04-24T08:25:56.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326cc00640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806e490 0x7f32681e3ca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f325c00d620 tx=0x7f325c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:56.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f3264c00640 1 -- 172.21.15.88:0/3120903918 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c00b620 con 0x7f326806e490 2024-04-24T08:25:56.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f3264c00640 1 -- 172.21.15.88:0/3120903918 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325c019070 con 0x7f326806e490 2024-04-24T08:25:56.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f3264c00640 1 -- 172.21.15.88:0/3120903918 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c00b9e0 con 0x7f326806e490 2024-04-24T08:25:56.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326f600640 1 -- 172.21.15.88:0/3120903918 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32681e46e0 con 0x7f326806e490 2024-04-24T08:25:56.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326f600640 1 -- 172.21.15.88:0/3120903918 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3268146c90 con 0x7f326806e490 2024-04-24T08:25:56.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.877+0000 7f326f600640 1 -- 172.21.15.88:0/3120903918 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3268068c00 con 0x7f326806e490 2024-04-24T08:25:56.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.881+0000 7f3264c00640 1 -- 172.21.15.88:0/3120903918 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f325c00bb80 con 0x7f326806e490 2024-04-24T08:25:56.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.881+0000 7f3264c00640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3248068380 0x7f324806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:56.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.881+0000 7f3264c00640 1 -- 172.21.15.88:0/3120903918 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f325c086c80 con 0x7f326806e490 2024-04-24T08:25:56.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.881+0000 7f3267e00640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3248068380 0x7f324806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:56.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.881+0000 7f3267e00640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3248068380 0x7f324806a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3268143860 tx=0x7f3254007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:56.885+0000 7f3264c00640 1 -- 172.21.15.88:0/3120903918 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f325c056be0 con 0x7f326806e490 2024-04-24T08:25:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.041+0000 7f326f600640 1 -- 172.21.15.88:0/3120903918 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f32681e0730 con 0x7f326806e490 2024-04-24T08:25:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.041+0000 7f3264c00640 1 -- 172.21.15.88:0/3120903918 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f325c05aee0 con 0x7f326806e490 2024-04-24T08:25:57.045 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:25:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.045+0000 7f326f600640 1 -- 172.21.15.88:0/3120903918 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3248068380 msgr2=0x7f324806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.045+0000 7f326f600640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3248068380 0x7f324806a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3268143860 tx=0x7f3254007e40 comp rx=0 tx=0).stop 2024-04-24T08:25:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.045+0000 7f326f600640 1 -- 172.21.15.88:0/3120903918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806e490 msgr2=0x7f32681e3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.045+0000 7f326f600640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806e490 0x7f32681e3ca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f325c00d620 tx=0x7f325c00dae0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.045+0000 7f326f600640 1 -- 172.21.15.88:0/3120903918 shutdown_connections 2024-04-24T08:25:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.045+0000 7f326f600640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3248068380 0x7f324806a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.045+0000 7f326f600640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32680b4c90 0x7f326813c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.045+0000 7f326f600640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f326809e7a0 0x7f32680af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.045+0000 7f326f600640 1 --2- 172.21.15.88:0/3120903918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806e490 0x7f32681e3ca0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.045+0000 7f326f600640 1 -- 172.21.15.88:0/3120903918 >> 172.21.15.88:0/3120903918 conn(0x7f32680b9690 msgr2=0x7f326814fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.045+0000 7f326f600640 1 -- 172.21.15.88:0/3120903918 shutdown_connections 2024-04-24T08:25:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.045+0000 7f326f600640 1 -- 172.21.15.88:0/3120903918 wait complete. 2024-04-24T08:25:57.067 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T08:25:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2f01000640 1 Processor -- start 2024-04-24T08:25:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2f01000640 1 -- start start 2024-04-24T08:25:57.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2f01000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2efc0ae4e0 0x7f2efc13e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2f01000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2efc0737c0 0x7f2efc13eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2f01000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2efc0b0580 con 0x7f2efc0b01a0 2024-04-24T08:25:57.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2f01000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2efc0b59d0 con 0x7f2efc0737c0 2024-04-24T08:25:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2f01000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2efc0ae970 con 0x7f2efc0ae4e0 2024-04-24T08:25:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2efc0b01a0 0x7f2efc06d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50400/0 (socket says 172.21.15.88:50400) 2024-04-24T08:25:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9e00640 1 -- 172.21.15.88:0/2761966118 learned_addr learned my addr 172.21.15.88:0/2761966118 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2efa800640 1 --2- 172.21.15.88:0/2761966118 >> v2:172.21.15.142:3300/0 conn(0x7f2efc0737c0 0x7f2efc13eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef1400640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2efc0ae4e0 0x7f2efc13e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3980707717 0 0) 0x7f2efc0b0580 con 0x7f2efc0b01a0 2024-04-24T08:25:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ee0003530 con 0x7f2efc0b01a0 2024-04-24T08:25:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3909295491 0 0) 0x7f2ee0003530 con 0x7f2efc0b01a0 2024-04-24T08:25:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2efc0ae4e0 msgr2=0x7f2efc13e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2efc0ae4e0 0x7f2efc13e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 >> v2:172.21.15.142:3300/0 conn(0x7f2efc0737c0 msgr2=0x7f2efc13eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 --2- 172.21.15.88:0/2761966118 >> v2:172.21.15.142:3300/0 conn(0x7f2efc0737c0 0x7f2efc13eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc0b53a0 con 0x7f2efc0b01a0 2024-04-24T08:25:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f2eec001a00 con 0x7f2efc0b01a0 2024-04-24T08:25:57.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 >> v1:172.21.15.88:6789/0 conn(0x7f2efc0b01a0 legacy=0x7f2efc06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee00039c0 0x7f2ee0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee0004810 0x7f2ee0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00051d0 0x7f2ee000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc0b59d0 con 0x7f2ee0004810 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc0ae970 con 0x7f2ee00039c0 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee000bf10 con 0x7f2ee00051d0 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef1400640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee0004810 0x7f2ee0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef9e00640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee00039c0 0x7f2ee0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2efa800640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00051d0 0x7f2ee000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef1400640 1 -- 172.21.15.88:0/2761966118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00051d0 msgr2=0x7f2ee000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef1400640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00051d0 0x7f2ee000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef1400640 1 -- 172.21.15.88:0/2761966118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee00039c0 msgr2=0x7f2ee0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:57.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef1400640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee00039c0 0x7f2ee0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2ef1400640 1 -- 172.21.15.88:0/2761966118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee0003530 con 0x7f2ee0004810 2024-04-24T08:25:57.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.205+0000 7f2efa800640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00051d0 0x7f2ee000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.209+0000 7f2ef1400640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee0004810 0x7f2ee0004c90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009ae0 tx=0x7f2ee401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791becc24c3bbc32 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.209+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40b2070 con 0x7f2ee0004810 2024-04-24T08:25:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.209+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee40a5550 con 0x7f2ee0004810 2024-04-24T08:25:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.209+0000 7f2ef9400640 1 -- 172.21.15.88:0/2761966118 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40096b0 con 0x7f2ee0004810 2024-04-24T08:25:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.209+0000 7f2f01000640 1 -- 172.21.15.88:0/2761966118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee0004810 msgr2=0x7f2ee0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.209+0000 7f2f01000640 1 --2- 172.21.15.88:0/2761966118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee0004810 0x7f2ee0004c90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009ae0 tx=0x7f2ee401ca70 comp rx=0 tx=0).stop 2024-04-24T08:25:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.209+0000 7f2efa800640 1 -- 172.21.15.88:0/2761966118 reap_dead start 2024-04-24T08:25:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.209+0000 7f2f01000640 1 -- 172.21.15.88:0/2761966118 shutdown_connections 2024-04-24T08:25:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.209+0000 7f2f01000640 1 -- 172.21.15.88:0/2761966118 >> 172.21.15.88:0/2761966118 conn(0x7f2efc0b9690 msgr2=0x7f2efc0b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.209+0000 7f2f01000640 1 -- 172.21.15.88:0/2761966118 shutdown_connections 2024-04-24T08:25:57.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.209+0000 7f2f01000640 1 -- 172.21.15.88:0/2761966118 wait complete. 2024-04-24T08:25:57.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2f01000640 1 Processor -- start 2024-04-24T08:25:57.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2f01000640 1 -- start start 2024-04-24T08:25:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2f01000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee0004810 0x7f2efc09da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2f01000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2efc070600 0x7f2efc1e0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2f01000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2efc071460 0x7f2efc1e3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2f01000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc14fe50 con 0x7f2ee0004810 2024-04-24T08:25:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2f01000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc06e470 con 0x7f2efc070600 2024-04-24T08:25:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2f01000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2efc14ffd0 con 0x7f2efc071460 2024-04-24T08:25:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef9e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee0004810 0x7f2efc09da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef9e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee0004810 0x7f2efc09da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59484/0 (socket says 172.21.15.88:59484) 2024-04-24T08:25:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef9e00640 1 -- 172.21.15.88:0/2467620491 learned_addr learned my addr 172.21.15.88:0/2467620491 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2efa800640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2efc071460 0x7f2efc1e3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef1400640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2efc070600 0x7f2efc1e0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef9e00640 1 -- 172.21.15.88:0/2467620491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2efc071460 msgr2=0x7f2efc1e3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef9e00640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2efc071460 0x7f2efc1e3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef9e00640 1 -- 172.21.15.88:0/2467620491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2efc070600 msgr2=0x7f2efc1e0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef9e00640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2efc070600 0x7f2efc1e0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef9e00640 1 -- 172.21.15.88:0/2467620491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc1e02a0 con 0x7f2ee0004810 2024-04-24T08:25:57.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2efa800640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2efc071460 0x7f2efc1e3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:57.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef9e00640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee0004810 0x7f2efc09da30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0077f0 tx=0x7f2eec00a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:57.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef2a00640 1 -- 172.21.15.88:0/2467620491 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0133f0 con 0x7f2ee0004810 2024-04-24T08:25:57.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef2a00640 1 -- 172.21.15.88:0/2467620491 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eec018070 con 0x7f2ee0004810 2024-04-24T08:25:57.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2ef2a00640 1 -- 172.21.15.88:0/2467620491 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0137f0 con 0x7f2ee0004810 2024-04-24T08:25:57.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2f01000640 1 -- 172.21.15.88:0/2467620491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2efc071940 con 0x7f2ee0004810 2024-04-24T08:25:57.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2f01000640 1 -- 172.21.15.88:0/2467620491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2efc070ac0 con 0x7f2ee0004810 2024-04-24T08:25:57.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.213+0000 7f2f01000640 1 -- 172.21.15.88:0/2467620491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2efc068c00 con 0x7f2ee0004810 2024-04-24T08:25:57.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.217+0000 7f2ef2a00640 1 -- 172.21.15.88:0/2467620491 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2eec013990 con 0x7f2ee0004810 2024-04-24T08:25:57.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.217+0000 7f2ef2a00640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2ed8068380 0x7f2ed806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.217+0000 7f2ef2a00640 1 -- 172.21.15.88:0/2467620491 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2eec087200 con 0x7f2ee0004810 2024-04-24T08:25:57.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.217+0000 7f2ef1400640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2ed8068380 0x7f2ed806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.217+0000 7f2ef1400640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2ed8068380 0x7f2ed806a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40af000 tx=0x7f2ee40046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:57.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.221+0000 7f2ef2a00640 1 -- 172.21.15.88:0/2467620491 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2eec0577b0 con 0x7f2ee0004810 2024-04-24T08:25:57.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.377+0000 7f2f01000640 1 -- 172.21.15.88:0/2467620491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2efc0b3f60 con 0x7f2ee0004810 2024-04-24T08:25:57.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.377+0000 7f2ef2a00640 1 -- 172.21.15.88:0/2467620491 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f2eec0570b0 con 0x7f2ee0004810 2024-04-24T08:25:57.380 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-24T08:25:57.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.381+0000 7f2f01000640 1 -- 172.21.15.88:0/2467620491 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2ed8068380 msgr2=0x7f2ed806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.381+0000 7f2f01000640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2ed8068380 0x7f2ed806a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40af000 tx=0x7f2ee40046d0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.381+0000 7f2f01000640 1 -- 172.21.15.88:0/2467620491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee0004810 msgr2=0x7f2efc09da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.381+0000 7f2f01000640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee0004810 0x7f2efc09da30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0077f0 tx=0x7f2eec00a750 comp rx=0 tx=0).stop 2024-04-24T08:25:57.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.381+0000 7f2f01000640 1 -- 172.21.15.88:0/2467620491 shutdown_connections 2024-04-24T08:25:57.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.381+0000 7f2f01000640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2ed8068380 0x7f2ed806a840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.381+0000 7f2f01000640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2efc071460 0x7f2efc1e3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.381+0000 7f2f01000640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2efc070600 0x7f2efc1e0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.381+0000 7f2f01000640 1 --2- 172.21.15.88:0/2467620491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee0004810 0x7f2efc09da30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.381+0000 7f2f01000640 1 -- 172.21.15.88:0/2467620491 >> 172.21.15.88:0/2467620491 conn(0x7f2efc0b9690 msgr2=0x7f2efc06d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:57.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.381+0000 7f2f01000640 1 -- 172.21.15.88:0/2467620491 shutdown_connections 2024-04-24T08:25:57.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.381+0000 7f2f01000640 1 -- 172.21.15.88:0/2467620491 wait complete. 2024-04-24T08:25:57.402 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T08:25:57.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.537+0000 7efeaf000640 1 Processor -- start 2024-04-24T08:25:57.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.537+0000 7efeaf000640 1 -- start start 2024-04-24T08:25:57.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.537+0000 7efeaf000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efea80adb30 0x7efea80ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeaf000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efea8148060 0x7efea8152480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeaf000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efea80adf10 con 0x7efea8147be0 2024-04-24T08:25:57.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeaf000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7efea80b3110 con 0x7efea8148060 2024-04-24T08:25:57.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeaf000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7efea80af2c0 con 0x7efea80adb30 2024-04-24T08:25:57.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeae600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efea8148060 0x7efea8152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeae600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efea8148060 0x7efea8152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59490/0 (socket says 172.21.15.88:59490) 2024-04-24T08:25:57.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeae600640 1 -- 172.21.15.88:0/4072230864 learned_addr learned my addr 172.21.15.88:0/4072230864 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:57.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeae600640 1 -- 172.21.15.88:0/4072230864 >> v2:172.21.15.142:3300/0 conn(0x7efea80adb30 msgr2=0x7efea80ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:57.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeadc00640 1 --2- 172.21.15.88:0/4072230864 >> v2:172.21.15.142:3300/0 conn(0x7efea80adb30 0x7efea80ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeae600640 1 --2- 172.21.15.88:0/4072230864 >> v2:172.21.15.142:3300/0 conn(0x7efea80adb30 0x7efea80ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeae600640 1 -- 172.21.15.88:0/4072230864 >> v1:172.21.15.142:6789/0 conn(0x7efea8147be0 legacy=0x7efea80b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:57.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeae600640 1 -- 172.21.15.88:0/4072230864 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea80b3360 con 0x7efea8148060 2024-04-24T08:25:57.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeadc00640 1 --2- 172.21.15.88:0/4072230864 >> v2:172.21.15.142:3300/0 conn(0x7efea80adb30 0x7efea80ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:57.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.541+0000 7efeae600640 1 --2- 172.21.15.88:0/4072230864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea8148060 0x7efea8152480 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efea80ba320 tx=0x7efea001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a322eb8806bb06b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:57.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efea7e00640 1 -- 172.21.15.88:0/4072230864 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea00a5550 con 0x7efea8148060 2024-04-24T08:25:57.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efea7e00640 1 -- 172.21.15.88:0/4072230864 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea00a56f0 con 0x7efea8148060 2024-04-24T08:25:57.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efea7e00640 1 -- 172.21.15.88:0/4072230864 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea00a5ac0 con 0x7efea8148060 2024-04-24T08:25:57.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 -- 172.21.15.88:0/4072230864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea8148060 msgr2=0x7efea8152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 --2- 172.21.15.88:0/4072230864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea8148060 0x7efea8152480 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efea80ba320 tx=0x7efea001c890 comp rx=0 tx=0).stop 2024-04-24T08:25:57.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 -- 172.21.15.88:0/4072230864 shutdown_connections 2024-04-24T08:25:57.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 --2- 172.21.15.88:0/4072230864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea8148060 0x7efea8152480 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 --2- 172.21.15.88:0/4072230864 >> v2:172.21.15.142:3300/0 conn(0x7efea80adb30 0x7efea80ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 -- 172.21.15.88:0/4072230864 >> 172.21.15.88:0/4072230864 conn(0x7efea80b9260 msgr2=0x7efea80b9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:57.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 -- 172.21.15.88:0/4072230864 shutdown_connections 2024-04-24T08:25:57.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 -- 172.21.15.88:0/4072230864 wait complete. 2024-04-24T08:25:57.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 Processor -- start 2024-04-24T08:25:57.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 -- start start 2024-04-24T08:25:57.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efea80adb30 0x7efea8142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efea8147be0 0x7efea8140f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea8148060 0x7efea81e05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efea80b58e0 con 0x7efea8148060 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7efea80b5760 con 0x7efea80adb30 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeaf000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7efea80af730 con 0x7efea8147be0 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeae600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea8148060 0x7efea81e05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeae600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea8148060 0x7efea81e05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59496/0 (socket says 172.21.15.88:59496) 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeae600640 1 -- 172.21.15.88:0/1575436936 learned_addr learned my addr 172.21.15.88:0/1575436936 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeadc00640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efea80adb30 0x7efea8142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efead200640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efea8147be0 0x7efea8140f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeae600640 1 -- 172.21.15.88:0/1575436936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efea8147be0 msgr2=0x7efea8140f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeae600640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efea8147be0 0x7efea8140f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeae600640 1 -- 172.21.15.88:0/1575436936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efea80adb30 msgr2=0x7efea8142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeae600640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efea80adb30 0x7efea8142d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.545+0000 7efeae600640 1 -- 172.21.15.88:0/1575436936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea81450d0 con 0x7efea8148060 2024-04-24T08:25:57.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.549+0000 7efeae600640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea8148060 0x7efea81e05b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efea001a4c0 tx=0x7efea0019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:57.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.549+0000 7efea5600640 1 -- 172.21.15.88:0/1575436936 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea00bc020 con 0x7efea8148060 2024-04-24T08:25:57.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.549+0000 7efea5600640 1 -- 172.21.15.88:0/1575436936 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea00b8670 con 0x7efea8148060 2024-04-24T08:25:57.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.549+0000 7efea5600640 1 -- 172.21.15.88:0/1575436936 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0009510 con 0x7efea8148060 2024-04-24T08:25:57.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.549+0000 7efeaf000640 1 -- 172.21.15.88:0/1575436936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea8144600 con 0x7efea8148060 2024-04-24T08:25:57.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.549+0000 7efeaf000640 1 -- 172.21.15.88:0/1575436936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea8144320 con 0x7efea8148060 2024-04-24T08:25:57.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.549+0000 7efeaf000640 1 -- 172.21.15.88:0/1575436936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea8145580 con 0x7efea8148060 2024-04-24T08:25:57.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.549+0000 7efea5600640 1 -- 172.21.15.88:0/1575436936 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efea00bf020 con 0x7efea8148060 2024-04-24T08:25:57.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.549+0000 7efea5600640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efe880683b0 0x7efe8806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.549+0000 7efea5600640 1 -- 172.21.15.88:0/1575436936 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efea0121850 con 0x7efea8148060 2024-04-24T08:25:57.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.549+0000 7efeadc00640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efe880683b0 0x7efe8806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.549+0000 7efeadc00640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efe880683b0 0x7efe8806a870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00ab60 tx=0x7efe9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:57.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.553+0000 7efea5600640 1 -- 172.21.15.88:0/1575436936 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efea8145580 con 0x7efea8148060 2024-04-24T08:25:57.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.709+0000 7efeaf000640 1 -- 172.21.15.88:0/1575436936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efea8068b20 con 0x7efea8148060 2024-04-24T08:25:57.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.709+0000 7efea5600640 1 -- 172.21.15.88:0/1575436936 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7efea00c6030 con 0x7efea8148060 2024-04-24T08:25:57.711 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-24T08:25:57.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.713+0000 7efeaf000640 1 -- 172.21.15.88:0/1575436936 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efe880683b0 msgr2=0x7efe8806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.713+0000 7efeaf000640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efe880683b0 0x7efe8806a870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00ab60 tx=0x7efe9c008040 comp rx=0 tx=0).stop 2024-04-24T08:25:57.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.713+0000 7efeaf000640 1 -- 172.21.15.88:0/1575436936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea8148060 msgr2=0x7efea81e05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.713+0000 7efeaf000640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea8148060 0x7efea81e05b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efea001a4c0 tx=0x7efea0019630 comp rx=0 tx=0).stop 2024-04-24T08:25:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.713+0000 7efeaf000640 1 -- 172.21.15.88:0/1575436936 shutdown_connections 2024-04-24T08:25:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.713+0000 7efeaf000640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efe880683b0 0x7efe8806a870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.713+0000 7efeaf000640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efea8148060 0x7efea81e05b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.713+0000 7efeaf000640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efea8147be0 0x7efea8140f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.713+0000 7efeaf000640 1 --2- 172.21.15.88:0/1575436936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efea80adb30 0x7efea8142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.713+0000 7efeaf000640 1 -- 172.21.15.88:0/1575436936 >> 172.21.15.88:0/1575436936 conn(0x7efea80b9260 msgr2=0x7efea81484a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.713+0000 7efeaf000640 1 -- 172.21.15.88:0/1575436936 shutdown_connections 2024-04-24T08:25:57.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.713+0000 7efeaf000640 1 -- 172.21.15.88:0/1575436936 wait complete. 2024-04-24T08:25:57.733 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:25:57.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa950400640 1 Processor -- start 2024-04-24T08:25:57.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa950400640 1 -- start start 2024-04-24T08:25:57.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa950400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9480b9d90 0x7fa9481450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa950400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa9480b44e0 0x7fa9480b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa950400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa948145620 con 0x7fa948148130 2024-04-24T08:25:57.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa950400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa948145b80 con 0x7fa9480b44e0 2024-04-24T08:25:57.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa950400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa9480ba170 con 0x7fa9480b9d90 2024-04-24T08:25:57.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa94e400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa948148130 0x7fa9481485c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46656/0 (socket says 172.21.15.88:46656) 2024-04-24T08:25:57.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa94e400640 1 -- 172.21.15.88:0/558032891 learned_addr learned my addr 172.21.15.88:0/558032891 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:57.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa94d000640 1 --2- 172.21.15.88:0/558032891 >> v2:172.21.15.88:3300/0 conn(0x7fa9480b44e0 0x7fa9480b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa94da00640 1 --2- 172.21.15.88:0/558032891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9480b9d90 0x7fa9481450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa94d000640 1 -- 172.21.15.88:0/558032891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9480b9d90 msgr2=0x7fa9481450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:57.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa94d000640 1 --2- 172.21.15.88:0/558032891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9480b9d90 0x7fa9481450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa94d000640 1 -- 172.21.15.88:0/558032891 >> v1:172.21.15.88:6789/0 conn(0x7fa948148130 legacy=0x7fa9481485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.865+0000 7fa94d000640 1 -- 172.21.15.88:0/558032891 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9481458a0 con 0x7fa9480b44e0 2024-04-24T08:25:57.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.869+0000 7fa94d000640 1 --2- 172.21.15.88:0/558032891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9480b44e0 0x7fa9480b4940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa9340097c0 tx=0x7fa93401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91134bbf4f594436 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:57.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.869+0000 7fa947e00640 1 -- 172.21.15.88:0/558032891 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9340b0070 con 0x7fa9480b44e0 2024-04-24T08:25:57.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.869+0000 7fa947e00640 1 -- 172.21.15.88:0/558032891 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9340ab600 con 0x7fa9480b44e0 2024-04-24T08:25:57.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.869+0000 7fa947e00640 1 -- 172.21.15.88:0/558032891 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9340ab9d0 con 0x7fa9480b44e0 2024-04-24T08:25:57.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.869+0000 7fa950400640 1 -- 172.21.15.88:0/558032891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9480b44e0 msgr2=0x7fa9480b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.869+0000 7fa950400640 1 --2- 172.21.15.88:0/558032891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9480b44e0 0x7fa9480b4940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa9340097c0 tx=0x7fa93401c4a0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.869+0000 7fa950400640 1 -- 172.21.15.88:0/558032891 shutdown_connections 2024-04-24T08:25:57.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.869+0000 7fa950400640 1 --2- 172.21.15.88:0/558032891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9480b44e0 0x7fa9480b4940 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.869+0000 7fa950400640 1 --2- 172.21.15.88:0/558032891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9480b9d90 0x7fa9481450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.869+0000 7fa950400640 1 -- 172.21.15.88:0/558032891 >> 172.21.15.88:0/558032891 conn(0x7fa94806c0d0 msgr2=0x7fa9480b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:57.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.869+0000 7fa950400640 1 -- 172.21.15.88:0/558032891 shutdown_connections 2024-04-24T08:25:57.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.869+0000 7fa950400640 1 -- 172.21.15.88:0/558032891 wait complete. 2024-04-24T08:25:57.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa950400640 1 Processor -- start 2024-04-24T08:25:57.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa950400640 1 -- start start 2024-04-24T08:25:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa950400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9480b44e0 0x7fa9481e1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa950400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9480b9d90 0x7fa9481491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa950400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa948148130 0x7fa948149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa950400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa948152010 con 0x7fa948148130 2024-04-24T08:25:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa950400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa948151e90 con 0x7fa9480b44e0 2024-04-24T08:25:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa950400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa948152190 con 0x7fa9480b9d90 2024-04-24T08:25:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa94e400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa948148130 0x7fa948149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa94e400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa948148130 0x7fa948149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53920/0 (socket says 172.21.15.88:53920) 2024-04-24T08:25:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa94e400640 1 -- 172.21.15.88:0/4006880064 learned_addr learned my addr 172.21.15.88:0/4006880064 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa94d000640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9480b9d90 0x7fa9481491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa94da00640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9480b44e0 0x7fa9481e1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa94e400640 1 -- 172.21.15.88:0/4006880064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9480b9d90 msgr2=0x7fa9481491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa94e400640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9480b9d90 0x7fa9481491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa94e400640 1 -- 172.21.15.88:0/4006880064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9480b44e0 msgr2=0x7fa9481e1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:57.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa94e400640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9480b44e0 0x7fa9481e1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:57.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa94e400640 1 -- 172.21.15.88:0/4006880064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94814efd0 con 0x7fa948148130 2024-04-24T08:25:57.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa94e400640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa948148130 0x7fa948149710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa94000cab0 tx=0x7fa94000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:57.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa945600640 1 -- 172.21.15.88:0/4006880064 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa940017070 con 0x7fa948148130 2024-04-24T08:25:57.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa945600640 1 -- 172.21.15.88:0/4006880064 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94000abd0 con 0x7fa948148130 2024-04-24T08:25:57.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa945600640 1 -- 172.21.15.88:0/4006880064 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa940012400 con 0x7fa948148130 2024-04-24T08:25:57.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa950400640 1 -- 172.21.15.88:0/4006880064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa94814e7f0 con 0x7fa948148130 2024-04-24T08:25:57.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa950400640 1 -- 172.21.15.88:0/4006880064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9481e2960 con 0x7fa948148130 2024-04-24T08:25:57.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.873+0000 7fa950400640 1 -- 172.21.15.88:0/4006880064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa948068b90 con 0x7fa948148130 2024-04-24T08:25:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.877+0000 7fa945600640 1 -- 172.21.15.88:0/4006880064 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa94001a070 con 0x7fa948148130 2024-04-24T08:25:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.877+0000 7fa945600640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9280683b0 0x7fa92806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.877+0000 7fa945600640 1 -- 172.21.15.88:0/4006880064 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa940086530 con 0x7fa948148130 2024-04-24T08:25:57.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.877+0000 7fa94da00640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9280683b0 0x7fa92806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:57.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.877+0000 7fa94da00640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9280683b0 0x7fa92806a870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa94814ce30 tx=0x7fa93c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:57.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:57.881+0000 7fa945600640 1 -- 172.21.15.88:0/4006880064 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa94814e7f0 con 0x7fa948148130 2024-04-24T08:25:58.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.069+0000 7fa950400640 1 -- 172.21.15.88:0/4006880064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9481e24b0 con 0x7fa948148130 2024-04-24T08:25:58.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.069+0000 7fa945600640 1 -- 172.21.15.88:0/4006880064 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7fa948145620 con 0x7fa948148130 2024-04-24T08:25:58.073 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:58.073 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1421585339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1421585339},{"type":"v1","addr":"172.21.15.142:6833","nonce":1421585339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:25:27.478065+0000","modified":"2024-04-24T08:25:30.500783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2851985776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2851985776},{"type":"v1","addr":"172.21.15.88:6835","nonce":2851985776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-24T08:25:58.074 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2024-04-24T08:25:58.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.073+0000 7fa950400640 1 -- 172.21.15.88:0/4006880064 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9280683b0 msgr2=0x7fa92806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.073+0000 7fa950400640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9280683b0 0x7fa92806a870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa94814ce30 tx=0x7fa93c008040 comp rx=0 tx=0).stop 2024-04-24T08:25:58.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.073+0000 7fa950400640 1 -- 172.21.15.88:0/4006880064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa948148130 msgr2=0x7fa948149710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.073+0000 7fa950400640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa948148130 0x7fa948149710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa94000cab0 tx=0x7fa94000cf70 comp rx=0 tx=0).stop 2024-04-24T08:25:58.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.073+0000 7fa950400640 1 -- 172.21.15.88:0/4006880064 shutdown_connections 2024-04-24T08:25:58.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.073+0000 7fa950400640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9280683b0 0x7fa92806a870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.073+0000 7fa950400640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa948148130 0x7fa948149710 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.073+0000 7fa950400640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9480b9d90 0x7fa9481491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.073+0000 7fa950400640 1 --2- 172.21.15.88:0/4006880064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9480b44e0 0x7fa9481e1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.073+0000 7fa950400640 1 -- 172.21.15.88:0/4006880064 >> 172.21.15.88:0/4006880064 conn(0x7fa94806c0d0 msgr2=0x7fa9480b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:58.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.073+0000 7fa950400640 1 -- 172.21.15.88:0/4006880064 shutdown_connections 2024-04-24T08:25:58.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.073+0000 7fa950400640 1 -- 172.21.15.88:0/4006880064 wait complete. 2024-04-24T08:25:58.094 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:58.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.225+0000 7fa81cc00640 1 Processor -- start 2024-04-24T08:25:58.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.225+0000 7fa81cc00640 1 -- start start 2024-04-24T08:25:58.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa81cc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8180b9d90 0x7fa8181450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa81cc00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8180b44e0 0x7fa8180b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa81cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa818148130 0x7fa8181485a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa81cc00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa818145b80 con 0x7fa8180b44e0 2024-04-24T08:25:58.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa81cc00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa818145620 con 0x7fa8180b9d90 2024-04-24T08:25:58.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa81cc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa8180ba170 con 0x7fa818148130 2024-04-24T08:25:58.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa80d400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8180b44e0 0x7fa8180b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa80d400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8180b44e0 0x7fa8180b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53932/0 (socket says 172.21.15.88:53932) 2024-04-24T08:25:58.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa80d400640 1 -- 172.21.15.88:0/4141632429 learned_addr learned my addr 172.21.15.88:0/4141632429 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:58.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa815e00640 1 --2- 172.21.15.88:0/4141632429 >> v2:172.21.15.142:3300/0 conn(0x7fa8180b9d90 0x7fa8181450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa816800640 1 --2- 172.21.15.88:0/4141632429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa818148130 0x7fa8181485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa80d400640 1 -- 172.21.15.88:0/4141632429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa818148130 msgr2=0x7fa8181485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:58.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa80d400640 1 --2- 172.21.15.88:0/4141632429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa818148130 0x7fa8181485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa80d400640 1 -- 172.21.15.88:0/4141632429 >> v2:172.21.15.142:3300/0 conn(0x7fa8180b9d90 msgr2=0x7fa8181450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:58.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa80d400640 1 --2- 172.21.15.88:0/4141632429 >> v2:172.21.15.142:3300/0 conn(0x7fa8180b9d90 0x7fa8181450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa80d400640 1 -- 172.21.15.88:0/4141632429 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8181458a0 con 0x7fa8180b44e0 2024-04-24T08:25:58.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.229+0000 7fa815e00640 1 --2- 172.21.15.88:0/4141632429 >> v2:172.21.15.142:3300/0 conn(0x7fa8180b9d90 0x7fa8181450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:58.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa80d400640 1 --2- 172.21.15.88:0/4141632429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8180b44e0 0x7fa8180b4970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa81806e410 tx=0x7fa80001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5513438973248f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:58.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa815400640 1 -- 172.21.15.88:0/4141632429 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8000b0070 con 0x7fa8180b44e0 2024-04-24T08:25:58.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa815400640 1 -- 172.21.15.88:0/4141632429 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8000ab600 con 0x7fa8180b44e0 2024-04-24T08:25:58.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa815400640 1 -- 172.21.15.88:0/4141632429 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8000ab9d0 con 0x7fa8180b44e0 2024-04-24T08:25:58.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 -- 172.21.15.88:0/4141632429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8180b44e0 msgr2=0x7fa8180b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 --2- 172.21.15.88:0/4141632429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8180b44e0 0x7fa8180b4970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa81806e410 tx=0x7fa80001c490 comp rx=0 tx=0).stop 2024-04-24T08:25:58.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 -- 172.21.15.88:0/4141632429 shutdown_connections 2024-04-24T08:25:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 --2- 172.21.15.88:0/4141632429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa818148130 0x7fa8181485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 --2- 172.21.15.88:0/4141632429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8180b44e0 0x7fa8180b4970 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 --2- 172.21.15.88:0/4141632429 >> v2:172.21.15.142:3300/0 conn(0x7fa8180b9d90 0x7fa8181450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 -- 172.21.15.88:0/4141632429 >> 172.21.15.88:0/4141632429 conn(0x7fa81806c0d0 msgr2=0x7fa8180b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 -- 172.21.15.88:0/4141632429 shutdown_connections 2024-04-24T08:25:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 -- 172.21.15.88:0/4141632429 wait complete. 2024-04-24T08:25:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 Processor -- start 2024-04-24T08:25:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 -- start start 2024-04-24T08:25:58.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8180b44e0 0x7fa81814e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8180b9d90 0x7fa8180b8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818148130 0x7fa8181e0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa81809e3d0 con 0x7fa818148130 2024-04-24T08:25:58.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa8181443c0 con 0x7fa8180b44e0 2024-04-24T08:25:58.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa81cc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa8180b7ba0 con 0x7fa8180b9d90 2024-04-24T08:25:58.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa816800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818148130 0x7fa8181e0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa816800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818148130 0x7fa8181e0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53942/0 (socket says 172.21.15.88:53942) 2024-04-24T08:25:58.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.233+0000 7fa816800640 1 -- 172.21.15.88:0/1815936713 learned_addr learned my addr 172.21.15.88:0/1815936713 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:58.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa815e00640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8180b44e0 0x7fa81814e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa80d400640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8180b9d90 0x7fa8180b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa816800640 1 -- 172.21.15.88:0/1815936713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8180b9d90 msgr2=0x7fa8180b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa816800640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8180b9d90 0x7fa8180b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa816800640 1 -- 172.21.15.88:0/1815936713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8180b44e0 msgr2=0x7fa81814e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa816800640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8180b44e0 0x7fa81814e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa816800640 1 -- 172.21.15.88:0/1815936713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81814d680 con 0x7fa818148130 2024-04-24T08:25:58.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa816800640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818148130 0x7fa8181e0f60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa81000d560 tx=0x7fa81000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:58.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa80ea00640 1 -- 172.21.15.88:0/1815936713 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8100125f0 con 0x7fa818148130 2024-04-24T08:25:58.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa80ea00640 1 -- 172.21.15.88:0/1815936713 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa810019070 con 0x7fa818148130 2024-04-24T08:25:58.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa81cc00640 1 -- 172.21.15.88:0/1815936713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8180b89a0 con 0x7fa818148130 2024-04-24T08:25:58.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa80ea00640 1 -- 172.21.15.88:0/1815936713 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8100129f0 con 0x7fa818148130 2024-04-24T08:25:58.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa81cc00640 1 -- 172.21.15.88:0/1815936713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8180b7550 con 0x7fa818148130 2024-04-24T08:25:58.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa81cc00640 1 -- 172.21.15.88:0/1815936713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8181e0c40 con 0x7fa818148130 2024-04-24T08:25:58.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.237+0000 7fa80ea00640 1 -- 172.21.15.88:0/1815936713 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa810012b90 con 0x7fa818148130 2024-04-24T08:25:58.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.241+0000 7fa80ea00640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7f4068380 0x7fa7f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.241+0000 7fa80ea00640 1 -- 172.21.15.88:0/1815936713 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa810086d60 con 0x7fa818148130 2024-04-24T08:25:58.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.241+0000 7fa815e00640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7f4068380 0x7fa7f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.241+0000 7fa815e00640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7f4068380 0x7fa7f406a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa808009a80 tx=0x7fa808003cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:58.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.245+0000 7fa80ea00640 1 -- 172.21.15.88:0/1815936713 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa8181e0c40 con 0x7fa818148130 2024-04-24T08:25:58.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.405+0000 7fa81cc00640 1 -- 172.21.15.88:0/1815936713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa818068b90 con 0x7fa818148130 2024-04-24T08:25:58.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.405+0000 7fa80ea00640 1 -- 172.21.15.88:0/1815936713 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fa810057310 con 0x7fa818148130 2024-04-24T08:25:58.407 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:58.407 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:58.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.409+0000 7fa81cc00640 1 -- 172.21.15.88:0/1815936713 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7f4068380 msgr2=0x7fa7f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.409+0000 7fa81cc00640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7f4068380 0x7fa7f406a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa808009a80 tx=0x7fa808003cf0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.409+0000 7fa81cc00640 1 -- 172.21.15.88:0/1815936713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818148130 msgr2=0x7fa8181e0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.409+0000 7fa81cc00640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818148130 0x7fa8181e0f60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa81000d560 tx=0x7fa81000da20 comp rx=0 tx=0).stop 2024-04-24T08:25:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.409+0000 7fa81cc00640 1 -- 172.21.15.88:0/1815936713 shutdown_connections 2024-04-24T08:25:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.409+0000 7fa81cc00640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7f4068380 0x7fa7f406a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.409+0000 7fa81cc00640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818148130 0x7fa8181e0f60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.409+0000 7fa81cc00640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8180b9d90 0x7fa8180b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.409+0000 7fa81cc00640 1 --2- 172.21.15.88:0/1815936713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8180b44e0 0x7fa81814e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.409+0000 7fa81cc00640 1 -- 172.21.15.88:0/1815936713 >> 172.21.15.88:0/1815936713 conn(0x7fa81806c0d0 msgr2=0x7fa8180b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.409+0000 7fa81cc00640 1 -- 172.21.15.88:0/1815936713 shutdown_connections 2024-04-24T08:25:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.409+0000 7fa81cc00640 1 -- 172.21.15.88:0/1815936713 wait complete. 2024-04-24T08:25:58.427 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T08:25:58.427 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:25:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa13200640 1 Processor -- start 2024-04-24T08:25:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa13200640 1 -- start start 2024-04-24T08:25:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa13200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0c06e720 0x7faa0c0b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa13200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faa0c06cbe0 0x7faa0c0b7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa13200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0c06eb00 con 0x7faa0c14c2c0 2024-04-24T08:25:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa13200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7faa0c14be30 con 0x7faa0c06cbe0 2024-04-24T08:25:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa13200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faa0c14b7e0 con 0x7faa0c06e720 2024-04-24T08:25:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa11200640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faa0c14c2c0 0x7faa0c148140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46662/0 (socket says 172.21.15.88:46662) 2024-04-24T08:25:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa11200640 1 -- 172.21.15.88:0/1550778891 learned_addr learned my addr 172.21.15.88:0/1550778891 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa03400640 1 --2- 172.21.15.88:0/1550778891 >> v2:172.21.15.88:3300/0 conn(0x7faa0c06cbe0 0x7faa0c0b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa0be00640 1 --2- 172.21.15.88:0/1550778891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0c06e720 0x7faa0c0b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa03400640 1 -- 172.21.15.88:0/1550778891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0c06e720 msgr2=0x7faa0c0b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa03400640 1 --2- 172.21.15.88:0/1550778891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0c06e720 0x7faa0c0b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa03400640 1 -- 172.21.15.88:0/1550778891 >> v1:172.21.15.88:6789/0 conn(0x7faa0c14c2c0 legacy=0x7faa0c148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa0b400640 1 -- 172.21.15.88:0/1550778891 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571754123 0 0) 0x7faa0c06eb00 con 0x7faa0c14c2c0 2024-04-24T08:25:58.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa03400640 1 -- 172.21.15.88:0/1550778891 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c14bac0 con 0x7faa0c06cbe0 2024-04-24T08:25:58.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.561+0000 7faa0be00640 1 --2- 172.21.15.88:0/1550778891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0c06e720 0x7faa0c0b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:25:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.565+0000 7faa03400640 1 --2- 172.21.15.88:0/1550778891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0c06cbe0 0x7faa0c0b7550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40097c0 tx=0x7fa9f401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e904284dfbd751b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.565+0000 7faa0b400640 1 -- 172.21.15.88:0/1550778891 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40b0070 con 0x7faa0c06cbe0 2024-04-24T08:25:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.565+0000 7faa0b400640 1 -- 172.21.15.88:0/1550778891 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f40ab600 con 0x7faa0c06cbe0 2024-04-24T08:25:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.565+0000 7faa0b400640 1 -- 172.21.15.88:0/1550778891 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40ab9d0 con 0x7faa0c06cbe0 2024-04-24T08:25:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.565+0000 7faa13200640 1 -- 172.21.15.88:0/1550778891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0c06cbe0 msgr2=0x7faa0c0b7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.565+0000 7faa13200640 1 --2- 172.21.15.88:0/1550778891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0c06cbe0 0x7faa0c0b7550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40097c0 tx=0x7fa9f401c380 comp rx=0 tx=0).stop 2024-04-24T08:25:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.565+0000 7faa13200640 1 -- 172.21.15.88:0/1550778891 shutdown_connections 2024-04-24T08:25:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.565+0000 7faa13200640 1 --2- 172.21.15.88:0/1550778891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0c06cbe0 0x7faa0c0b7550 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.565+0000 7faa13200640 1 --2- 172.21.15.88:0/1550778891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0c06e720 0x7faa0c0b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.565+0000 7faa13200640 1 -- 172.21.15.88:0/1550778891 >> 172.21.15.88:0/1550778891 conn(0x7faa0c067810 msgr2=0x7faa0c067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.565+0000 7faa13200640 1 -- 172.21.15.88:0/1550778891 shutdown_connections 2024-04-24T08:25:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.565+0000 7faa13200640 1 -- 172.21.15.88:0/1550778891 wait complete. 2024-04-24T08:25:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa13200640 1 Processor -- start 2024-04-24T08:25:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa13200640 1 -- start start 2024-04-24T08:25:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa13200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0c06cbe0 0x7faa0c0aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa13200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0c06e720 0x7faa0c141c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa13200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0c14c2c0 0x7faa0c142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa13200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c155ba0 con 0x7faa0c06e720 2024-04-24T08:25:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa13200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c155a20 con 0x7faa0c06cbe0 2024-04-24T08:25:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa13200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faa0c155d20 con 0x7faa0c14c2c0 2024-04-24T08:25:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa03400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0c06e720 0x7faa0c141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa03400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0c06e720 0x7faa0c141c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53956/0 (socket says 172.21.15.88:53956) 2024-04-24T08:25:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa03400640 1 -- 172.21.15.88:0/2739443474 learned_addr learned my addr 172.21.15.88:0/2739443474 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:58.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa03400640 1 -- 172.21.15.88:0/2739443474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0c14c2c0 msgr2=0x7faa0c142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa03400640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0c14c2c0 0x7faa0c142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa03400640 1 -- 172.21.15.88:0/2739443474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0c06cbe0 msgr2=0x7faa0c0aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa0be00640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0c06cbe0 0x7faa0c0aa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa03400640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0c06cbe0 0x7faa0c0aa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa03400640 1 -- 172.21.15.88:0/2739443474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c0a98f0 con 0x7faa0c06e720 2024-04-24T08:25:58.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa0be00640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0c06cbe0 0x7faa0c0aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:58.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa03400640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0c06e720 0x7faa0c141c10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40ae040 tx=0x7fa9f4019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:58.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa08c00640 1 -- 172.21.15.88:0/2739443474 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40b0040 con 0x7faa0c06e720 2024-04-24T08:25:58.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa08c00640 1 -- 172.21.15.88:0/2739443474 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f40b9070 con 0x7faa0c06e720 2024-04-24T08:25:58.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa13200640 1 -- 172.21.15.88:0/2739443474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c0ab1b0 con 0x7faa0c06e720 2024-04-24T08:25:58.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa08c00640 1 -- 172.21.15.88:0/2739443474 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40aaa30 con 0x7faa0c06e720 2024-04-24T08:25:58.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa13200640 1 -- 172.21.15.88:0/2739443474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c0b5720 con 0x7faa0c06e720 2024-04-24T08:25:58.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.569+0000 7faa13200640 1 -- 172.21.15.88:0/2739443474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0c068b90 con 0x7faa0c06e720 2024-04-24T08:25:58.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.573+0000 7faa08c00640 1 -- 172.21.15.88:0/2739443474 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa9f40aabd0 con 0x7faa0c06e720 2024-04-24T08:25:58.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.573+0000 7faa08c00640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9e8068380 0x7fa9e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.573+0000 7faa08c00640 1 -- 172.21.15.88:0/2739443474 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa9f4120af0 con 0x7faa0c06e720 2024-04-24T08:25:58.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.573+0000 7faa0be00640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9e8068380 0x7fa9e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.573+0000 7faa0be00640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9e8068380 0x7fa9e806a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009980 tx=0x7fa9fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:58.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.577+0000 7faa08c00640 1 -- 172.21.15.88:0/2739443474 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa9f4016090 con 0x7faa0c06e720 2024-04-24T08:25:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.769+0000 7faa13200640 1 -- 172.21.15.88:0/2739443474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa0c0ab380 con 0x7faa0c06e720 2024-04-24T08:25:58.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.769+0000 7faa08c00640 1 -- 172.21.15.88:0/2739443474 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7fa9f40f0a50 con 0x7faa0c06e720 2024-04-24T08:25:58.772 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:58.773 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1421585339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1421585339},{"type":"v1","addr":"172.21.15.142:6833","nonce":1421585339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:25:27.478065+0000","modified":"2024-04-24T08:25:30.500783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2851985776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2851985776},{"type":"v1","addr":"172.21.15.88:6835","nonce":2851985776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-24T08:25:58.773 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2024-04-24T08:25:58.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.773+0000 7faa13200640 1 -- 172.21.15.88:0/2739443474 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9e8068380 msgr2=0x7fa9e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.773+0000 7faa13200640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9e8068380 0x7fa9e806a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009980 tx=0x7fa9fc008040 comp rx=0 tx=0).stop 2024-04-24T08:25:58.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.773+0000 7faa13200640 1 -- 172.21.15.88:0/2739443474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0c06e720 msgr2=0x7faa0c141c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.773+0000 7faa13200640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0c06e720 0x7faa0c141c10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40ae040 tx=0x7fa9f4019120 comp rx=0 tx=0).stop 2024-04-24T08:25:58.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.773+0000 7faa13200640 1 -- 172.21.15.88:0/2739443474 shutdown_connections 2024-04-24T08:25:58.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.773+0000 7faa13200640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9e8068380 0x7fa9e806a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.773+0000 7faa13200640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0c14c2c0 0x7faa0c142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.773+0000 7faa13200640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0c06e720 0x7faa0c141c10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.773+0000 7faa13200640 1 --2- 172.21.15.88:0/2739443474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0c06cbe0 0x7faa0c0aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.773+0000 7faa13200640 1 -- 172.21.15.88:0/2739443474 >> 172.21.15.88:0/2739443474 conn(0x7faa0c067810 msgr2=0x7faa0c0b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:58.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.773+0000 7faa13200640 1 -- 172.21.15.88:0/2739443474 shutdown_connections 2024-04-24T08:25:58.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.773+0000 7faa13200640 1 -- 172.21.15.88:0/2739443474 wait complete. 2024-04-24T08:25:58.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:25:58.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e9b200640 1 Processor -- start 2024-04-24T08:25:58.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e9b200640 1 -- start start 2024-04-24T08:25:58.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e9b200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e94067a70 0x7f8e940b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e9b200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e9406ec80 0x7f8e940b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e9b200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e94067e50 con 0x7f8e940b4570 2024-04-24T08:25:58.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e9b200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8e940b49e0 con 0x7f8e9406ec80 2024-04-24T08:25:58.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e9b200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8e940af2c0 con 0x7f8e94067a70 2024-04-24T08:25:58.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e99400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e9406ec80 0x7f8e940b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e9a800640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8e940b4570 0x7f8e9406d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46666/0 (socket says 172.21.15.88:46666) 2024-04-24T08:25:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e9a800640 1 -- 172.21.15.88:0/1093532439 learned_addr learned my addr 172.21.15.88:0/1093532439 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e99e00640 1 --2- 172.21.15.88:0/1093532439 >> v2:172.21.15.142:3300/0 conn(0x7f8e94067a70 0x7f8e940b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e99400640 1 -- 172.21.15.88:0/1093532439 >> v2:172.21.15.142:3300/0 conn(0x7f8e94067a70 msgr2=0x7f8e940b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e99400640 1 --2- 172.21.15.88:0/1093532439 >> v2:172.21.15.142:3300/0 conn(0x7f8e94067a70 0x7f8e940b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e99400640 1 -- 172.21.15.88:0/1093532439 >> v1:172.21.15.88:6789/0 conn(0x7f8e940b4570 legacy=0x7f8e9406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e99400640 1 -- 172.21.15.88:0/1093532439 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e940b5cd0 con 0x7f8e9406ec80 2024-04-24T08:25:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.929+0000 7f8e98a00640 1 -- 172.21.15.88:0/1093532439 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 460033102 0 0) 0x7f8e94067e50 con 0x7f8e940b4570 2024-04-24T08:25:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.933+0000 7f8e99400640 1 --2- 172.21.15.88:0/1093532439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9406ec80 0x7f8e940b0080 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8e94068070 tx=0x7f8e8401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03cb9b8449a7eec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:58.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.933+0000 7f8e98a00640 1 -- 172.21.15.88:0/1093532439 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e840b0070 con 0x7f8e9406ec80 2024-04-24T08:25:58.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.933+0000 7f8e98a00640 1 -- 172.21.15.88:0/1093532439 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e840ab600 con 0x7f8e9406ec80 2024-04-24T08:25:58.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.933+0000 7f8e98a00640 1 -- 172.21.15.88:0/1093532439 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e840ab9d0 con 0x7f8e9406ec80 2024-04-24T08:25:58.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.933+0000 7f8e9b200640 1 -- 172.21.15.88:0/1093532439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9406ec80 msgr2=0x7f8e940b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.933+0000 7f8e9b200640 1 --2- 172.21.15.88:0/1093532439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9406ec80 0x7f8e940b0080 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8e94068070 tx=0x7f8e8401c430 comp rx=0 tx=0).stop 2024-04-24T08:25:58.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.933+0000 7f8e9b200640 1 -- 172.21.15.88:0/1093532439 shutdown_connections 2024-04-24T08:25:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.933+0000 7f8e9b200640 1 --2- 172.21.15.88:0/1093532439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9406ec80 0x7f8e940b0080 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.933+0000 7f8e9b200640 1 --2- 172.21.15.88:0/1093532439 >> v2:172.21.15.142:3300/0 conn(0x7f8e94067a70 0x7f8e940b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.933+0000 7f8e9b200640 1 -- 172.21.15.88:0/1093532439 >> 172.21.15.88:0/1093532439 conn(0x7f8e940b6670 msgr2=0x7f8e940b6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.933+0000 7f8e9b200640 1 -- 172.21.15.88:0/1093532439 shutdown_connections 2024-04-24T08:25:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.933+0000 7f8e9b200640 1 -- 172.21.15.88:0/1093532439 wait complete. 2024-04-24T08:25:58.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e9b200640 1 Processor -- start 2024-04-24T08:25:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e9b200640 1 -- start start 2024-04-24T08:25:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e9b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e94067a70 0x7f8e94147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e9b200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9406ec80 0x7f8e941e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e9b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e940b4570 0x7f8e941e0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e9b200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8e94154c10 con 0x7f8e9406ec80 2024-04-24T08:25:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e9b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8e94154a90 con 0x7f8e94067a70 2024-04-24T08:25:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e9b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8e94154d90 con 0x7f8e940b4570 2024-04-24T08:25:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e99400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9406ec80 0x7f8e941e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e99400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9406ec80 0x7f8e941e0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53964/0 (socket says 172.21.15.88:53964) 2024-04-24T08:25:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e99400640 1 -- 172.21.15.88:0/1755032718 learned_addr learned my addr 172.21.15.88:0/1755032718 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e99400640 1 -- 172.21.15.88:0/1755032718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e940b4570 msgr2=0x7f8e941e0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e99400640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e940b4570 0x7f8e941e0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e99400640 1 -- 172.21.15.88:0/1755032718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e94067a70 msgr2=0x7f8e94147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e99e00640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e94067a70 0x7f8e94147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e99400640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e94067a70 0x7f8e94147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e99400640 1 -- 172.21.15.88:0/1755032718 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e94149b00 con 0x7f8e9406ec80 2024-04-24T08:25:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e99e00640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e94067a70 0x7f8e94147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:25:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e99400640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9406ec80 0x7f8e941e0420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009740 tx=0x7f8e840191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e8e000640 1 -- 172.21.15.88:0/1755032718 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e840b0040 con 0x7f8e9406ec80 2024-04-24T08:25:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e8e000640 1 -- 172.21.15.88:0/1755032718 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e840b9070 con 0x7f8e9406ec80 2024-04-24T08:25:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e9b200640 1 -- 172.21.15.88:0/1755032718 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e94148380 con 0x7f8e9406ec80 2024-04-24T08:25:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e8e000640 1 -- 172.21.15.88:0/1755032718 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e840b4650 con 0x7f8e9406ec80 2024-04-24T08:25:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e9b200640 1 -- 172.21.15.88:0/1755032718 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e94145e90 con 0x7f8e9406ec80 2024-04-24T08:25:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.937+0000 7f8e9b200640 1 -- 172.21.15.88:0/1755032718 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e94148190 con 0x7f8e9406ec80 2024-04-24T08:25:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.941+0000 7f8e8e000640 1 -- 172.21.15.88:0/1755032718 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e840b47f0 con 0x7f8e9406ec80 2024-04-24T08:25:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.941+0000 7f8e8e000640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8e78068380 0x7f8e7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.941+0000 7f8e8e000640 1 -- 172.21.15.88:0/1755032718 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8e84120730 con 0x7f8e9406ec80 2024-04-24T08:25:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.941+0000 7f8e99e00640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8e78068380 0x7f8e7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.941+0000 7f8e99e00640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8e78068380 0x7f8e7806a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8e94141a50 tx=0x7f8e88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:58.945+0000 7f8e8e000640 1 -- 172.21.15.88:0/1755032718 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8e84016050 con 0x7f8e9406ec80 2024-04-24T08:25:59.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.137+0000 7f8e9b200640 1 -- 172.21.15.88:0/1755032718 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e94069230 con 0x7f8e9406ec80 2024-04-24T08:25:59.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.137+0000 7f8e8e000640 1 -- 172.21.15.88:0/1755032718 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7f8e840f0ce0 con 0x7f8e9406ec80 2024-04-24T08:25:59.141 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:59.141 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1421585339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1421585339},{"type":"v1","addr":"172.21.15.142:6833","nonce":1421585339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:25:27.478065+0000","modified":"2024-04-24T08:25:30.500783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2851985776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2851985776},{"type":"v1","addr":"172.21.15.88:6835","nonce":2851985776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-24T08:25:59.141 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2024-04-24T08:25:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.141+0000 7f8e9b200640 1 -- 172.21.15.88:0/1755032718 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8e78068380 msgr2=0x7f8e7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.141+0000 7f8e9b200640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8e78068380 0x7f8e7806a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8e94141a50 tx=0x7f8e88008040 comp rx=0 tx=0).stop 2024-04-24T08:25:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.141+0000 7f8e9b200640 1 -- 172.21.15.88:0/1755032718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9406ec80 msgr2=0x7f8e941e0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.141+0000 7f8e9b200640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9406ec80 0x7f8e941e0420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009740 tx=0x7f8e840191d0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.141+0000 7f8e9b200640 1 -- 172.21.15.88:0/1755032718 shutdown_connections 2024-04-24T08:25:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.141+0000 7f8e9b200640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8e78068380 0x7f8e7806a840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.141+0000 7f8e9b200640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e940b4570 0x7f8e941e0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.141+0000 7f8e9b200640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9406ec80 0x7f8e941e0420 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.141+0000 7f8e9b200640 1 --2- 172.21.15.88:0/1755032718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e94067a70 0x7f8e94147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.141+0000 7f8e9b200640 1 -- 172.21.15.88:0/1755032718 >> 172.21.15.88:0/1755032718 conn(0x7f8e940b6670 msgr2=0x7f8e94070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.141+0000 7f8e9b200640 1 -- 172.21.15.88:0/1755032718 shutdown_connections 2024-04-24T08:25:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.141+0000 7f8e9b200640 1 -- 172.21.15.88:0/1755032718 wait complete. 2024-04-24T08:25:59.162 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:25:59.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7766400640 1 Processor -- start 2024-04-24T08:25:59.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7766400640 1 -- start start 2024-04-24T08:25:59.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7766400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7760071b90 0x7f77601419e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7766400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77600712c0 0x7f77600b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7766400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7760071f70 con 0x7f7760141f20 2024-04-24T08:25:59.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7766400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f776006bf70 con 0x7f7760071b90 2024-04-24T08:25:59.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7766400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f776006bc00 con 0x7f77600712c0 2024-04-24T08:25:59.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7765a00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7760141f20 0x7f77600b4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46672/0 (socket says 172.21.15.88:46672) 2024-04-24T08:25:59.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7765a00640 1 -- 172.21.15.88:0/4231042734 learned_addr learned my addr 172.21.15.88:0/4231042734 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775fe00640 1 --2- 172.21.15.88:0/4231042734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77600712c0 0x7f77600b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7765000640 1 --2- 172.21.15.88:0/4231042734 >> v2:172.21.15.142:3300/0 conn(0x7f7760071b90 0x7f77601419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050636376 0 0) 0x7f7760071f70 con 0x7f7760141f20 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7748003530 con 0x7f7760141f20 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2465593230 0 0) 0x7f7748003530 con 0x7f7760141f20 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77600712c0 msgr2=0x7f77600b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 --2- 172.21.15.88:0/4231042734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77600712c0 0x7f77600b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 >> v2:172.21.15.142:3300/0 conn(0x7f7760071b90 msgr2=0x7f77601419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 --2- 172.21.15.88:0/4231042734 >> v2:172.21.15.142:3300/0 conn(0x7f7760071b90 0x7f77601419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77600b5d10 con 0x7f7760141f20 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f7758001a00 con 0x7f7760141f20 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 >> v1:172.21.15.88:6789/0 conn(0x7f7760141f20 legacy=0x7f77600b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 --2- 172.21.15.88:0/4231042734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77480039c0 0x7f7748003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 --2- 172.21.15.88:0/4231042734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77600712c0 0x7f7748004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 --2- 172.21.15.88:0/4231042734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7748004d50 0x7f77480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f776006bf70 con 0x7f7748004d50 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f776006bc00 con 0x7f77480039c0 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f774800b9d0 con 0x7f77600712c0 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7765a00640 1 --2- 172.21.15.88:0/4231042734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7748004d50 0x7f77480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f775fe00640 1 --2- 172.21.15.88:0/4231042734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77600712c0 0x7f7748004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7765000640 1 --2- 172.21.15.88:0/4231042734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77480039c0 0x7f7748003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7765a00640 1 -- 172.21.15.88:0/4231042734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77600712c0 msgr2=0x7f7748004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7765a00640 1 --2- 172.21.15.88:0/4231042734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77600712c0 0x7f7748004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7765a00640 1 -- 172.21.15.88:0/4231042734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77480039c0 msgr2=0x7f7748003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7765a00640 1 --2- 172.21.15.88:0/4231042734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77480039c0 0x7f7748003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.297+0000 7f7765a00640 1 -- 172.21.15.88:0/4231042734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7748003530 con 0x7f7748004d50 2024-04-24T08:25:59.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.301+0000 7f7765a00640 1 --2- 172.21.15.88:0/4231042734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7748004d50 0x7f77480051d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f775800a8a0 tx=0x7f775801fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24e4c035b8b2bb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:59.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.301+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775800a4c0 con 0x7f7748004d50 2024-04-24T08:25:59.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.301+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77580ad020 con 0x7f7748004d50 2024-04-24T08:25:59.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.301+0000 7f775f400640 1 -- 172.21.15.88:0/4231042734 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580a9740 con 0x7f7748004d50 2024-04-24T08:25:59.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.301+0000 7f7766400640 1 -- 172.21.15.88:0/4231042734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7748004d50 msgr2=0x7f77480051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.301+0000 7f7766400640 1 --2- 172.21.15.88:0/4231042734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7748004d50 0x7f77480051d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f775800a8a0 tx=0x7f775801fb20 comp rx=0 tx=0).stop 2024-04-24T08:25:59.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.301+0000 7f7765a00640 1 -- 172.21.15.88:0/4231042734 reap_dead start 2024-04-24T08:25:59.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.301+0000 7f7766400640 1 -- 172.21.15.88:0/4231042734 shutdown_connections 2024-04-24T08:25:59.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.301+0000 7f7766400640 1 -- 172.21.15.88:0/4231042734 >> 172.21.15.88:0/4231042734 conn(0x7f77600ba270 msgr2=0x7f77600ba680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:59.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.301+0000 7f7766400640 1 -- 172.21.15.88:0/4231042734 shutdown_connections 2024-04-24T08:25:59.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.301+0000 7f7766400640 1 -- 172.21.15.88:0/4231042734 wait complete. 2024-04-24T08:25:59.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7766400640 1 Processor -- start 2024-04-24T08:25:59.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7766400640 1 -- start start 2024-04-24T08:25:59.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7766400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7748004d50 0x7f7760147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7766400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77601cdac0 0x7f77601dd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7766400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77601ddb00 0x7f776013c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7766400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f77600b5380 con 0x7f77601cdac0 2024-04-24T08:25:59.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7766400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f77600b64b0 con 0x7f77601ddb00 2024-04-24T08:25:59.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7766400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f77600b5500 con 0x7f7748004d50 2024-04-24T08:25:59.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f775fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77601cdac0 0x7f77601dd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f775fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77601cdac0 0x7f77601dd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53982/0 (socket says 172.21.15.88:53982) 2024-04-24T08:25:59.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f775fe00640 1 -- 172.21.15.88:0/429886914 learned_addr learned my addr 172.21.15.88:0/429886914 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:59.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7765000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7748004d50 0x7f7760147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7765a00640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77601ddb00 0x7f776013c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f775fe00640 1 -- 172.21.15.88:0/429886914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7748004d50 msgr2=0x7f7760147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f775fe00640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7748004d50 0x7f7760147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f775fe00640 1 -- 172.21.15.88:0/429886914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77601ddb00 msgr2=0x7f776013c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f775fe00640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77601ddb00 0x7f776013c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f775fe00640 1 -- 172.21.15.88:0/429886914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77601ce8c0 con 0x7f77601cdac0 2024-04-24T08:25:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7765000640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7748004d50 0x7f7760147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:25:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f775fe00640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77601cdac0 0x7f77601dd5c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f774c011940 tx=0x7f774c011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f775cc00640 1 -- 172.21.15.88:0/429886914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c019070 con 0x7f77601cdac0 2024-04-24T08:25:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f775cc00640 1 -- 172.21.15.88:0/429886914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c004240 con 0x7f77601cdac0 2024-04-24T08:25:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7766400640 1 -- 172.21.15.88:0/429886914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7760144200 con 0x7f77601cdac0 2024-04-24T08:25:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f775cc00640 1 -- 172.21.15.88:0/429886914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c00f7c0 con 0x7f77601cdac0 2024-04-24T08:25:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7766400640 1 -- 172.21.15.88:0/429886914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7760148790 con 0x7f77601cdac0 2024-04-24T08:25:59.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.305+0000 7f7766400640 1 -- 172.21.15.88:0/429886914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7760068b20 con 0x7f77601cdac0 2024-04-24T08:25:59.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.309+0000 7f775cc00640 1 -- 172.21.15.88:0/429886914 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f774c01c070 con 0x7f77601cdac0 2024-04-24T08:25:59.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.309+0000 7f775cc00640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7740068380 0x7f774006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.309+0000 7f775cc00640 1 -- 172.21.15.88:0/429886914 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f774c086d70 con 0x7f77601cdac0 2024-04-24T08:25:59.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.309+0000 7f7765000640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7740068380 0x7f774006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.309+0000 7f7765000640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7740068380 0x7f774006a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7754009fd0 tx=0x7f7754009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:59.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.313+0000 7f775cc00640 1 -- 172.21.15.88:0/429886914 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f774c056cd0 con 0x7f77601cdac0 2024-04-24T08:25:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.473+0000 7f7766400640 1 -- 172.21.15.88:0/429886914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77601ddf10 con 0x7f77601cdac0 2024-04-24T08:25:59.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.473+0000 7f775cc00640 1 -- 172.21.15.88:0/429886914 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f774c05afd0 con 0x7f77601cdac0 2024-04-24T08:25:59.476 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:25:59.476 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:25:29.104490+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:25:25.116395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T08:25:26.444475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:25:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.477+0000 7f7766400640 1 -- 172.21.15.88:0/429886914 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7740068380 msgr2=0x7f774006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.477+0000 7f7766400640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7740068380 0x7f774006a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7754009fd0 tx=0x7f7754009190 comp rx=0 tx=0).stop 2024-04-24T08:25:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.477+0000 7f7766400640 1 -- 172.21.15.88:0/429886914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77601cdac0 msgr2=0x7f77601dd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.477+0000 7f7766400640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77601cdac0 0x7f77601dd5c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f774c011940 tx=0x7f774c011d40 comp rx=0 tx=0).stop 2024-04-24T08:25:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.477+0000 7f7766400640 1 -- 172.21.15.88:0/429886914 shutdown_connections 2024-04-24T08:25:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.477+0000 7f7766400640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7740068380 0x7f774006a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.477+0000 7f7766400640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77601ddb00 0x7f776013c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.477+0000 7f7766400640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77601cdac0 0x7f77601dd5c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.477+0000 7f7766400640 1 --2- 172.21.15.88:0/429886914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7748004d50 0x7f7760147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.477+0000 7f7766400640 1 -- 172.21.15.88:0/429886914 >> 172.21.15.88:0/429886914 conn(0x7f77600ba270 msgr2=0x7f776013fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:59.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.477+0000 7f7766400640 1 -- 172.21.15.88:0/429886914 shutdown_connections 2024-04-24T08:25:59.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.477+0000 7f7766400640 1 -- 172.21.15.88:0/429886914 wait complete. 2024-04-24T08:25:59.500 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T08:25:59.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.633+0000 7f853ca00640 1 Processor -- start 2024-04-24T08:25:59.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.633+0000 7f853ca00640 1 -- start start 2024-04-24T08:25:59.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f853ca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85380b7870 0x7f8538073860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f853ca00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8538073da0 0x7f85380b6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f853ca00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8538147e30 0x7f853814b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f853ca00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8538148980 con 0x7f8538147e30 2024-04-24T08:25:59.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f853ca00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8538148e10 con 0x7f8538073da0 2024-04-24T08:25:59.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f853ca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f85380b7c50 con 0x7f85380b7870 2024-04-24T08:25:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f8536800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8538147e30 0x7f853814b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f8536800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8538147e30 0x7f853814b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53986/0 (socket says 172.21.15.88:53986) 2024-04-24T08:25:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f8536800640 1 -- 172.21.15.88:0/2596354431 learned_addr learned my addr 172.21.15.88:0/2596354431 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f8535400640 1 --2- 172.21.15.88:0/2596354431 >> v2:172.21.15.142:3300/0 conn(0x7f8538073da0 0x7f85380b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f8535e00640 1 --2- 172.21.15.88:0/2596354431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85380b7870 0x7f8538073860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f8536800640 1 -- 172.21.15.88:0/2596354431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85380b7870 msgr2=0x7f8538073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f8536800640 1 --2- 172.21.15.88:0/2596354431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85380b7870 0x7f8538073860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f8536800640 1 -- 172.21.15.88:0/2596354431 >> v2:172.21.15.142:3300/0 conn(0x7f8538073da0 msgr2=0x7f85380b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:25:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f8536800640 1 --2- 172.21.15.88:0/2596354431 >> v2:172.21.15.142:3300/0 conn(0x7f8538073da0 0x7f85380b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f8536800640 1 -- 172.21.15.88:0/2596354431 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8538148330 con 0x7f8538147e30 2024-04-24T08:25:59.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.637+0000 7f8536800640 1 --2- 172.21.15.88:0/2596354431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538147e30 0x7f853814b420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f85380bc590 tx=0x7f853001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989a1bdaf8d04b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:59.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8534a00640 1 -- 172.21.15.88:0/2596354431 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85300a5660 con 0x7f8538147e30 2024-04-24T08:25:59.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8534a00640 1 -- 172.21.15.88:0/2596354431 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853806cdf0 con 0x7f8538147e30 2024-04-24T08:25:59.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8534a00640 1 -- 172.21.15.88:0/2596354431 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85300a5a20 con 0x7f8538147e30 2024-04-24T08:25:59.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 -- 172.21.15.88:0/2596354431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538147e30 msgr2=0x7f853814b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 --2- 172.21.15.88:0/2596354431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538147e30 0x7f853814b420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f85380bc590 tx=0x7f853001c8d0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 -- 172.21.15.88:0/2596354431 shutdown_connections 2024-04-24T08:25:59.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 --2- 172.21.15.88:0/2596354431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538147e30 0x7f853814b420 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 --2- 172.21.15.88:0/2596354431 >> v2:172.21.15.142:3300/0 conn(0x7f8538073da0 0x7f85380b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 --2- 172.21.15.88:0/2596354431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85380b7870 0x7f8538073860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 -- 172.21.15.88:0/2596354431 >> 172.21.15.88:0/2596354431 conn(0x7f85380bb4d0 msgr2=0x7f85380bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:59.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 -- 172.21.15.88:0/2596354431 shutdown_connections 2024-04-24T08:25:59.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 -- 172.21.15.88:0/2596354431 wait complete. 2024-04-24T08:25:59.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 Processor -- start 2024-04-24T08:25:59.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 -- start start 2024-04-24T08:25:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538073da0 0x7f85381e43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85380b7870 0x7f85380b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8538147e30 0x7f85381e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8538154940 con 0x7f8538073da0 2024-04-24T08:25:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f85381547c0 con 0x7f8538147e30 2024-04-24T08:25:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f853ca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8538154ac0 con 0x7f85380b7870 2024-04-24T08:25:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8535e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538073da0 0x7f85381e43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8535e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538073da0 0x7f85381e43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53988/0 (socket says 172.21.15.88:53988) 2024-04-24T08:25:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8535e00640 1 -- 172.21.15.88:0/598228843 learned_addr learned my addr 172.21.15.88:0/598228843 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:25:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8536800640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8538147e30 0x7f85381e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8535400640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85380b7870 0x7f85380b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8535e00640 1 -- 172.21.15.88:0/598228843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85380b7870 msgr2=0x7f85380b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8535e00640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85380b7870 0x7f85380b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8535e00640 1 -- 172.21.15.88:0/598228843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8538147e30 msgr2=0x7f85381e4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8535e00640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8538147e30 0x7f85381e4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.641+0000 7f8535e00640 1 -- 172.21.15.88:0/598228843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85380b1f00 con 0x7f8538073da0 2024-04-24T08:25:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.645+0000 7f8535e00640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538073da0 0x7f85381e43b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f852800d800 tx=0x7f852800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.645+0000 7f852e000640 1 -- 172.21.15.88:0/598228843 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852800b6c0 con 0x7f8538073da0 2024-04-24T08:25:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.645+0000 7f852e000640 1 -- 172.21.15.88:0/598228843 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8528019070 con 0x7f8538073da0 2024-04-24T08:25:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.645+0000 7f853ca00640 1 -- 172.21.15.88:0/598228843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85380b2390 con 0x7f8538073da0 2024-04-24T08:25:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.645+0000 7f852e000640 1 -- 172.21.15.88:0/598228843 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852800ba60 con 0x7f8538073da0 2024-04-24T08:25:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.645+0000 7f853ca00640 1 -- 172.21.15.88:0/598228843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85380b4a00 con 0x7f8538073da0 2024-04-24T08:25:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.645+0000 7f853ca00640 1 -- 172.21.15.88:0/598228843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8538068b20 con 0x7f8538073da0 2024-04-24T08:25:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.645+0000 7f852e000640 1 -- 172.21.15.88:0/598228843 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f852800bc00 con 0x7f8538073da0 2024-04-24T08:25:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.645+0000 7f852e000640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8518068380 0x7f851806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:25:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.645+0000 7f852e000640 1 -- 172.21.15.88:0/598228843 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8528086e50 con 0x7f8538073da0 2024-04-24T08:25:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.645+0000 7f8535400640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8518068380 0x7f851806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:25:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.649+0000 7f8535400640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8518068380 0x7f851806a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f85380b50b0 tx=0x7f8524008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:25:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.649+0000 7f852e000640 1 -- 172.21.15.88:0/598228843 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8528057400 con 0x7f8538073da0 2024-04-24T08:25:59.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.841+0000 7f853ca00640 1 -- 172.21.15.88:0/598228843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8538145850 con 0x7f8538073da0 2024-04-24T08:25:59.844 INFO:tasks.ceph.mon.a.smithi088.stderr:2024-04-24T08:25:59.841+0000 7fc2ae200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T08:25:59.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.845+0000 7f852e000640 1 -- 172.21.15.88:0/598228843 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f8528056d00 con 0x7f8538073da0 2024-04-24T08:25:59.846 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T08:25:59.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.845+0000 7f853ca00640 1 -- 172.21.15.88:0/598228843 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8518068380 msgr2=0x7f851806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.845+0000 7f853ca00640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8518068380 0x7f851806a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f85380b50b0 tx=0x7f8524008040 comp rx=0 tx=0).stop 2024-04-24T08:25:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.845+0000 7f853ca00640 1 -- 172.21.15.88:0/598228843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538073da0 msgr2=0x7f85381e43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:25:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.845+0000 7f853ca00640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538073da0 0x7f85381e43b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f852800d800 tx=0x7f852800dcc0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.849+0000 7f853ca00640 1 -- 172.21.15.88:0/598228843 shutdown_connections 2024-04-24T08:25:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.849+0000 7f853ca00640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8518068380 0x7f851806a840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.849+0000 7f853ca00640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8538147e30 0x7f85381e4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.849+0000 7f853ca00640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85380b7870 0x7f85380b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.849+0000 7f853ca00640 1 --2- 172.21.15.88:0/598228843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538073da0 0x7f85381e43b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:25:59.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.849+0000 7f853ca00640 1 -- 172.21.15.88:0/598228843 >> 172.21.15.88:0/598228843 conn(0x7f85380bb4d0 msgr2=0x7f8538146c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:25:59.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.849+0000 7f853ca00640 1 -- 172.21.15.88:0/598228843 shutdown_connections 2024-04-24T08:25:59.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:25:59.849+0000 7f853ca00640 1 -- 172.21.15.88:0/598228843 wait complete. 2024-04-24T08:25:59.853 INFO:tasks.ceph.mds.a.smithi088.stderr: -1250> 2024-04-24T08:25:30.502+0000 7fe18f600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T08:25:59.869 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-24T08:25:59.900 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2024-04-24T08:26:00.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.009+0000 7f0bde000640 1 Processor -- start 2024-04-24T08:26:00.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.009+0000 7f0bde000640 1 -- start start 2024-04-24T08:26:00.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.013+0000 7f0bde000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0bd8142060 0x7f0bd80b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:00.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.013+0000 7f0bde000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bd80bc390 con 0x7f0bd80bbfb0 2024-04-24T08:26:00.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.013+0000 7f0bde000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bd806e640 con 0x7f0bd806cbe0 2024-04-24T08:26:00.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.013+0000 7f0bde000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f0bd806e920 con 0x7f0bd8142060 2024-04-24T08:26:00.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.013+0000 7f0bd7e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0bd8142060 0x7f0bd80b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:00.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.013+0000 7f0bd7400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0bd80bbfb0 0x7f0bd8141950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46688/0 (socket says 172.21.15.88:46688) 2024-04-24T08:26:00.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.013+0000 7f0bd7400640 1 -- 172.21.15.88:0/4154826313 learned_addr learned my addr 172.21.15.88:0/4154826313 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:00.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.013+0000 7f0bd7e00640 1 -- 172.21.15.88:0/4154826313 >> v1:172.21.15.142:6789/0 conn(0x7f0bd806cbe0 legacy=0x7f0bd81505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:00.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.013+0000 7f0bd7e00640 1 -- 172.21.15.88:0/4154826313 >> v1:172.21.15.88:6789/0 conn(0x7f0bd80bbfb0 legacy=0x7f0bd8141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:00.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.013+0000 7f0bd7e00640 1 -- 172.21.15.88:0/4154826313 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd806e2d0 con 0x7f0bd8142060 2024-04-24T08:26:00.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd7e00640 1 --2- 172.21.15.88:0/4154826313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bd8142060 0x7f0bd80b7210 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009d90 tx=0x7f0bd001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d33a189bc9ab98 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:00.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd6000640 1 -- 172.21.15.88:0/4154826313 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00b2070 con 0x7f0bd8142060 2024-04-24T08:26:00.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd6000640 1 -- 172.21.15.88:0/4154826313 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd00a57a0 con 0x7f0bd8142060 2024-04-24T08:26:00.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd6000640 1 -- 172.21.15.88:0/4154826313 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00a5b70 con 0x7f0bd8142060 2024-04-24T08:26:00.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 -- 172.21.15.88:0/4154826313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bd8142060 msgr2=0x7f0bd80b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:00.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 --2- 172.21.15.88:0/4154826313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bd8142060 0x7f0bd80b7210 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009d90 tx=0x7f0bd001c8e0 comp rx=0 tx=0).stop 2024-04-24T08:26:00.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 -- 172.21.15.88:0/4154826313 shutdown_connections 2024-04-24T08:26:00.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 --2- 172.21.15.88:0/4154826313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bd8142060 0x7f0bd80b7210 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:00.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 -- 172.21.15.88:0/4154826313 >> 172.21.15.88:0/4154826313 conn(0x7f0bd8067e40 msgr2=0x7f0bd80bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:00.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 -- 172.21.15.88:0/4154826313 shutdown_connections 2024-04-24T08:26:00.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 -- 172.21.15.88:0/4154826313 wait complete. 2024-04-24T08:26:00.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 Processor -- start 2024-04-24T08:26:00.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 -- start start 2024-04-24T08:26:00.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bd806cbe0 0x7f0bd813cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80bbfb0 0x7f0bd81e1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bd8142060 0x7f0bd8149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81568b0 con 0x7f0bd806cbe0 2024-04-24T08:26:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd8156730 con 0x7f0bd80bbfb0 2024-04-24T08:26:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bde000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0bd8156a30 con 0x7f0bd8142060 2024-04-24T08:26:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd7400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bd806cbe0 0x7f0bd813cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd7400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bd806cbe0 0x7f0bd813cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54030/0 (socket says 172.21.15.88:54030) 2024-04-24T08:26:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd7400640 1 -- 172.21.15.88:0/2375325209 learned_addr learned my addr 172.21.15.88:0/2375325209 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd6a00640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80bbfb0 0x7f0bd81e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd7e00640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bd8142060 0x7f0bd8149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd7400640 1 -- 172.21.15.88:0/2375325209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bd8142060 msgr2=0x7f0bd8149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd7400640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bd8142060 0x7f0bd8149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd7400640 1 -- 172.21.15.88:0/2375325209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80bbfb0 msgr2=0x7f0bd81e1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd7400640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80bbfb0 0x7f0bd81e1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd7400640 1 -- 172.21.15.88:0/2375325209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd813e210 con 0x7f0bd806cbe0 2024-04-24T08:26:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.017+0000 7f0bd7e00640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bd8142060 0x7f0bd8149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.021+0000 7f0bd7400640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bd806cbe0 0x7f0bd813cc90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800c500 tx=0x7f0bc800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:00.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.021+0000 7f0bcf400640 1 -- 172.21.15.88:0/2375325209 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8017070 con 0x7f0bd806cbe0 2024-04-24T08:26:00.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.021+0000 7f0bcf400640 1 -- 172.21.15.88:0/2375325209 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc8005cf0 con 0x7f0bd806cbe0 2024-04-24T08:26:00.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.021+0000 7f0bcf400640 1 -- 172.21.15.88:0/2375325209 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80072f0 con 0x7f0bd806cbe0 2024-04-24T08:26:00.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.021+0000 7f0bde000640 1 -- 172.21.15.88:0/2375325209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd81e18c0 con 0x7f0bd806cbe0 2024-04-24T08:26:00.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.021+0000 7f0bde000640 1 -- 172.21.15.88:0/2375325209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd81e1590 con 0x7f0bd806cbe0 2024-04-24T08:26:00.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.021+0000 7f0bde000640 1 -- 172.21.15.88:0/2375325209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bd8068c00 con 0x7f0bd806cbe0 2024-04-24T08:26:00.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.021+0000 7f0bcf400640 1 -- 172.21.15.88:0/2375325209 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0bc801a070 con 0x7f0bd806cbe0 2024-04-24T08:26:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.021+0000 7f0bcf400640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0bb8068380 0x7f0bb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.021+0000 7f0bcf400640 1 -- 172.21.15.88:0/2375325209 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f0bc8085d00 con 0x7f0bd806cbe0 2024-04-24T08:26:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.021+0000 7f0bd6a00640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0bb8068380 0x7f0bb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.025+0000 7f0bd6a00640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0bb8068380 0x7f0bb806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8153340 tx=0x7f0bc4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:00.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.025+0000 7f0bcf400640 1 -- 172.21.15.88:0/2375325209 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0bc8055c00 con 0x7f0bd806cbe0 2024-04-24T08:26:00.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.225+0000 7f0bde000640 1 -- 172.21.15.88:0/2375325209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0bd80bb6c0 con 0x7f0bd806cbe0 2024-04-24T08:26:00.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.901+0000 7f0bcf400640 1 -- 172.21.15.88:0/2375325209 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f0bc8059f00 con 0x7f0bd806cbe0 2024-04-24T08:26:00.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.901+0000 7f0bde000640 1 -- 172.21.15.88:0/2375325209 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0bb8068380 msgr2=0x7f0bb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:00.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.901+0000 7f0bde000640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0bb8068380 0x7f0bb806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8153340 tx=0x7f0bc4009040 comp rx=0 tx=0).stop 2024-04-24T08:26:00.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.901+0000 7f0bde000640 1 -- 172.21.15.88:0/2375325209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bd806cbe0 msgr2=0x7f0bd813cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:00.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.901+0000 7f0bde000640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bd806cbe0 0x7f0bd813cc90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800c500 tx=0x7f0bc800c9c0 comp rx=0 tx=0).stop 2024-04-24T08:26:00.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.901+0000 7f0bde000640 1 -- 172.21.15.88:0/2375325209 shutdown_connections 2024-04-24T08:26:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.901+0000 7f0bde000640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0bb8068380 0x7f0bb806a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.901+0000 7f0bde000640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bd8142060 0x7f0bd8149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.901+0000 7f0bde000640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80bbfb0 0x7f0bd81e1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.901+0000 7f0bde000640 1 --2- 172.21.15.88:0/2375325209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bd806cbe0 0x7f0bd813cc90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.901+0000 7f0bde000640 1 -- 172.21.15.88:0/2375325209 >> 172.21.15.88:0/2375325209 conn(0x7f0bd8067e40 msgr2=0x7f0bd80b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.901+0000 7f0bde000640 1 -- 172.21.15.88:0/2375325209 shutdown_connections 2024-04-24T08:26:00.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:00.905+0000 7f0bde000640 1 -- 172.21.15.88:0/2375325209 wait complete. 2024-04-24T08:26:00.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-24T08:26:01.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd11c00640 1 Processor -- start 2024-04-24T08:26:01.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd11c00640 1 -- start start 2024-04-24T08:26:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd11c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efd0c067a70 0x7efd0c14bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd11c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efd0c0afb70 0x7efd0c0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd11c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd0c06bad0 0x7efd0c06bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd11c00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7efd0c14c0c0 con 0x7efd0c0afb70 2024-04-24T08:26:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd11c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7efd0c067e50 con 0x7efd0c067a70 2024-04-24T08:26:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd11c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7efd0c14b380 con 0x7efd0c06bad0 2024-04-24T08:26:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd0b400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efd0c0afb70 0x7efd0c0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd0b400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efd0c0afb70 0x7efd0c0affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54044/0 (socket says 172.21.15.88:54044) 2024-04-24T08:26:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd0b400640 1 -- 172.21.15.88:0/926095256 learned_addr learned my addr 172.21.15.88:0/926095256 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd11200640 1 --2- 172.21.15.88:0/926095256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd0c06bad0 0x7efd0c06bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd0be00640 1 --2- 172.21.15.88:0/926095256 >> v2:172.21.15.142:3300/0 conn(0x7efd0c067a70 0x7efd0c14bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd0b400640 1 -- 172.21.15.88:0/926095256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd0c06bad0 msgr2=0x7efd0c06bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd0b400640 1 --2- 172.21.15.88:0/926095256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd0c06bad0 0x7efd0c06bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd0b400640 1 -- 172.21.15.88:0/926095256 >> v2:172.21.15.142:3300/0 conn(0x7efd0c067a70 msgr2=0x7efd0c14bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd0b400640 1 --2- 172.21.15.88:0/926095256 >> v2:172.21.15.142:3300/0 conn(0x7efd0c067a70 0x7efd0c14bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd0b400640 1 -- 172.21.15.88:0/926095256 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0c14b660 con 0x7efd0c0afb70 2024-04-24T08:26:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.117+0000 7efd0be00640 1 --2- 172.21.15.88:0/926095256 >> v2:172.21.15.142:3300/0 conn(0x7efd0c067a70 0x7efd0c14bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:01.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd0b400640 1 --2- 172.21.15.88:0/926095256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0c0afb70 0x7efd0c0affb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efd0c06e910 tx=0x7efcf801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e4e10ff356a3ec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:01.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd0aa00640 1 -- 172.21.15.88:0/926095256 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf80b0070 con 0x7efd0c0afb70 2024-04-24T08:26:01.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd0aa00640 1 -- 172.21.15.88:0/926095256 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf80ab600 con 0x7efd0c0afb70 2024-04-24T08:26:01.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd0aa00640 1 -- 172.21.15.88:0/926095256 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf80ab9d0 con 0x7efd0c0afb70 2024-04-24T08:26:01.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd11c00640 1 -- 172.21.15.88:0/926095256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0c0afb70 msgr2=0x7efd0c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:01.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd11c00640 1 --2- 172.21.15.88:0/926095256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0c0afb70 0x7efd0c0affb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efd0c06e910 tx=0x7efcf801c490 comp rx=0 tx=0).stop 2024-04-24T08:26:01.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd11c00640 1 -- 172.21.15.88:0/926095256 shutdown_connections 2024-04-24T08:26:01.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd11c00640 1 --2- 172.21.15.88:0/926095256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd0c06bad0 0x7efd0c06bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:01.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd11c00640 1 --2- 172.21.15.88:0/926095256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0c0afb70 0x7efd0c0affb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:01.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd11c00640 1 --2- 172.21.15.88:0/926095256 >> v2:172.21.15.142:3300/0 conn(0x7efd0c067a70 0x7efd0c14bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:01.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd11c00640 1 -- 172.21.15.88:0/926095256 >> 172.21.15.88:0/926095256 conn(0x7efd0c0b9a40 msgr2=0x7efd0c0b9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:01.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd11c00640 1 -- 172.21.15.88:0/926095256 shutdown_connections 2024-04-24T08:26:01.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd11c00640 1 -- 172.21.15.88:0/926095256 wait complete. 2024-04-24T08:26:01.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd11c00640 1 Processor -- start 2024-04-24T08:26:01.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.121+0000 7efd11c00640 1 -- start start 2024-04-24T08:26:01.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd11c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd0c067a70 0x7efd0c144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:01.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd11c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0c06bad0 0x7efd0c0728d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:01.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd11c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd0c0afb70 0x7efd0c1e3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:01.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd11c00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c148850 con 0x7efd0c06bad0 2024-04-24T08:26:01.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd11c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c1486d0 con 0x7efd0c067a70 2024-04-24T08:26:01.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd11c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7efd0c1489d0 con 0x7efd0c0afb70 2024-04-24T08:26:01.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd0b400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0c06bad0 0x7efd0c0728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:01.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd0b400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0c06bad0 0x7efd0c0728d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54052/0 (socket says 172.21.15.88:54052) 2024-04-24T08:26:01.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd0b400640 1 -- 172.21.15.88:0/1582950061 learned_addr learned my addr 172.21.15.88:0/1582950061 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:01.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd0be00640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd0c067a70 0x7efd0c144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:01.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd11200640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd0c0afb70 0x7efd0c1e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:01.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd0b400640 1 -- 172.21.15.88:0/1582950061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd0c0afb70 msgr2=0x7efd0c1e3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:01.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd0b400640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd0c0afb70 0x7efd0c1e3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:01.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd0b400640 1 -- 172.21.15.88:0/1582950061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd0c067a70 msgr2=0x7efd0c144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:01.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd0b400640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd0c067a70 0x7efd0c144690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:01.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd0b400640 1 -- 172.21.15.88:0/1582950061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0c140690 con 0x7efd0c06bad0 2024-04-24T08:26:01.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd0be00640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd0c067a70 0x7efd0c144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:26:01.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd0b400640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0c06bad0 0x7efd0c0728d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efcf801ab40 tx=0x7efcf8019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:01.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd03e00640 1 -- 172.21.15.88:0/1582950061 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf80abe60 con 0x7efd0c06bad0 2024-04-24T08:26:01.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd03e00640 1 -- 172.21.15.88:0/1582950061 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf80b4620 con 0x7efd0c06bad0 2024-04-24T08:26:01.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd11c00640 1 -- 172.21.15.88:0/1582950061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0c146a50 con 0x7efd0c06bad0 2024-04-24T08:26:01.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd03e00640 1 -- 172.21.15.88:0/1582950061 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf80b0040 con 0x7efd0c06bad0 2024-04-24T08:26:01.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd11c00640 1 -- 172.21.15.88:0/1582950061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0c0723b0 con 0x7efd0c06bad0 2024-04-24T08:26:01.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.125+0000 7efd11c00640 1 -- 172.21.15.88:0/1582950061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd0c069230 con 0x7efd0c06bad0 2024-04-24T08:26:01.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.129+0000 7efd03e00640 1 -- 172.21.15.88:0/1582950061 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efcf80ab4c0 con 0x7efd0c06bad0 2024-04-24T08:26:01.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.129+0000 7efd03e00640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efcec068380 0x7efcec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:01.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.129+0000 7efd03e00640 1 -- 172.21.15.88:0/1582950061 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7efcf8120300 con 0x7efd0c06bad0 2024-04-24T08:26:01.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.129+0000 7efd0be00640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efcec068380 0x7efcec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:01.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.129+0000 7efd0be00640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efcec068380 0x7efcec06a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009d40 tx=0x7efcfc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:01.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.133+0000 7efd03e00640 1 -- 172.21.15.88:0/1582950061 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efcf8016110 con 0x7efd0c06bad0 2024-04-24T08:26:01.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.293+0000 7efd11c00640 1 -- 172.21.15.88:0/1582950061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7efd0c140970 con 0x7efd0c06bad0 2024-04-24T08:26:01.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.921+0000 7efd03e00640 1 -- 172.21.15.88:0/1582950061 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7efcf80f0320 con 0x7efd0c06bad0 2024-04-24T08:26:01.924 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2024-04-24T08:26:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.925+0000 7efd11c00640 1 -- 172.21.15.88:0/1582950061 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efcec068380 msgr2=0x7efcec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.925+0000 7efd11c00640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efcec068380 0x7efcec06a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009d40 tx=0x7efcfc008040 comp rx=0 tx=0).stop 2024-04-24T08:26:01.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.925+0000 7efd11c00640 1 -- 172.21.15.88:0/1582950061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0c06bad0 msgr2=0x7efd0c0728d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:01.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.925+0000 7efd11c00640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0c06bad0 0x7efd0c0728d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efcf801ab40 tx=0x7efcf8019230 comp rx=0 tx=0).stop 2024-04-24T08:26:01.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.925+0000 7efd11c00640 1 -- 172.21.15.88:0/1582950061 shutdown_connections 2024-04-24T08:26:01.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.925+0000 7efd11c00640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7efcec068380 0x7efcec06a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:01.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.925+0000 7efd11c00640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd0c0afb70 0x7efd0c1e3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:01.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.925+0000 7efd11c00640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd0c06bad0 0x7efd0c0728d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:01.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.925+0000 7efd11c00640 1 --2- 172.21.15.88:0/1582950061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd0c067a70 0x7efd0c144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:01.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.925+0000 7efd11c00640 1 -- 172.21.15.88:0/1582950061 >> 172.21.15.88:0/1582950061 conn(0x7efd0c0b9a40 msgr2=0x7efd0c0b8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:01.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.925+0000 7efd11c00640 1 -- 172.21.15.88:0/1582950061 shutdown_connections 2024-04-24T08:26:01.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:01.925+0000 7efd11c00640 1 -- 172.21.15.88:0/1582950061 wait complete. 2024-04-24T08:26:01.950 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-24T08:26:02.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.089+0000 7fc9fb800640 1 Processor -- start 2024-04-24T08:26:02.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.089+0000 7fc9fb800640 1 -- start start 2024-04-24T08:26:02.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.089+0000 7fc9fb800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9f414aa30 0x7fc9f4153960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:02.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.089+0000 7fc9fb800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9f40b26e0 con 0x7fc9f406d5b0 2024-04-24T08:26:02.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.089+0000 7fc9fb800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9f406ea50 con 0x7fc9f406e670 2024-04-24T08:26:02.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.089+0000 7fc9fb800640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc9f406dc10 con 0x7fc9f414aa30 2024-04-24T08:26:02.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.089+0000 7fc9f9800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9f414aa30 0x7fc9f4153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:02.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.089+0000 7fc9f3e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc9f406d5b0 0x7fc9f414a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46698/0 (socket says 172.21.15.88:46698) 2024-04-24T08:26:02.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.089+0000 7fc9f3e00640 1 -- 172.21.15.88:0/1132013583 learned_addr learned my addr 172.21.15.88:0/1132013583 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:02.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.089+0000 7fc9f9800640 1 -- 172.21.15.88:0/1132013583 >> v1:172.21.15.142:6789/0 conn(0x7fc9f406e670 legacy=0x7fc9f40b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:02.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.089+0000 7fc9f9800640 1 -- 172.21.15.88:0/1132013583 >> v1:172.21.15.88:6789/0 conn(0x7fc9f406d5b0 legacy=0x7fc9f414a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:02.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.089+0000 7fc9f9800640 1 -- 172.21.15.88:0/1132013583 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f406def0 con 0x7fc9f414aa30 2024-04-24T08:26:02.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.093+0000 7fc9f9800640 1 --2- 172.21.15.88:0/1132013583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f414aa30 0x7fc9f4153960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009d90 tx=0x7fc9ec01c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc28bd05dcb8eb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:02.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.093+0000 7fc9f3400640 1 -- 172.21.15.88:0/1132013583 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0a66e0 con 0x7fc9f414aa30 2024-04-24T08:26:02.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.093+0000 7fc9f3400640 1 -- 172.21.15.88:0/1132013583 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ec0a6880 con 0x7fc9f414aa30 2024-04-24T08:26:02.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.093+0000 7fc9f3400640 1 -- 172.21.15.88:0/1132013583 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0a6c50 con 0x7fc9f414aa30 2024-04-24T08:26:02.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.093+0000 7fc9fb800640 1 -- 172.21.15.88:0/1132013583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f414aa30 msgr2=0x7fc9f4153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:02.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.093+0000 7fc9fb800640 1 --2- 172.21.15.88:0/1132013583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f414aa30 0x7fc9f4153960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009d90 tx=0x7fc9ec01c810 comp rx=0 tx=0).stop 2024-04-24T08:26:02.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.093+0000 7fc9fb800640 1 -- 172.21.15.88:0/1132013583 shutdown_connections 2024-04-24T08:26:02.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.093+0000 7fc9fb800640 1 --2- 172.21.15.88:0/1132013583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f414aa30 0x7fc9f4153960 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:02.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.093+0000 7fc9fb800640 1 -- 172.21.15.88:0/1132013583 >> 172.21.15.88:0/1132013583 conn(0x7fc9f40bb4d0 msgr2=0x7fc9f40bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:02.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.093+0000 7fc9fb800640 1 -- 172.21.15.88:0/1132013583 shutdown_connections 2024-04-24T08:26:02.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.093+0000 7fc9fb800640 1 -- 172.21.15.88:0/1132013583 wait complete. 2024-04-24T08:26:02.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9fb800640 1 Processor -- start 2024-04-24T08:26:02.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9fb800640 1 -- start start 2024-04-24T08:26:02.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9fb800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9f406d5b0 0x7fc9f41e3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:02.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9fb800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f406e670 0x7fc9f40ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:02.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9fb800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f414aa30 0x7fc9f4138850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:02.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9fb800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4156840 con 0x7fc9f414aa30 2024-04-24T08:26:02.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9fb800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f41566c0 con 0x7fc9f406d5b0 2024-04-24T08:26:02.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9fb800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f41569c0 con 0x7fc9f406e670 2024-04-24T08:26:02.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f9800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f414aa30 0x7fc9f4138850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:02.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f9800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f414aa30 0x7fc9f4138850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54068/0 (socket says 172.21.15.88:54068) 2024-04-24T08:26:02.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f9800640 1 -- 172.21.15.88:0/1193605271 learned_addr learned my addr 172.21.15.88:0/1193605271 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:02.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f8e00640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9f406d5b0 0x7fc9f41e3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:02.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f3e00640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f406e670 0x7fc9f40ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:02.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f9800640 1 -- 172.21.15.88:0/1193605271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f406e670 msgr2=0x7fc9f40ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:02.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f9800640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f406e670 0x7fc9f40ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:02.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f9800640 1 -- 172.21.15.88:0/1193605271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9f406d5b0 msgr2=0x7fc9f41e3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:02.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f9800640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9f406d5b0 0x7fc9f41e3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:02.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f9800640 1 -- 172.21.15.88:0/1193605271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f40aec00 con 0x7fc9f414aa30 2024-04-24T08:26:02.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f9800640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f414aa30 0x7fc9f4138850 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0b0040 tx=0x7fc9ec0195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:02.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f0c00640 1 -- 172.21.15.88:0/1193605271 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0be070 con 0x7fc9f414aa30 2024-04-24T08:26:02.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f0c00640 1 -- 172.21.15.88:0/1193605271 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ec0b8840 con 0x7fc9f414aa30 2024-04-24T08:26:02.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9f0c00640 1 -- 172.21.15.88:0/1193605271 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0b8c70 con 0x7fc9f414aa30 2024-04-24T08:26:02.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9fb800640 1 -- 172.21.15.88:0/1193605271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f40aeee0 con 0x7fc9f414aa30 2024-04-24T08:26:02.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.097+0000 7fc9fb800640 1 -- 172.21.15.88:0/1193605271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f40ae910 con 0x7fc9f414aa30 2024-04-24T08:26:02.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.101+0000 7fc9fb800640 1 -- 172.21.15.88:0/1193605271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f4068ca0 con 0x7fc9f414aa30 2024-04-24T08:26:02.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.101+0000 7fc9f0c00640 1 -- 172.21.15.88:0/1193605271 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc9ec0c1070 con 0x7fc9f414aa30 2024-04-24T08:26:02.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.101+0000 7fc9f0c00640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc9d40683b0 0x7fc9d406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:02.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.101+0000 7fc9f0c00640 1 -- 172.21.15.88:0/1193605271 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5357+0+0 (secure 0 0 0) 0x7fc9ec1214e0 con 0x7fc9f414aa30 2024-04-24T08:26:02.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.101+0000 7fc9f8e00640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc9d40683b0 0x7fc9d406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:02.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.101+0000 7fc9f8e00640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc9d40683b0 0x7fc9d406a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8007fd0 tx=0x7fc9e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:02.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.105+0000 7fc9f0c00640 1 -- 172.21.15.88:0/1193605271 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc9ec0c9020 con 0x7fc9f414aa30 2024-04-24T08:26:02.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.273+0000 7fc9fb800640 1 -- 172.21.15.88:0/1193605271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc9f40b49f0 con 0x7fc9f414aa30 2024-04-24T08:26:02.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9f0c00640 1 -- 172.21.15.88:0/1193605271 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7fc9ec016520 con 0x7fc9f414aa30 2024-04-24T08:26:02.926 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2024-04-24T08:26:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9fb800640 1 -- 172.21.15.88:0/1193605271 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc9d40683b0 msgr2=0x7fc9d406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9fb800640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc9d40683b0 0x7fc9d406a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8007fd0 tx=0x7fc9e8009040 comp rx=0 tx=0).stop 2024-04-24T08:26:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9fb800640 1 -- 172.21.15.88:0/1193605271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f414aa30 msgr2=0x7fc9f4138850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9fb800640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f414aa30 0x7fc9f4138850 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0b0040 tx=0x7fc9ec0195b0 comp rx=0 tx=0).stop 2024-04-24T08:26:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9fb800640 1 -- 172.21.15.88:0/1193605271 shutdown_connections 2024-04-24T08:26:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9fb800640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc9d40683b0 0x7fc9d406a870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9fb800640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f414aa30 0x7fc9f4138850 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9fb800640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f406e670 0x7fc9f40ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9fb800640 1 --2- 172.21.15.88:0/1193605271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9f406d5b0 0x7fc9f41e3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9fb800640 1 -- 172.21.15.88:0/1193605271 >> 172.21.15.88:0/1193605271 conn(0x7fc9f40bb4d0 msgr2=0x7fc9f4144e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9fb800640 1 -- 172.21.15.88:0/1193605271 shutdown_connections 2024-04-24T08:26:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:02.925+0000 7fc9fb800640 1 -- 172.21.15.88:0/1193605271 wait complete. 2024-04-24T08:26:02.956 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-24T08:26:02.956 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-24T08:26:02.956 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-24T08:26:02.956 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:26:02.956 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-24T08:26:02.956 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-24T08:26:02.956 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-24T08:26:02.956 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:26:02.969 INFO:tasks.ceph.mds.a:Stopped 2024-04-24T08:26:02.969 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-24T08:26:02.969 INFO:tasks.ceph.mds.b:Stopped 2024-04-24T08:26:02.969 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-24T08:26:03.014 INFO:tasks.ceph.mds.b:Started 2024-04-24T08:26:03.014 DEBUG:teuthology.parallel:result is None 2024-04-24T08:26:03.015 INFO:tasks.ceph.mds.a:Started 2024-04-24T08:26:03.015 DEBUG:teuthology.parallel:result is None 2024-04-24T08:26:03.015 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-24T08:26:03.099 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2024-04-24T08:26:03.100 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-04-24T08:26:03.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75fe00640 1 Processor -- start 2024-04-24T08:26:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75fe00640 1 -- start start 2024-04-24T08:26:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75809b620 0x7fb75809ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb75809c4d0 0x7fb7581492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75fe00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7581497f0 0x7fb75806d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75fe00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb75806eb30 con 0x7fb7581497f0 2024-04-24T08:26:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75fe00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb75809d430 con 0x7fb75809c4d0 2024-04-24T08:26:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb75809dea0 con 0x7fb75809b620 2024-04-24T08:26:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75de00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7581497f0 0x7fb75806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75d400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75809b620 0x7fb75809ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75de00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7581497f0 0x7fb75806d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54100/0 (socket says 172.21.15.88:54100) 2024-04-24T08:26:03.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75de00640 1 -- 172.21.15.88:0/463194806 learned_addr learned my addr 172.21.15.88:0/463194806 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:03.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75ca00640 1 --2- 172.21.15.88:0/463194806 >> v2:172.21.15.142:3300/0 conn(0x7fb75809c4d0 0x7fb7581492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:03.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75de00640 1 -- 172.21.15.88:0/463194806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75809b620 msgr2=0x7fb75809ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:03.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75de00640 1 --2- 172.21.15.88:0/463194806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75809b620 0x7fb75809ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:03.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75de00640 1 -- 172.21.15.88:0/463194806 >> v2:172.21.15.142:3300/0 conn(0x7fb75809c4d0 msgr2=0x7fb7581492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:03.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75de00640 1 --2- 172.21.15.88:0/463194806 >> v2:172.21.15.142:3300/0 conn(0x7fb75809c4d0 0x7fb7581492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:03.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.153+0000 7fb75de00640 1 -- 172.21.15.88:0/463194806 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75809d6a0 con 0x7fb7581497f0 2024-04-24T08:26:03.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb75de00640 1 --2- 172.21.15.88:0/463194806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7581497f0 0x7fb75806d210 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb75806eee0 tx=0x7fb75001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3921956ab32bafd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:03.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb757e00640 1 -- 172.21.15.88:0/463194806 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7500a55e0 con 0x7fb7581497f0 2024-04-24T08:26:03.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb757e00640 1 -- 172.21.15.88:0/463194806 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7500a5780 con 0x7fb7581497f0 2024-04-24T08:26:03.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb757e00640 1 -- 172.21.15.88:0/463194806 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7500a5b50 con 0x7fb7581497f0 2024-04-24T08:26:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb75fe00640 1 -- 172.21.15.88:0/463194806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7581497f0 msgr2=0x7fb75806d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb75fe00640 1 --2- 172.21.15.88:0/463194806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7581497f0 0x7fb75806d210 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb75806eee0 tx=0x7fb75001c960 comp rx=0 tx=0).stop 2024-04-24T08:26:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb75fe00640 1 -- 172.21.15.88:0/463194806 shutdown_connections 2024-04-24T08:26:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb75fe00640 1 --2- 172.21.15.88:0/463194806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7581497f0 0x7fb75806d210 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb75fe00640 1 --2- 172.21.15.88:0/463194806 >> v2:172.21.15.142:3300/0 conn(0x7fb75809c4d0 0x7fb7581492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb75fe00640 1 --2- 172.21.15.88:0/463194806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75809b620 0x7fb75809ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb75fe00640 1 -- 172.21.15.88:0/463194806 >> 172.21.15.88:0/463194806 conn(0x7fb7580b9420 msgr2=0x7fb7580b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb75fe00640 1 -- 172.21.15.88:0/463194806 shutdown_connections 2024-04-24T08:26:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.157+0000 7fb75fe00640 1 -- 172.21.15.88:0/463194806 wait complete. 2024-04-24T08:26:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75fe00640 1 Processor -- start 2024-04-24T08:26:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75fe00640 1 -- start start 2024-04-24T08:26:03.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75809b620 0x7fb7581489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:03.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb75809c4d0 0x7fb758099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:03.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7581497f0 0x7fb75809a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:03.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75fe00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb758143010 con 0x7fb75809c4d0 2024-04-24T08:26:03.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75fe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb758142e90 con 0x7fb7581497f0 2024-04-24T08:26:03.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb758143190 con 0x7fb75809b620 2024-04-24T08:26:03.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75ca00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb75809c4d0 0x7fb758099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:03.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75d400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75809b620 0x7fb7581489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:03.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75d400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75809b620 0x7fb7581489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:58530/0 (socket says 172.21.15.88:58530) 2024-04-24T08:26:03.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75d400640 1 -- 172.21.15.88:0/537540021 learned_addr learned my addr 172.21.15.88:0/537540021 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75de00640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7581497f0 0x7fb75809a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75d400640 1 -- 172.21.15.88:0/537540021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7581497f0 msgr2=0x7fb75809a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75d400640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7581497f0 0x7fb75809a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75d400640 1 -- 172.21.15.88:0/537540021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb75809c4d0 msgr2=0x7fb758099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75d400640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb75809c4d0 0x7fb758099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75d400640 1 -- 172.21.15.88:0/537540021 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb758150060 con 0x7fb75809b620 2024-04-24T08:26:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75d400640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75809b620 0x7fb7581489a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00e960 tx=0x7fb74c00ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb755600640 1 -- 172.21.15.88:0/537540021 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c017070 con 0x7fb75809b620 2024-04-24T08:26:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb755600640 1 -- 172.21.15.88:0/537540021 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74c00ca00 con 0x7fb75809b620 2024-04-24T08:26:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75fe00640 1 -- 172.21.15.88:0/537540021 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb758150340 con 0x7fb75809b620 2024-04-24T08:26:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb755600640 1 -- 172.21.15.88:0/537540021 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00cdb0 con 0x7fb75809b620 2024-04-24T08:26:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75fe00640 1 -- 172.21.15.88:0/537540021 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb75813ce70 con 0x7fb75809b620 2024-04-24T08:26:03.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.161+0000 7fb75fe00640 1 -- 172.21.15.88:0/537540021 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb75813d400 con 0x7fb75809b620 2024-04-24T08:26:03.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.165+0000 7fb755600640 1 -- 172.21.15.88:0/537540021 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb74c01a070 con 0x7fb75809b620 2024-04-24T08:26:03.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.165+0000 7fb755600640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb738068380 0x7fb73806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:03.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.165+0000 7fb755600640 1 -- 172.21.15.88:0/537540021 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 4943+0+0 (secure 0 0 0) 0x7fb74c086e10 con 0x7fb75809b620 2024-04-24T08:26:03.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.165+0000 7fb75ca00640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb738068380 0x7fb73806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:03.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.165+0000 7fb75ca00640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb738068380 0x7fb73806a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb7581490b0 tx=0x7fb744009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:03.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.169+0000 7fb755600640 1 -- 172.21.15.88:0/537540021 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb74c0570f0 con 0x7fb75809b620 2024-04-24T08:26:03.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.345+0000 7fb75fe00640 1 -- 172.21.15.88:0/537540021 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb75814fe50 con 0x7fb75809b620 2024-04-24T08:26:03.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.949+0000 7fb755600640 1 -- 172.21.15.88:0/537540021 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) ==== 97+0+0 (secure 0 0 0) 0x7fb74c05b3f0 con 0x7fb75809b620 2024-04-24T08:26:03.952 INFO:teuthology.orchestra.run.smithi088.stderr: removed all blocklist entries 2024-04-24T08:26:03.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.953+0000 7fb75fe00640 1 -- 172.21.15.88:0/537540021 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb738068380 msgr2=0x7fb73806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:03.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.953+0000 7fb75fe00640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb738068380 0x7fb73806a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb7581490b0 tx=0x7fb744009190 comp rx=0 tx=0).stop 2024-04-24T08:26:03.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.953+0000 7fb75fe00640 1 -- 172.21.15.88:0/537540021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75809b620 msgr2=0x7fb7581489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:03.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.953+0000 7fb75fe00640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75809b620 0x7fb7581489a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00e960 tx=0x7fb74c00ee20 comp rx=0 tx=0).stop 2024-04-24T08:26:03.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.953+0000 7fb75fe00640 1 -- 172.21.15.88:0/537540021 shutdown_connections 2024-04-24T08:26:03.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.953+0000 7fb75fe00640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb738068380 0x7fb73806a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:03.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.953+0000 7fb75fe00640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7581497f0 0x7fb75809a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:03.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.953+0000 7fb75fe00640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb75809c4d0 0x7fb758099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:03.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.953+0000 7fb75fe00640 1 --2- 172.21.15.88:0/537540021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75809b620 0x7fb7581489a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:03.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.953+0000 7fb75fe00640 1 -- 172.21.15.88:0/537540021 >> 172.21.15.88:0/537540021 conn(0x7fb7580b9420 msgr2=0x7fb7580af730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:03.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.953+0000 7fb75fe00640 1 -- 172.21.15.88:0/537540021 shutdown_connections 2024-04-24T08:26:03.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:03.953+0000 7fb75fe00640 1 -- 172.21.15.88:0/537540021 wait complete. 2024-04-24T08:26:03.974 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-24T08:26:04.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.105+0000 7f715b600640 1 Processor -- start 2024-04-24T08:26:04.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.105+0000 7f715b600640 1 -- start start 2024-04-24T08:26:04.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f715b600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715409be30 0x7f7154145f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f715b600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71540ba170 con 0x7f71540b9d90 2024-04-24T08:26:04.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f715b600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715414a060 con 0x7f715406d920 2024-04-24T08:26:04.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f715b600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f715409cd30 con 0x7f715409be30 2024-04-24T08:26:04.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7158c00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f71540b9d90 0x7f715406d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46720/0 (socket says 172.21.15.88:46720) 2024-04-24T08:26:04.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7158c00640 1 -- 172.21.15.88:0/2808596946 learned_addr learned my addr 172.21.15.88:0/2808596946 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:04.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153e00640 1 --2- 172.21.15.88:0/2808596946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715409be30 0x7f7154145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321584382 0 0) 0x7f71540ba170 con 0x7f71540b9d90 2024-04-24T08:26:04.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7138003530 con 0x7f71540b9d90 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1335951402 0 0) 0x7f715414a060 con 0x7f715406d920 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71540ba170 con 0x7f715406d920 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3864700991 0 0) 0x7f7138003530 con 0x7f71540b9d90 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715409be30 msgr2=0x7f7154145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 --2- 172.21.15.88:0/2808596946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715409be30 0x7f7154145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 >> v1:172.21.15.142:6789/0 conn(0x7f715406d920 legacy=0x7f71541504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7154149860 con 0x7f71540b9d90 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f7144001a00 con 0x7f71540b9d90 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 >> v1:172.21.15.88:6789/0 conn(0x7f71540b9d90 legacy=0x7f715406d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 --2- 172.21.15.88:0/2808596946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715409be30 0x7f7138003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 --2- 172.21.15.88:0/2808596946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7138004130 0x7f7138004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 --2- 172.21.15.88:0/2808596946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7138004d50 0x7f71380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f715409cd30 con 0x7f7138004130 2024-04-24T08:26:04.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f713800bc30 con 0x7f7138004d50 2024-04-24T08:26:04.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f713800be30 con 0x7f715409be30 2024-04-24T08:26:04.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153e00640 1 --2- 172.21.15.88:0/2808596946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7138004130 0x7f7138004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7159600640 1 --2- 172.21.15.88:0/2808596946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7138004d50 0x7f71380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7158c00640 1 --2- 172.21.15.88:0/2808596946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715409be30 0x7f7138003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153e00640 1 -- 172.21.15.88:0/2808596946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715409be30 msgr2=0x7f7138003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:04.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153e00640 1 --2- 172.21.15.88:0/2808596946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715409be30 0x7f7138003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153e00640 1 -- 172.21.15.88:0/2808596946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7138004d50 msgr2=0x7f71380051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:04.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153e00640 1 --2- 172.21.15.88:0/2808596946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7138004d50 0x7f71380051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.109+0000 7f7153e00640 1 -- 172.21.15.88:0/2808596946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7138003530 con 0x7f7138004130 2024-04-24T08:26:04.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f7153e00640 1 --2- 172.21.15.88:0/2808596946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7138004130 0x7f7138004810 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7140009ae0 tx=0x7f714001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9f1d8a681dce1d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:04.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71400b2070 con 0x7f7138004130 2024-04-24T08:26:04.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71400a5510 con 0x7f7138004130 2024-04-24T08:26:04.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f7153400640 1 -- 172.21.15.88:0/2808596946 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71400096b0 con 0x7f7138004130 2024-04-24T08:26:04.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f715b600640 1 -- 172.21.15.88:0/2808596946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7138004130 msgr2=0x7f7138004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f715b600640 1 --2- 172.21.15.88:0/2808596946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7138004130 0x7f7138004810 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7140009ae0 tx=0x7f714001ca70 comp rx=0 tx=0).stop 2024-04-24T08:26:04.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f7159600640 1 -- 172.21.15.88:0/2808596946 reap_dead start 2024-04-24T08:26:04.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f715b600640 1 -- 172.21.15.88:0/2808596946 shutdown_connections 2024-04-24T08:26:04.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f715b600640 1 -- 172.21.15.88:0/2808596946 >> 172.21.15.88:0/2808596946 conn(0x7f715406c0d0 msgr2=0x7f71540b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:04.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f715b600640 1 -- 172.21.15.88:0/2808596946 shutdown_connections 2024-04-24T08:26:04.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f715b600640 1 -- 172.21.15.88:0/2808596946 wait complete. 2024-04-24T08:26:04.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f715b600640 1 Processor -- start 2024-04-24T08:26:04.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.113+0000 7f715b600640 1 -- start start 2024-04-24T08:26:04.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f715b600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7138004130 0x7f71540b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f715b600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71540b0820 0x7f71540b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f715b600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71541de8e0 0x7f71540b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f715b600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f71540b3fa0 con 0x7f7138004130 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f715b600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f71540b3e20 con 0x7f71540b0820 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f715b600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7154152410 con 0x7f71541de8e0 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7158c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7138004130 0x7f71540b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7158c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7138004130 0x7f71540b7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54116/0 (socket says 172.21.15.88:54116) 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7158c00640 1 -- 172.21.15.88:0/3148069501 learned_addr learned my addr 172.21.15.88:0/3148069501 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7159600640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71541de8e0 0x7f71540b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7158c00640 1 -- 172.21.15.88:0/3148069501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71541de8e0 msgr2=0x7f71540b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7158c00640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71541de8e0 0x7f71540b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7158c00640 1 -- 172.21.15.88:0/3148069501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71540b0820 msgr2=0x7f71540b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7153e00640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71540b0820 0x7f71540b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7158c00640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71540b0820 0x7f71540b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7158c00640 1 -- 172.21.15.88:0/3148069501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71541dee70 con 0x7f7138004130 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7153e00640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71540b0820 0x7f71540b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:04.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7158c00640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7138004130 0x7f71540b7e90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f71440079a0 tx=0x7f714400a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:04.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7150c00640 1 -- 172.21.15.88:0/3148069501 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144017020 con 0x7f7138004130 2024-04-24T08:26:04.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7150c00640 1 -- 172.21.15.88:0/3148069501 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7144007a90 con 0x7f7138004130 2024-04-24T08:26:04.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7150c00640 1 -- 172.21.15.88:0/3148069501 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144013610 con 0x7f7138004130 2024-04-24T08:26:04.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f715b600640 1 -- 172.21.15.88:0/3148069501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71541df150 con 0x7f7138004130 2024-04-24T08:26:04.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f715b600640 1 -- 172.21.15.88:0/3148069501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71540b8b30 con 0x7f7138004130 2024-04-24T08:26:04.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f715b600640 1 -- 172.21.15.88:0/3148069501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7154068b90 con 0x7f7138004130 2024-04-24T08:26:04.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.117+0000 7f7150c00640 1 -- 172.21.15.88:0/3148069501 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f714401a020 con 0x7f7138004130 2024-04-24T08:26:04.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.121+0000 7f7150c00640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7134068380 0x7f713406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.121+0000 7f7150c00640 1 -- 172.21.15.88:0/3148069501 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7f71440870f0 con 0x7f7138004130 2024-04-24T08:26:04.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.121+0000 7f7153e00640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7134068380 0x7f713406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.121+0000 7f7153e00640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7134068380 0x7f713406a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f71400af000 tx=0x7f71400046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:04.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.125+0000 7f7150c00640 1 -- 172.21.15.88:0/3148069501 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7144021020 con 0x7f7138004130 2024-04-24T08:26:04.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.333+0000 7f715b600640 1 -- 172.21.15.88:0/3148069501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f71540afb70 con 0x7f7138004130 2024-04-24T08:26:04.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.333+0000 7f7150c00640 1 -- 172.21.15.88:0/3148069501 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+5207 (secure 0 0 0) 0x7f7144057960 con 0x7f7138004130 2024-04-24T08:26:04.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:04.337 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:26:04.337 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_dump": [ 2024-04-24T08:26:04.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.337 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.a", 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQC8wShmR3tjLBAAzC/tom6MtpsXzIu4Q8bF4g==", 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.b", 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQC8wShmaLY0MRAA4C7VwUvS2kfRJG3Zs0uZCg==", 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.338 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.0", 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQC/wShmtiJOJBAAftc6wI18dGzb8g67eHItEw==", 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.1", 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDCwShmoiy8LhAAVGF40f/k1DKBdtodsRQYeA==", 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.2", 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDFwShmZq45NxAAiG66924obdbvtga9o774nQ==", 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-04-24T08:26:04.340 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.3", 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDJwShmzC40BRAAiRgfksbTIO3nldg4ZvpDYg==", 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.342 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.4", 2024-04-24T08:26:04.342 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDOwShmmZBXOxAAS8BTD9awA0JC+PgVSdMjuw==", 2024-04-24T08:26:04.342 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.342 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-04-24T08:26:04.342 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-04-24T08:26:04.342 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.342 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.342 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.5", 2024-04-24T08:26:04.342 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDSwShmCfhmChAAdJ0ts5lzvhtpSItkb2AN7A==", 2024-04-24T08:26:04.342 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.343 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-04-24T08:26:04.343 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-04-24T08:26:04.343 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.343 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.343 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.6", 2024-04-24T08:26:04.343 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDVwShmHYxWExAAfQiCyQc/EUiKastD/W0cfw==", 2024-04-24T08:26:04.343 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.343 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-04-24T08:26:04.343 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-04-24T08:26:04.344 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.344 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.344 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.7", 2024-04-24T08:26:04.344 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDYwShmjujbHhAAD0AUXpz9e2X6BFqmdqreVw==", 2024-04-24T08:26:04.344 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.344 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-04-24T08:26:04.344 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-04-24T08:26:04.344 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.344 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.345 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.0", 2024-04-24T08:26:04.345 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQC8wShmTIw5NRAA2gyIbsJGs4xD5Edvy8KmQg==", 2024-04-24T08:26:04.345 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.345 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2024-04-24T08:26:04.345 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow r", 2024-04-24T08:26:04.345 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw", 2024-04-24T08:26:04.345 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rwx" 2024-04-24T08:26:04.345 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.346 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.admin", 2024-04-24T08:26:04.346 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQC8wShm9B3SEBAANvwfcBRmBRejQQWTdCSPkw==", 2024-04-24T08:26:04.346 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.346 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2024-04-24T08:26:04.346 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2024-04-24T08:26:04.346 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2024-04-24T08:26:04.346 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.346 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.347 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-mds", 2024-04-24T08:26:04.347 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDdwShmVIZcOhAAWo5CUlARme5/6T24C0DJ0A==", 2024-04-24T08:26:04.347 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.347 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-mds" 2024-04-24T08:26:04.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.347 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-mgr", 2024-04-24T08:26:04.347 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDdwShmkZBcOhAA0pN/fAn6khwpisnBJrzSFw==", 2024-04-24T08:26:04.347 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.347 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-24T08:26:04.348 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.348 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-osd", 2024-04-24T08:26:04.348 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDdwShmYJlcOhAAaWo6LGflh5vGvl8OqnKdjw==", 2024-04-24T08:26:04.348 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.348 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-osd" 2024-04-24T08:26:04.348 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.348 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rbd", 2024-04-24T08:26:04.349 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDdwShm76FcOhAAn/PDxiV8sGUhdhBY6rgggA==", 2024-04-24T08:26:04.349 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.349 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-24T08:26:04.349 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.349 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-24T08:26:04.349 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDdwShmqKpcOhAAQ2qwJZ6k+TEz3p1v3wv0fg==", 2024-04-24T08:26:04.349 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.349 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-24T08:26:04.349 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.350 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rgw", 2024-04-24T08:26:04.351 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDdwShmg7NcOhAAYbCeul9j1FItjjJEdymBSg==", 2024-04-24T08:26:04.351 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.351 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-24T08:26:04.351 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.351 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.x", 2024-04-24T08:26:04.351 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQC8wShmXIb6JxAA0UBmH5g6fqzx9jHxtbiWEQ==", 2024-04-24T08:26:04.351 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.y", 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQC8wShmEOIlJBAAtSMWYz47ddIsN6TSsgqv0g==", 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.352 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:04.353 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-24T08:26:04.353 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:26:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.337+0000 7f715b600640 1 -- 172.21.15.88:0/3148069501 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7134068380 msgr2=0x7f713406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.337+0000 7f715b600640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7134068380 0x7f713406a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f71400af000 tx=0x7f71400046d0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.337+0000 7f715b600640 1 -- 172.21.15.88:0/3148069501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7138004130 msgr2=0x7f71540b7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.337+0000 7f715b600640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7138004130 0x7f71540b7e90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f71440079a0 tx=0x7f714400a600 comp rx=0 tx=0).stop 2024-04-24T08:26:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.337+0000 7f715b600640 1 -- 172.21.15.88:0/3148069501 shutdown_connections 2024-04-24T08:26:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.337+0000 7f715b600640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7134068380 0x7f713406a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.337+0000 7f715b600640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71541de8e0 0x7f71540b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.337+0000 7f715b600640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71540b0820 0x7f71540b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.337+0000 7f715b600640 1 --2- 172.21.15.88:0/3148069501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7138004130 0x7f71540b7e90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.337+0000 7f715b600640 1 -- 172.21.15.88:0/3148069501 >> 172.21.15.88:0/3148069501 conn(0x7f715406c0d0 msgr2=0x7f71540ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.337+0000 7f715b600640 1 -- 172.21.15.88:0/3148069501 shutdown_connections 2024-04-24T08:26:04.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.337+0000 7f715b600640 1 -- 172.21.15.88:0/3148069501 wait complete. 2024-04-24T08:26:04.358 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-24T08:26:04.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bfa00640 1 Processor -- start 2024-04-24T08:26:04.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bfa00640 1 -- start start 2024-04-24T08:26:04.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bfa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3b8071e40 0x7fb3b814b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bfa00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb3b8142020 0x7fb3b81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bfa00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b8072220 con 0x7fb3b8073db0 2024-04-24T08:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bfa00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb3b8073090 con 0x7fb3b8142020 2024-04-24T08:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bfa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b80babd0 con 0x7fb3b8071e40 2024-04-24T08:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bda00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb3b8142020 0x7fb3b81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3afe00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb3b8073db0 0x7fb3b8141910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46724/0 (socket says 172.21.15.88:46724) 2024-04-24T08:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3afe00640 1 -- 172.21.15.88:0/462466 learned_addr learned my addr 172.21.15.88:0/462466 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bd000640 1 --2- 172.21.15.88:0/462466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3b8071e40 0x7fb3b814b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bda00640 1 -- 172.21.15.88:0/462466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3b8071e40 msgr2=0x7fb3b814b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:04.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bda00640 1 --2- 172.21.15.88:0/462466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3b8071e40 0x7fb3b814b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bda00640 1 -- 172.21.15.88:0/462466 >> v1:172.21.15.88:6789/0 conn(0x7fb3b8073db0 legacy=0x7fb3b8141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3bda00640 1 -- 172.21.15.88:0/462466 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b80baeb0 con 0x7fb3b8142020 2024-04-24T08:26:04.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.493+0000 7fb3b7e00640 1 -- 172.21.15.88:0/462466 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121131687 0 0) 0x7fb3b8072220 con 0x7fb3b8073db0 2024-04-24T08:26:04.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.497+0000 7fb3bda00640 1 --2- 172.21.15.88:0/462466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3b8142020 0x7fb3b81525e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009d90 tx=0x7fb3b001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49edb94384866a71 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:04.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.497+0000 7fb3b7e00640 1 -- 172.21.15.88:0/462466 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00b2070 con 0x7fb3b8142020 2024-04-24T08:26:04.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.497+0000 7fb3b7e00640 1 -- 172.21.15.88:0/462466 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b00a5940 con 0x7fb3b8142020 2024-04-24T08:26:04.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.497+0000 7fb3b7e00640 1 -- 172.21.15.88:0/462466 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00a5d10 con 0x7fb3b8142020 2024-04-24T08:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.497+0000 7fb3bfa00640 1 -- 172.21.15.88:0/462466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3b8142020 msgr2=0x7fb3b81525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.497+0000 7fb3bfa00640 1 --2- 172.21.15.88:0/462466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3b8142020 0x7fb3b81525e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009d90 tx=0x7fb3b001c970 comp rx=0 tx=0).stop 2024-04-24T08:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.497+0000 7fb3bfa00640 1 -- 172.21.15.88:0/462466 shutdown_connections 2024-04-24T08:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.497+0000 7fb3bfa00640 1 --2- 172.21.15.88:0/462466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3b8142020 0x7fb3b81525e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.497+0000 7fb3bfa00640 1 --2- 172.21.15.88:0/462466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3b8071e40 0x7fb3b814b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.497+0000 7fb3bfa00640 1 -- 172.21.15.88:0/462466 >> 172.21.15.88:0/462466 conn(0x7fb3b806d310 msgr2=0x7fb3b80ba4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.497+0000 7fb3bfa00640 1 -- 172.21.15.88:0/462466 shutdown_connections 2024-04-24T08:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.497+0000 7fb3bfa00640 1 -- 172.21.15.88:0/462466 wait complete. 2024-04-24T08:26:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bfa00640 1 Processor -- start 2024-04-24T08:26:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bfa00640 1 -- start start 2024-04-24T08:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bfa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3b8071e40 0x7fb3b81e3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bfa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3b8073db0 0x7fb3b81e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bfa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3b8142020 0x7fb3b8144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bfa00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b80b10e0 con 0x7fb3b8073db0 2024-04-24T08:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bfa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b80b0f60 con 0x7fb3b8071e40 2024-04-24T08:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bfa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b8155340 con 0x7fb3b8142020 2024-04-24T08:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3afe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3b8073db0 0x7fb3b81e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bda00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3b8142020 0x7fb3b8144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3afe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3b8073db0 0x7fb3b81e4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54146/0 (socket says 172.21.15.88:54146) 2024-04-24T08:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3afe00640 1 -- 172.21.15.88:0/2035954222 learned_addr learned my addr 172.21.15.88:0/2035954222 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bd000640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3b8071e40 0x7fb3b81e3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3afe00640 1 -- 172.21.15.88:0/2035954222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3b8142020 msgr2=0x7fb3b8144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3afe00640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3b8142020 0x7fb3b8144980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3afe00640 1 -- 172.21.15.88:0/2035954222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3b8071e40 msgr2=0x7fb3b81e3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3afe00640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3b8071e40 0x7fb3b81e3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3afe00640 1 -- 172.21.15.88:0/2035954222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b8142800 con 0x7fb3b8073db0 2024-04-24T08:26:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bda00640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3b8142020 0x7fb3b8144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:26:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3afe00640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3b8073db0 0x7fb3b81e4200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00011f0 tx=0x7fb3a000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:04.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3b5600640 1 -- 172.21.15.88:0/2035954222 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0018070 con 0x7fb3b8073db0 2024-04-24T08:26:04.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3b5600640 1 -- 172.21.15.88:0/2035954222 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a00074e0 con 0x7fb3b8073db0 2024-04-24T08:26:04.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3b5600640 1 -- 172.21.15.88:0/2035954222 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0004a10 con 0x7fb3b8073db0 2024-04-24T08:26:04.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bfa00640 1 -- 172.21.15.88:0/2035954222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b8141300 con 0x7fb3b8073db0 2024-04-24T08:26:04.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bfa00640 1 -- 172.21.15.88:0/2035954222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b8140f90 con 0x7fb3b8073db0 2024-04-24T08:26:04.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.501+0000 7fb3bfa00640 1 -- 172.21.15.88:0/2035954222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b8068b20 con 0x7fb3b8073db0 2024-04-24T08:26:04.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.505+0000 7fb3b5600640 1 -- 172.21.15.88:0/2035954222 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb3a0004bb0 con 0x7fb3b8073db0 2024-04-24T08:26:04.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.505+0000 7fb3b5600640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb394068380 0x7fb39406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.505+0000 7fb3b5600640 1 -- 172.21.15.88:0/2035954222 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7fb3a00858c0 con 0x7fb3b8073db0 2024-04-24T08:26:04.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.505+0000 7fb3bd000640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb394068380 0x7fb39406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.505+0000 7fb3bd000640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb394068380 0x7fb39406a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009b60 tx=0x7fb3a8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:04.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.509+0000 7fb3b5600640 1 -- 172.21.15.88:0/2035954222 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb3a0055c10 con 0x7fb3b8073db0 2024-04-24T08:26:04.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.721+0000 7fb3bfa00640 1 -- 172.21.15.88:0/2035954222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fb3b8145680 con 0x7fb3b8073db0 2024-04-24T08:26:04.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3b5600640 1 -- 172.21.15.88:0/2035954222 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fb3a0059f10 con 0x7fb3b8073db0 2024-04-24T08:26:04.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3bfa00640 1 -- 172.21.15.88:0/2035954222 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb394068380 msgr2=0x7fb39406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3bfa00640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb394068380 0x7fb39406a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009b60 tx=0x7fb3a8009190 comp rx=0 tx=0).stop 2024-04-24T08:26:04.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3bfa00640 1 -- 172.21.15.88:0/2035954222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3b8073db0 msgr2=0x7fb3b81e4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3bfa00640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3b8073db0 0x7fb3b81e4200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00011f0 tx=0x7fb3a000c9b0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3bfa00640 1 -- 172.21.15.88:0/2035954222 shutdown_connections 2024-04-24T08:26:04.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3bfa00640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb394068380 0x7fb39406a840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3bfa00640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3b8142020 0x7fb3b8144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3bfa00640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3b8073db0 0x7fb3b81e4200 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3bfa00640 1 --2- 172.21.15.88:0/2035954222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3b8071e40 0x7fb3b81e3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3bfa00640 1 -- 172.21.15.88:0/2035954222 >> 172.21.15.88:0/2035954222 conn(0x7fb3b806d310 msgr2=0x7fb3b80b6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:04.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3bfa00640 1 -- 172.21.15.88:0/2035954222 shutdown_connections 2024-04-24T08:26:04.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.725+0000 7fb3bfa00640 1 -- 172.21.15.88:0/2035954222 wait complete. 2024-04-24T08:26:04.747 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-24T08:26:04.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23b7000640 1 Processor -- start 2024-04-24T08:26:04.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23b7000640 1 -- start start 2024-04-24T08:26:04.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23b7000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23b009c730 0x7f23b0148130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23b7000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b00b5760 0x7f23b006d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23b7000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23b00b4fd0 con 0x7f23b006d750 2024-04-24T08:26:04.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23b7000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f23b00b52d0 con 0x7f23b009c730 2024-04-24T08:26:04.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23b7000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f23b00aeb30 con 0x7f23b00b5760 2024-04-24T08:26:04.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23afe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23b009c730 0x7f23b0148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23a7400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b00b5760 0x7f23b006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23b5000640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f23b006d750 0x7f23b0143bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:40880/0 (socket says 172.21.15.88:40880) 2024-04-24T08:26:04.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23a7400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b00b5760 0x7f23b006d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:58594/0 (socket says 172.21.15.88:58594) 2024-04-24T08:26:04.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23a7400640 1 -- 172.21.15.88:0/2737454427 learned_addr learned my addr 172.21.15.88:0/2737454427 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:04.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.881+0000 7f23afe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23b009c730 0x7f23b0148130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:34316/0 (socket says 172.21.15.88:34316) 2024-04-24T08:26:04.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.885+0000 7f23afe00640 1 -- 172.21.15.88:0/2737454427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b00b5760 msgr2=0x7f23b006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:04.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.885+0000 7f23afe00640 1 --2- 172.21.15.88:0/2737454427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b00b5760 0x7f23b006d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.885+0000 7f23afe00640 1 -- 172.21.15.88:0/2737454427 >> v1:172.21.15.142:6789/0 conn(0x7f23b006d750 legacy=0x7f23b0143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.885+0000 7f23afe00640 1 -- 172.21.15.88:0/2737454427 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b0148670 con 0x7f23b009c730 2024-04-24T08:26:04.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.885+0000 7f23af400640 1 -- 172.21.15.88:0/2737454427 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1160018451 0 0) 0x7f23b00b4fd0 con 0x7f23b006d750 2024-04-24T08:26:04.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.885+0000 7f23a7400640 1 --2- 172.21.15.88:0/2737454427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b00b5760 0x7f23b006d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:26:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.885+0000 7f23afe00640 1 --2- 172.21.15.88:0/2737454427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b009c730 0x7f23b0148130 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009d90 tx=0x7f23a001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9472530769b5cc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.885+0000 7f23af400640 1 -- 172.21.15.88:0/2737454427 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00b2070 con 0x7f23b009c730 2024-04-24T08:26:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.885+0000 7f23af400640 1 -- 172.21.15.88:0/2737454427 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a00a59c0 con 0x7f23b009c730 2024-04-24T08:26:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.885+0000 7f23af400640 1 -- 172.21.15.88:0/2737454427 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00a5d90 con 0x7f23b009c730 2024-04-24T08:26:04.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.885+0000 7f23b7000640 1 -- 172.21.15.88:0/2737454427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b009c730 msgr2=0x7f23b0148130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.885+0000 7f23b7000640 1 --2- 172.21.15.88:0/2737454427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b009c730 0x7f23b0148130 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009d90 tx=0x7f23a001c8e0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 -- 172.21.15.88:0/2737454427 shutdown_connections 2024-04-24T08:26:04.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 --2- 172.21.15.88:0/2737454427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b00b5760 0x7f23b006d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 --2- 172.21.15.88:0/2737454427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b009c730 0x7f23b0148130 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 -- 172.21.15.88:0/2737454427 >> 172.21.15.88:0/2737454427 conn(0x7f23b00b9420 msgr2=0x7f23b00b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:04.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 -- 172.21.15.88:0/2737454427 shutdown_connections 2024-04-24T08:26:04.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 -- 172.21.15.88:0/2737454427 wait complete. 2024-04-24T08:26:04.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 Processor -- start 2024-04-24T08:26:04.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 -- start start 2024-04-24T08:26:04.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23b006d750 0x7f23b00b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b009c730 0x7f23b00b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b00b5760 0x7f23b00b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f23b006df70 con 0x7f23b006d750 2024-04-24T08:26:04.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f23b009d3d0 con 0x7f23b00b5760 2024-04-24T08:26:04.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f23b009dbe0 con 0x7f23b009c730 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23afe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23b006d750 0x7f23b00b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23afe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23b006d750 0x7f23b00b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54152/0 (socket says 172.21.15.88:54152) 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23afe00640 1 -- 172.21.15.88:0/1613837921 learned_addr learned my addr 172.21.15.88:0/1613837921 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23a7400640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b009c730 0x7f23b00b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23afe00640 1 -- 172.21.15.88:0/1613837921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b009c730 msgr2=0x7f23b00b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b5000640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b00b5760 0x7f23b00b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23afe00640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b009c730 0x7f23b00b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23afe00640 1 -- 172.21.15.88:0/1613837921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b00b5760 msgr2=0x7f23b00b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23afe00640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b00b5760 0x7f23b00b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23afe00640 1 -- 172.21.15.88:0/1613837921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b0143980 con 0x7f23b006d750 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23a7400640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b009c730 0x7f23b00b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b5000640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b00b5760 0x7f23b00b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23afe00640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23b006d750 0x7f23b00b3440 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f23a001a510 tx=0x7f23a0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:04.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23acc00640 1 -- 172.21.15.88:0/1613837921 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00bd020 con 0x7f23b006d750 2024-04-24T08:26:04.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23acc00640 1 -- 172.21.15.88:0/1613837921 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a00adb70 con 0x7f23b006d750 2024-04-24T08:26:04.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 -- 172.21.15.88:0/1613837921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b00b2760 con 0x7f23b006d750 2024-04-24T08:26:04.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23acc00640 1 -- 172.21.15.88:0/1613837921 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00b2040 con 0x7f23b006d750 2024-04-24T08:26:04.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.889+0000 7f23b7000640 1 -- 172.21.15.88:0/1613837921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b00b0b40 con 0x7f23b006d750 2024-04-24T08:26:04.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.893+0000 7f23b7000640 1 -- 172.21.15.88:0/1613837921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b0143790 con 0x7f23b006d750 2024-04-24T08:26:04.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.893+0000 7f23acc00640 1 -- 172.21.15.88:0/1613837921 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f23a00c0020 con 0x7f23b006d750 2024-04-24T08:26:04.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.893+0000 7f23acc00640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f238c068380 0x7f238c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:04.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.893+0000 7f23acc00640 1 -- 172.21.15.88:0/1613837921 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7f23a0121b10 con 0x7f23b006d750 2024-04-24T08:26:04.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.893+0000 7f23a7400640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f238c068380 0x7f238c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:04.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.893+0000 7f23a7400640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f238c068380 0x7f238c06a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f23b00b2110 tx=0x7f2398008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:04.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:04.897+0000 7f23acc00640 1 -- 172.21.15.88:0/1613837921 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f23a00c7070 con 0x7f23b006d750 2024-04-24T08:26:05.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.113+0000 7f23b7000640 1 -- 172.21.15.88:0/1613837921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f23b0068b20 con 0x7f23b006d750 2024-04-24T08:26:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23acc00640 1 -- 172.21.15.88:0/1613837921 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f23b00b2760 con 0x7f23b006d750 2024-04-24T08:26:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23b7000640 1 -- 172.21.15.88:0/1613837921 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f238c068380 msgr2=0x7f238c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23b7000640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f238c068380 0x7f238c06a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f23b00b2110 tx=0x7f2398008040 comp rx=0 tx=0).stop 2024-04-24T08:26:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23b7000640 1 -- 172.21.15.88:0/1613837921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23b006d750 msgr2=0x7f23b00b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23b7000640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23b006d750 0x7f23b00b3440 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f23a001a510 tx=0x7f23a0019680 comp rx=0 tx=0).stop 2024-04-24T08:26:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23b7000640 1 -- 172.21.15.88:0/1613837921 shutdown_connections 2024-04-24T08:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23b7000640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f238c068380 0x7f238c06a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23b7000640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b00b5760 0x7f23b00b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23b7000640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b009c730 0x7f23b00b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23b7000640 1 --2- 172.21.15.88:0/1613837921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23b006d750 0x7f23b00b3440 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23b7000640 1 -- 172.21.15.88:0/1613837921 >> 172.21.15.88:0/1613837921 conn(0x7f23b00b9420 msgr2=0x7f23b00af530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23b7000640 1 -- 172.21.15.88:0/1613837921 shutdown_connections 2024-04-24T08:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.117+0000 7f23b7000640 1 -- 172.21.15.88:0/1613837921 wait complete. 2024-04-24T08:26:05.140 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-24T08:26:05.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.273+0000 7fbf9c800640 1 Processor -- start 2024-04-24T08:26:05.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.273+0000 7fbf9c800640 1 -- start start 2024-04-24T08:26:05.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.273+0000 7fbf9c800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbf94072ad0 0x7fbf94148300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:05.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.273+0000 7fbf9c800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf94148840 0x7fbf94148c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.273+0000 7fbf9c800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf9406bad0 con 0x7fbf94073b90 2024-04-24T08:26:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.273+0000 7fbf9c800640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbf940b15f0 con 0x7fbf94072ad0 2024-04-24T08:26:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.273+0000 7fbf9c800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbf94073f70 con 0x7fbf94148840 2024-04-24T08:26:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.273+0000 7fbf99e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbf94073b90 0x7fbf940b41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46738/0 (socket says 172.21.15.88:46738) 2024-04-24T08:26:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.273+0000 7fbf99400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbf94072ad0 0x7fbf94148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.273+0000 7fbf99e00640 1 -- 172.21.15.88:0/4086674610 learned_addr learned my addr 172.21.15.88:0/4086674610 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.273+0000 7fbf9a800640 1 --2- 172.21.15.88:0/4086674610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf94148840 0x7fbf94148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf99400640 1 -- 172.21.15.88:0/4086674610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf94148840 msgr2=0x7fbf94148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf99400640 1 --2- 172.21.15.88:0/4086674610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf94148840 0x7fbf94148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf99400640 1 -- 172.21.15.88:0/4086674610 >> v1:172.21.15.88:6789/0 conn(0x7fbf94073b90 legacy=0x7fbf940b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf99400640 1 -- 172.21.15.88:0/4086674610 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf94073130 con 0x7fbf94072ad0 2024-04-24T08:26:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf9a800640 1 --2- 172.21.15.88:0/4086674610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf94148840 0x7fbf94148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:05.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf99400640 1 --2- 172.21.15.88:0/4086674610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94072ad0 0x7fbf94148300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbf840097c0 tx=0x7fbf8401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97df1e60130c4f13 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:05.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf98a00640 1 -- 172.21.15.88:0/4086674610 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf840b0070 con 0x7fbf94072ad0 2024-04-24T08:26:05.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf98a00640 1 -- 172.21.15.88:0/4086674610 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf840ab600 con 0x7fbf94072ad0 2024-04-24T08:26:05.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf98a00640 1 -- 172.21.15.88:0/4086674610 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf840ab9d0 con 0x7fbf94072ad0 2024-04-24T08:26:05.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf9c800640 1 -- 172.21.15.88:0/4086674610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94072ad0 msgr2=0x7fbf94148300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf9c800640 1 --2- 172.21.15.88:0/4086674610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94072ad0 0x7fbf94148300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbf840097c0 tx=0x7fbf8401c380 comp rx=0 tx=0).stop 2024-04-24T08:26:05.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf9c800640 1 -- 172.21.15.88:0/4086674610 shutdown_connections 2024-04-24T08:26:05.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf9c800640 1 --2- 172.21.15.88:0/4086674610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf94148840 0x7fbf94148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf9c800640 1 --2- 172.21.15.88:0/4086674610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94072ad0 0x7fbf94148300 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf9c800640 1 -- 172.21.15.88:0/4086674610 >> 172.21.15.88:0/4086674610 conn(0x7fbf940ba4c0 msgr2=0x7fbf940ba8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:05.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf9c800640 1 -- 172.21.15.88:0/4086674610 shutdown_connections 2024-04-24T08:26:05.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.277+0000 7fbf9c800640 1 -- 172.21.15.88:0/4086674610 wait complete. 2024-04-24T08:26:05.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9c800640 1 Processor -- start 2024-04-24T08:26:05.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9c800640 1 -- start start 2024-04-24T08:26:05.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9c800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf94072ad0 0x7fbf940adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9c800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf94073b90 0x7fbf941e0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9c800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94148840 0x7fbf941e0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9c800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbf94072690 con 0x7fbf94148840 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9c800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbf940b4900 con 0x7fbf94073b90 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9c800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbf94072810 con 0x7fbf94072ad0 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9a800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94148840 0x7fbf941e0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9a800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94148840 0x7fbf941e0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54172/0 (socket says 172.21.15.88:54172) 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf99e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf94072ad0 0x7fbf940adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9a800640 1 -- 172.21.15.88:0/4101728471 learned_addr learned my addr 172.21.15.88:0/4101728471 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf99400640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf94073b90 0x7fbf941e0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9a800640 1 -- 172.21.15.88:0/4101728471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf94072ad0 msgr2=0x7fbf940adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9a800640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf94072ad0 0x7fbf940adc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9a800640 1 -- 172.21.15.88:0/4101728471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf94073b90 msgr2=0x7fbf941e0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9a800640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf94073b90 0x7fbf941e0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9a800640 1 -- 172.21.15.88:0/4101728471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf94143830 con 0x7fbf94148840 2024-04-24T08:26:05.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9a800640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94148840 0x7fbf941e0e50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf90007e70 tx=0x7fbf9000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:05.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf8e000640 1 -- 172.21.15.88:0/4101728471 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9001a070 con 0x7fbf94148840 2024-04-24T08:26:05.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf8e000640 1 -- 172.21.15.88:0/4101728471 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf90003bc0 con 0x7fbf94148840 2024-04-24T08:26:05.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf8e000640 1 -- 172.21.15.88:0/4101728471 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90004030 con 0x7fbf94148840 2024-04-24T08:26:05.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9c800640 1 -- 172.21.15.88:0/4101728471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf940af1f0 con 0x7fbf94148840 2024-04-24T08:26:05.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.281+0000 7fbf9c800640 1 -- 172.21.15.88:0/4101728471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf940aef10 con 0x7fbf94148840 2024-04-24T08:26:05.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.285+0000 7fbf9c800640 1 -- 172.21.15.88:0/4101728471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf94068b20 con 0x7fbf94148840 2024-04-24T08:26:05.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.285+0000 7fbf8e000640 1 -- 172.21.15.88:0/4101728471 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbf9001d070 con 0x7fbf94148840 2024-04-24T08:26:05.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.285+0000 7fbf8e000640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbf780683b0 0x7fbf7806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:05.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.285+0000 7fbf8e000640 1 -- 172.21.15.88:0/4101728471 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7fbf900867f0 con 0x7fbf94148840 2024-04-24T08:26:05.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.285+0000 7fbf99e00640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbf780683b0 0x7fbf7806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:05.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.285+0000 7fbf99e00640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbf780683b0 0x7fbf7806a870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbf88000f70 tx=0x7fbf88007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:05.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.289+0000 7fbf8e000640 1 -- 172.21.15.88:0/4101728471 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbf90010070 con 0x7fbf94148840 2024-04-24T08:26:05.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.505+0000 7fbf9c800640 1 -- 172.21.15.88:0/4101728471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fbf940b6da0 con 0x7fbf94148840 2024-04-24T08:26:05.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.505+0000 7fbf8e000640 1 -- 172.21.15.88:0/4101728471 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7fbf90056aa0 con 0x7fbf94148840 2024-04-24T08:26:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.509+0000 7fbf9c800640 1 -- 172.21.15.88:0/4101728471 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbf780683b0 msgr2=0x7fbf7806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.509+0000 7fbf9c800640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbf780683b0 0x7fbf7806a870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbf88000f70 tx=0x7fbf88007e90 comp rx=0 tx=0).stop 2024-04-24T08:26:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.509+0000 7fbf9c800640 1 -- 172.21.15.88:0/4101728471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94148840 msgr2=0x7fbf941e0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.509+0000 7fbf9c800640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94148840 0x7fbf941e0e50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf90007e70 tx=0x7fbf9000d4a0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.509+0000 7fbf9c800640 1 -- 172.21.15.88:0/4101728471 shutdown_connections 2024-04-24T08:26:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.509+0000 7fbf9c800640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbf780683b0 0x7fbf7806a870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.509+0000 7fbf9c800640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf94148840 0x7fbf941e0e50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.509+0000 7fbf9c800640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf94073b90 0x7fbf941e0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.509+0000 7fbf9c800640 1 --2- 172.21.15.88:0/4101728471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf94072ad0 0x7fbf940adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.509+0000 7fbf9c800640 1 -- 172.21.15.88:0/4101728471 >> 172.21.15.88:0/4101728471 conn(0x7fbf940ba4c0 msgr2=0x7fbf94074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.509+0000 7fbf9c800640 1 -- 172.21.15.88:0/4101728471 shutdown_connections 2024-04-24T08:26:05.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.509+0000 7fbf9c800640 1 -- 172.21.15.88:0/4101728471 wait complete. 2024-04-24T08:26:05.530 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-24T08:26:05.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.665+0000 7f88f9800640 1 Processor -- start 2024-04-24T08:26:05.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.665+0000 7f88f9800640 1 -- start start 2024-04-24T08:26:05.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.665+0000 7f88f9800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88f41489a0 0x7f88f4153660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:05.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.665+0000 7f88f9800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f406eb30 con 0x7f88f40b7b90 2024-04-24T08:26:05.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.665+0000 7f88f9800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f4147d90 con 0x7f88f406e750 2024-04-24T08:26:05.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.665+0000 7f88f9800640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f88f406dfd0 con 0x7f88f41489a0 2024-04-24T08:26:05.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.665+0000 7f88f3400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88f41489a0 0x7f88f4153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:05.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.665+0000 7f88f2000640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f88f40b7b90 0x7f88f4148290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46748/0 (socket says 172.21.15.88:46748) 2024-04-24T08:26:05.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.665+0000 7f88f2000640 1 -- 172.21.15.88:0/525891696 learned_addr learned my addr 172.21.15.88:0/525891696 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:05.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.665+0000 7f88f3400640 1 -- 172.21.15.88:0/525891696 >> v1:172.21.15.142:6789/0 conn(0x7f88f406e750 legacy=0x7f88f40b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.665+0000 7f88f3400640 1 -- 172.21.15.88:0/525891696 >> v1:172.21.15.88:6789/0 conn(0x7f88f40b7b90 legacy=0x7f88f4148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.665+0000 7f88f3400640 1 -- 172.21.15.88:0/525891696 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f406cd80 con 0x7f88f41489a0 2024-04-24T08:26:05.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.669+0000 7f88f3400640 1 --2- 172.21.15.88:0/525891696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88f41489a0 0x7f88f4153660 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0097c0 tx=0x7f88ec01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9e45a9cd66e3a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:05.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.669+0000 7f88f1600640 1 -- 172.21.15.88:0/525891696 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0b0070 con 0x7f88f41489a0 2024-04-24T08:26:05.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.669+0000 7f88f1600640 1 -- 172.21.15.88:0/525891696 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ec0ab600 con 0x7f88f41489a0 2024-04-24T08:26:05.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.669+0000 7f88f1600640 1 -- 172.21.15.88:0/525891696 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0ab9d0 con 0x7f88f41489a0 2024-04-24T08:26:05.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.669+0000 7f88f9800640 1 -- 172.21.15.88:0/525891696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88f41489a0 msgr2=0x7f88f4153660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.669+0000 7f88f9800640 1 --2- 172.21.15.88:0/525891696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88f41489a0 0x7f88f4153660 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0097c0 tx=0x7f88ec01c410 comp rx=0 tx=0).stop 2024-04-24T08:26:05.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.669+0000 7f88f9800640 1 -- 172.21.15.88:0/525891696 shutdown_connections 2024-04-24T08:26:05.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.669+0000 7f88f9800640 1 --2- 172.21.15.88:0/525891696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88f41489a0 0x7f88f4153660 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.669+0000 7f88f9800640 1 -- 172.21.15.88:0/525891696 >> 172.21.15.88:0/525891696 conn(0x7f88f40bb4d0 msgr2=0x7f88f40bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:05.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.669+0000 7f88f9800640 1 -- 172.21.15.88:0/525891696 shutdown_connections 2024-04-24T08:26:05.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.669+0000 7f88f9800640 1 -- 172.21.15.88:0/525891696 wait complete. 2024-04-24T08:26:05.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f9800640 1 Processor -- start 2024-04-24T08:26:05.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f9800640 1 -- start start 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f9800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88f406e750 0x7f88f4149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f9800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f40b7b90 0x7f88f41e0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f9800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88f41489a0 0x7f88f41e1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f9800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f88f4156950 con 0x7f88f41489a0 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f9800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f88f41567d0 con 0x7f88f40b7b90 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f9800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f88f4156ad0 con 0x7f88f406e750 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f3400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88f41489a0 0x7f88f41e1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f3400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88f41489a0 0x7f88f41e1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54184/0 (socket says 172.21.15.88:54184) 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f3400640 1 -- 172.21.15.88:0/3429915787 learned_addr learned my addr 172.21.15.88:0/3429915787 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f2000640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f40b7b90 0x7f88f41e0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f2a00640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88f406e750 0x7f88f4149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f3400640 1 -- 172.21.15.88:0/3429915787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88f406e750 msgr2=0x7f88f4149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f3400640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88f406e750 0x7f88f4149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f3400640 1 -- 172.21.15.88:0/3429915787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f40b7b90 msgr2=0x7f88f41e0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f3400640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f40b7b90 0x7f88f41e0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f3400640 1 -- 172.21.15.88:0/3429915787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f40b2a50 con 0x7f88f41489a0 2024-04-24T08:26:05.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f2000640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f40b7b90 0x7f88f41e0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:05.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f3400640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88f41489a0 0x7f88f41e1300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0ae040 tx=0x7f88ec0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:05.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88eaa00640 1 -- 172.21.15.88:0/3429915787 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0b8020 con 0x7f88f41489a0 2024-04-24T08:26:05.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88eaa00640 1 -- 172.21.15.88:0/3429915787 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ec0b4410 con 0x7f88f41489a0 2024-04-24T08:26:05.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88eaa00640 1 -- 172.21.15.88:0/3429915787 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0b0040 con 0x7f88f41489a0 2024-04-24T08:26:05.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f9800640 1 -- 172.21.15.88:0/3429915787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f40b4380 con 0x7f88f41489a0 2024-04-24T08:26:05.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f9800640 1 -- 172.21.15.88:0/3429915787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f4142050 con 0x7f88f41489a0 2024-04-24T08:26:05.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.673+0000 7f88f9800640 1 -- 172.21.15.88:0/3429915787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f4068b20 con 0x7f88f41489a0 2024-04-24T08:26:05.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.677+0000 7f88eaa00640 1 -- 172.21.15.88:0/3429915787 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f88ec0bb020 con 0x7f88f41489a0 2024-04-24T08:26:05.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.677+0000 7f88eaa00640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f88d4068380 0x7f88d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:05.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.677+0000 7f88eaa00640 1 -- 172.21.15.88:0/3429915787 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7f88ec120390 con 0x7f88f41489a0 2024-04-24T08:26:05.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.677+0000 7f88f2a00640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f88d4068380 0x7f88d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:05.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.677+0000 7f88f2a00640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f88d4068380 0x7f88d406a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f88e4001cb0 tx=0x7f88e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:05.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.681+0000 7f88eaa00640 1 -- 172.21.15.88:0/3429915787 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f88ec0c2030 con 0x7f88f41489a0 2024-04-24T08:26:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.893+0000 7f88f9800640 1 -- 172.21.15.88:0/3429915787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f88f40bb1c0 con 0x7f88f41489a0 2024-04-24T08:26:05.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88eaa00640 1 -- 172.21.15.88:0/3429915787 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f88ec016090 con 0x7f88f41489a0 2024-04-24T08:26:05.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88f9800640 1 -- 172.21.15.88:0/3429915787 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f88d4068380 msgr2=0x7f88d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88f9800640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f88d4068380 0x7f88d406a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f88e4001cb0 tx=0x7f88e4009040 comp rx=0 tx=0).stop 2024-04-24T08:26:05.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88f9800640 1 -- 172.21.15.88:0/3429915787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88f41489a0 msgr2=0x7f88f41e1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88f9800640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88f41489a0 0x7f88f41e1300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0ae040 tx=0x7f88ec0191b0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88f9800640 1 -- 172.21.15.88:0/3429915787 shutdown_connections 2024-04-24T08:26:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88f9800640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f88d4068380 0x7f88d406a840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88f9800640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88f41489a0 0x7f88f41e1300 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88f9800640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f40b7b90 0x7f88f41e0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88f9800640 1 --2- 172.21.15.88:0/3429915787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88f406e750 0x7f88f4149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88f9800640 1 -- 172.21.15.88:0/3429915787 >> 172.21.15.88:0/3429915787 conn(0x7f88f40bb4d0 msgr2=0x7f88f40ba990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88f9800640 1 -- 172.21.15.88:0/3429915787 shutdown_connections 2024-04-24T08:26:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:05.897+0000 7f88f9800640 1 -- 172.21.15.88:0/3429915787 wait complete. 2024-04-24T08:26:05.919 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-24T08:26:06.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.053+0000 7fd75a400640 1 Processor -- start 2024-04-24T08:26:06.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.053+0000 7fd75a400640 1 -- start start 2024-04-24T08:26:06.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd75a400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7540b7870 0x7fd754073860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd75a400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd754147e30 0x7fd7541527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd75a400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd754148e10 con 0x7fd754073da0 2024-04-24T08:26:06.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd75a400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd754148980 con 0x7fd754147e30 2024-04-24T08:26:06.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd75a400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd7540b7c50 con 0x7fd7540b7870 2024-04-24T08:26:06.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd753400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7540b7870 0x7fd754073860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd753e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd754147e30 0x7fd7541527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd753400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7540b7870 0x7fd754073860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:58646/0 (socket says 172.21.15.88:58646) 2024-04-24T08:26:06.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd74be00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd754073da0 0x7fd7540b6230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:40902/0 (socket says 172.21.15.88:40902) 2024-04-24T08:26:06.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd74be00640 1 -- 172.21.15.88:0/555754748 learned_addr learned my addr 172.21.15.88:0/555754748 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:06.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd753e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd754147e30 0x7fd7541527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:34356/0 (socket says 172.21.15.88:34356) 2024-04-24T08:26:06.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd753400640 1 -- 172.21.15.88:0/555754748 >> v2:172.21.15.142:3300/0 conn(0x7fd754147e30 msgr2=0x7fd7541527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:06.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd753400640 1 --2- 172.21.15.88:0/555754748 >> v2:172.21.15.142:3300/0 conn(0x7fd754147e30 0x7fd7541527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd753400640 1 -- 172.21.15.88:0/555754748 >> v1:172.21.15.142:6789/0 conn(0x7fd754073da0 legacy=0x7fd7540b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd753400640 1 -- 172.21.15.88:0/555754748 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd754148330 con 0x7fd7540b7870 2024-04-24T08:26:06.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.057+0000 7fd753e00640 1 --2- 172.21.15.88:0/555754748 >> v2:172.21.15.142:3300/0 conn(0x7fd754147e30 0x7fd7541527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:26:06.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd753400640 1 --2- 172.21.15.88:0/555754748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7540b7870 0x7fd754073860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7440097c0 tx=0x7fd74401c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8acb1d9e0f15559 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:06.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd752a00640 1 -- 172.21.15.88:0/555754748 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7440b0070 con 0x7fd7540b7870 2024-04-24T08:26:06.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd752a00640 1 -- 172.21.15.88:0/555754748 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7440ab600 con 0x7fd7540b7870 2024-04-24T08:26:06.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd752a00640 1 -- 172.21.15.88:0/555754748 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7440ab9d0 con 0x7fd7540b7870 2024-04-24T08:26:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd75a400640 1 -- 172.21.15.88:0/555754748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7540b7870 msgr2=0x7fd754073860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd75a400640 1 --2- 172.21.15.88:0/555754748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7540b7870 0x7fd754073860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7440097c0 tx=0x7fd74401c380 comp rx=0 tx=0).stop 2024-04-24T08:26:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd75a400640 1 -- 172.21.15.88:0/555754748 shutdown_connections 2024-04-24T08:26:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd75a400640 1 --2- 172.21.15.88:0/555754748 >> v2:172.21.15.142:3300/0 conn(0x7fd754147e30 0x7fd7541527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd75a400640 1 --2- 172.21.15.88:0/555754748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7540b7870 0x7fd754073860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd75a400640 1 -- 172.21.15.88:0/555754748 >> 172.21.15.88:0/555754748 conn(0x7fd7540bb4d0 msgr2=0x7fd7540bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd75a400640 1 -- 172.21.15.88:0/555754748 shutdown_connections 2024-04-24T08:26:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd75a400640 1 -- 172.21.15.88:0/555754748 wait complete. 2024-04-24T08:26:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd75a400640 1 Processor -- start 2024-04-24T08:26:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.061+0000 7fd75a400640 1 -- start start 2024-04-24T08:26:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd75a400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd754073da0 0x7fd7541e4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd75a400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7540b7870 0x7fd75413dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd75a400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd754147e30 0x7fd75413e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd75a400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd754155510 con 0x7fd754073da0 2024-04-24T08:26:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd75a400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd75406cdf0 con 0x7fd7540b7870 2024-04-24T08:26:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd75a400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd754155690 con 0x7fd754147e30 2024-04-24T08:26:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd753400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd754073da0 0x7fd7541e4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd753400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd754073da0 0x7fd7541e4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54200/0 (socket says 172.21.15.88:54200) 2024-04-24T08:26:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd753400640 1 -- 172.21.15.88:0/2658346472 learned_addr learned my addr 172.21.15.88:0/2658346472 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd74be00640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7540b7870 0x7fd75413dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd753e00640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd754147e30 0x7fd75413e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd753400640 1 -- 172.21.15.88:0/2658346472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd754147e30 msgr2=0x7fd75413e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd753400640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd754147e30 0x7fd75413e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd753400640 1 -- 172.21.15.88:0/2658346472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7540b7870 msgr2=0x7fd75413dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd753400640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7540b7870 0x7fd75413dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd753400640 1 -- 172.21.15.88:0/2658346472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7540b34c0 con 0x7fd754073da0 2024-04-24T08:26:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd753400640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd754073da0 0x7fd7541e4340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd744019fb0 tx=0x7fd744019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd74b400640 1 -- 172.21.15.88:0/2658346472 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7440b8020 con 0x7fd754073da0 2024-04-24T08:26:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd74b400640 1 -- 172.21.15.88:0/2658346472 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7440b4410 con 0x7fd754073da0 2024-04-24T08:26:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd75a400640 1 -- 172.21.15.88:0/2658346472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75413d3c0 con 0x7fd754073da0 2024-04-24T08:26:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd74b400640 1 -- 172.21.15.88:0/2658346472 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7440b0040 con 0x7fd754073da0 2024-04-24T08:26:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd75a400640 1 -- 172.21.15.88:0/2658346472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd75413d980 con 0x7fd754073da0 2024-04-24T08:26:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd75a400640 1 -- 172.21.15.88:0/2658346472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75413d1b0 con 0x7fd754073da0 2024-04-24T08:26:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.065+0000 7fd74b400640 1 -- 172.21.15.88:0/2658346472 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd7440bb020 con 0x7fd754073da0 2024-04-24T08:26:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.069+0000 7fd74b400640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd730068380 0x7fd73006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.069+0000 7fd74b400640 1 -- 172.21.15.88:0/2658346472 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7fd744120290 con 0x7fd754073da0 2024-04-24T08:26:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.069+0000 7fd74be00640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd730068380 0x7fd73006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.069+0000 7fd74be00640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd730068380 0x7fd73006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd754142800 tx=0x7fd73c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:06.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.073+0000 7fd74b400640 1 -- 172.21.15.88:0/2658346472 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd7440c2030 con 0x7fd754073da0 2024-04-24T08:26:06.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.285+0000 7fd75a400640 1 -- 172.21.15.88:0/2658346472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fd754145850 con 0x7fd754073da0 2024-04-24T08:26:06.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd74b400640 1 -- 172.21.15.88:0/2658346472 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7fd7440a4e20 con 0x7fd754073da0 2024-04-24T08:26:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd75a400640 1 -- 172.21.15.88:0/2658346472 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd730068380 msgr2=0x7fd73006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd75a400640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd730068380 0x7fd73006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd754142800 tx=0x7fd73c009040 comp rx=0 tx=0).stop 2024-04-24T08:26:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd75a400640 1 -- 172.21.15.88:0/2658346472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd754073da0 msgr2=0x7fd7541e4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd75a400640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd754073da0 0x7fd7541e4340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd744019fb0 tx=0x7fd744019120 comp rx=0 tx=0).stop 2024-04-24T08:26:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd75a400640 1 -- 172.21.15.88:0/2658346472 shutdown_connections 2024-04-24T08:26:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd75a400640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd730068380 0x7fd73006a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd75a400640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd754147e30 0x7fd75413e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd75a400640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7540b7870 0x7fd75413dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd75a400640 1 --2- 172.21.15.88:0/2658346472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd754073da0 0x7fd7541e4340 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd75a400640 1 -- 172.21.15.88:0/2658346472 >> 172.21.15.88:0/2658346472 conn(0x7fd7540bb4d0 msgr2=0x7fd7540bac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd75a400640 1 -- 172.21.15.88:0/2658346472 shutdown_connections 2024-04-24T08:26:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.289+0000 7fd75a400640 1 -- 172.21.15.88:0/2658346472 wait complete. 2024-04-24T08:26:06.312 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-24T08:26:06.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec4000640 1 Processor -- start 2024-04-24T08:26:06.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec4000640 1 -- start start 2024-04-24T08:26:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec4000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbebc09c4d0 0x7fbebc09ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec4000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbebc09e2d0 0x7fbebc142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec4000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbebc09d430 con 0x7fbebc09b620 2024-04-24T08:26:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec4000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbebc06eb30 con 0x7fbebc09e2d0 2024-04-24T08:26:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec4000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fbebc09dea0 con 0x7fbebc09c4d0 2024-04-24T08:26:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec1600640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbebc09b620 0x7fbebc1492b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46756/0 (socket says 172.21.15.88:46756) 2024-04-24T08:26:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec1600640 1 -- 172.21.15.88:0/356164421 learned_addr learned my addr 172.21.15.88:0/356164421 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec2000640 1 --2- 172.21.15.88:0/356164421 >> v2:172.21.15.88:3300/0 conn(0x7fbebc09e2d0 0x7fbebc142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec0c00640 1 --2- 172.21.15.88:0/356164421 >> v2:172.21.15.142:3300/0 conn(0x7fbebc09c4d0 0x7fbebc09ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbebbe00640 1 -- 172.21.15.88:0/356164421 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 205809492 0 0) 0x7fbebc09d430 con 0x7fbebc09b620 2024-04-24T08:26:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec2000640 1 -- 172.21.15.88:0/356164421 >> v2:172.21.15.142:3300/0 conn(0x7fbebc09c4d0 msgr2=0x7fbebc09ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:06.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec2000640 1 --2- 172.21.15.88:0/356164421 >> v2:172.21.15.142:3300/0 conn(0x7fbebc09c4d0 0x7fbebc09ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec2000640 1 -- 172.21.15.88:0/356164421 >> v1:172.21.15.88:6789/0 conn(0x7fbebc09b620 legacy=0x7fbebc1492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.445+0000 7fbec2000640 1 -- 172.21.15.88:0/356164421 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbebc09d6a0 con 0x7fbebc09e2d0 2024-04-24T08:26:06.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.449+0000 7fbec2000640 1 --2- 172.21.15.88:0/356164421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbebc09e2d0 0x7fbebc142ba0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009d90 tx=0x7fbeb401c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7357635f0f52a70 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:06.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.449+0000 7fbebbe00640 1 -- 172.21.15.88:0/356164421 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb40b0600 con 0x7fbebc09e2d0 2024-04-24T08:26:06.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.449+0000 7fbebbe00640 1 -- 172.21.15.88:0/356164421 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb40b07a0 con 0x7fbebc09e2d0 2024-04-24T08:26:06.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.449+0000 7fbebbe00640 1 -- 172.21.15.88:0/356164421 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb40b0b70 con 0x7fbebc09e2d0 2024-04-24T08:26:06.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.449+0000 7fbec4000640 1 -- 172.21.15.88:0/356164421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbebc09e2d0 msgr2=0x7fbebc142ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.449+0000 7fbec4000640 1 --2- 172.21.15.88:0/356164421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbebc09e2d0 0x7fbebc142ba0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009d90 tx=0x7fbeb401c5e0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.449+0000 7fbec4000640 1 -- 172.21.15.88:0/356164421 shutdown_connections 2024-04-24T08:26:06.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.449+0000 7fbec4000640 1 --2- 172.21.15.88:0/356164421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbebc09e2d0 0x7fbebc142ba0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.449+0000 7fbec4000640 1 --2- 172.21.15.88:0/356164421 >> v2:172.21.15.142:3300/0 conn(0x7fbebc09c4d0 0x7fbebc09ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.449+0000 7fbec4000640 1 -- 172.21.15.88:0/356164421 >> 172.21.15.88:0/356164421 conn(0x7fbebc0b9420 msgr2=0x7fbebc0b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:06.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.449+0000 7fbec4000640 1 -- 172.21.15.88:0/356164421 shutdown_connections 2024-04-24T08:26:06.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.449+0000 7fbec4000640 1 -- 172.21.15.88:0/356164421 wait complete. 2024-04-24T08:26:06.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec4000640 1 Processor -- start 2024-04-24T08:26:06.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec4000640 1 -- start start 2024-04-24T08:26:06.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec4000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbebc09b620 0x7fbebc0b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec4000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc09c4d0 0x7fbebc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec4000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbebc09e2d0 0x7fbebc0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec4000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc152b90 con 0x7fbebc09b620 2024-04-24T08:26:06.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec4000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc152a10 con 0x7fbebc09e2d0 2024-04-24T08:26:06.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec4000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbebc152d10 con 0x7fbebc09c4d0 2024-04-24T08:26:06.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec1600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbebc09b620 0x7fbebc0b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec1600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbebc09b620 0x7fbebc0b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54206/0 (socket says 172.21.15.88:54206) 2024-04-24T08:26:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec1600640 1 -- 172.21.15.88:0/2379213351 learned_addr learned my addr 172.21.15.88:0/2379213351 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec1600640 1 -- 172.21.15.88:0/2379213351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc09c4d0 msgr2=0x7fbebc0b8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec1600640 1 --2- 172.21.15.88:0/2379213351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc09c4d0 0x7fbebc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec1600640 1 -- 172.21.15.88:0/2379213351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbebc09e2d0 msgr2=0x7fbebc0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec1600640 1 --2- 172.21.15.88:0/2379213351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbebc09e2d0 0x7fbebc0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec1600640 1 -- 172.21.15.88:0/2379213351 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbebc0b7b20 con 0x7fbebc09b620 2024-04-24T08:26:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec1600640 1 --2- 172.21.15.88:0/2379213351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbebc09b620 0x7fbebc0b7480 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbeb00011f0 tx=0x7fbeb000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbeb9600640 1 -- 172.21.15.88:0/2379213351 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0018070 con 0x7fbebc09b620 2024-04-24T08:26:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbeb9600640 1 -- 172.21.15.88:0/2379213351 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb00074e0 con 0x7fbebc09b620 2024-04-24T08:26:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec4000640 1 -- 172.21.15.88:0/2379213351 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbebc0b7e00 con 0x7fbebc09b620 2024-04-24T08:26:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbeb9600640 1 -- 172.21.15.88:0/2379213351 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0004a10 con 0x7fbebc09b620 2024-04-24T08:26:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.453+0000 7fbec4000640 1 -- 172.21.15.88:0/2379213351 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbebc0692c0 con 0x7fbebc09b620 2024-04-24T08:26:06.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.457+0000 7fbec4000640 1 -- 172.21.15.88:0/2379213351 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbebc068b20 con 0x7fbebc09b620 2024-04-24T08:26:06.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.457+0000 7fbeb9600640 1 -- 172.21.15.88:0/2379213351 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbeb001b070 con 0x7fbebc09b620 2024-04-24T08:26:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.457+0000 7fbeb9600640 1 --2- 172.21.15.88:0/2379213351 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbe9c068380 0x7fbe9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.457+0000 7fbeb9600640 1 -- 172.21.15.88:0/2379213351 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7fbeb0085a00 con 0x7fbebc09b620 2024-04-24T08:26:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.457+0000 7fbec0c00640 1 --2- 172.21.15.88:0/2379213351 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbe9c068380 0x7fbe9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.457+0000 7fbec0c00640 1 --2- 172.21.15.88:0/2379213351 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbe9c068380 0x7fbe9c06a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbebc1db270 tx=0x7fbea8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.461+0000 7fbeb9600640 1 -- 172.21.15.88:0/2379213351 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbeb0056300 con 0x7fbebc09b620 2024-04-24T08:26:06.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.669+0000 7fbec4000640 1 -- 172.21.15.88:0/2379213351 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fbebc06e2b0 con 0x7fbebc09b620 2024-04-24T08:26:06.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbeb9600640 1 -- 172.21.15.88:0/2379213351 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7fbeb0055c00 con 0x7fbebc09b620 2024-04-24T08:26:06.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbec4000640 1 -- 172.21.15.88:0/2379213351 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbe9c068380 msgr2=0x7fbe9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbec4000640 1 --2- 172.21.15.88:0/2379213351 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbe9c068380 0x7fbe9c06a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbebc1db270 tx=0x7fbea8008040 comp rx=0 tx=0).stop 2024-04-24T08:26:06.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbec4000640 1 -- 172.21.15.88:0/2379213351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbebc09b620 msgr2=0x7fbebc0b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbec4000640 1 --2- 172.21.15.88:0/2379213351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbebc09b620 0x7fbebc0b7480 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbeb00011f0 tx=0x7fbeb000c9b0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbec4000640 1 -- 172.21.15.88:0/2379213351 shutdown_connections 2024-04-24T08:26:06.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbec4000640 1 --2- 172.21.15.88:0/2379213351 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbe9c068380 0x7fbe9c06a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbec4000640 1 --2- 172.21.15.88:0/2379213351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbebc09e2d0 0x7fbebc0b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbec4000640 1 --2- 172.21.15.88:0/2379213351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc09c4d0 0x7fbebc0b8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbec4000640 1 --2- 172.21.15.88:0/2379213351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbebc09b620 0x7fbebc0b7480 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbec4000640 1 -- 172.21.15.88:0/2379213351 >> 172.21.15.88:0/2379213351 conn(0x7fbebc0b9420 msgr2=0x7fbebc0b4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:06.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbec4000640 1 -- 172.21.15.88:0/2379213351 shutdown_connections 2024-04-24T08:26:06.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.673+0000 7fbec4000640 1 -- 172.21.15.88:0/2379213351 wait complete. 2024-04-24T08:26:06.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:26:06.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.829+0000 7f72f1e00640 1 Processor -- start 2024-04-24T08:26:06.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.829+0000 7f72f1e00640 1 -- start start 2024-04-24T08:26:06.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72f1e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f72ec0b44e0 0x7f72ec0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72f1e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec143bb0 0x7f72ec144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72f1e00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72ec0ba170 con 0x7f72ec0b9d90 2024-04-24T08:26:06.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72f1e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f72ec145b80 con 0x7f72ec0b44e0 2024-04-24T08:26:06.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72f1e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f72ec1458a0 con 0x7f72ec143bb0 2024-04-24T08:26:06.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72eaa00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f72ec0b9d90 0x7f72ec1450e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46760/0 (socket says 172.21.15.88:46760) 2024-04-24T08:26:06.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72eaa00640 1 -- 172.21.15.88:0/3186797682 learned_addr learned my addr 172.21.15.88:0/3186797682 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:06.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240828476 0 0) 0x7f72ec0ba170 con 0x7f72ec0b9d90 2024-04-24T08:26:06.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72d0005740 con 0x7f72ec0b9d90 2024-04-24T08:26:06.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72eb400640 1 --2- 172.21.15.88:0/3186797682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec143bb0 0x7f72ec144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72ea000640 1 --2- 172.21.15.88:0/3186797682 >> v2:172.21.15.142:3300/0 conn(0x7f72ec0b44e0 0x7f72ec0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 68397305 0 0) 0x7f72d0005740 con 0x7f72ec0b9d90 2024-04-24T08:26:06.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec143bb0 msgr2=0x7f72ec144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:06.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 --2- 172.21.15.88:0/3186797682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec143bb0 0x7f72ec144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 >> v2:172.21.15.142:3300/0 conn(0x7f72ec0b44e0 msgr2=0x7f72ec0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:06.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 --2- 172.21.15.88:0/3186797682 >> v2:172.21.15.142:3300/0 conn(0x7f72ec0b44e0 0x7f72ec0b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ec0b3fc0 con 0x7f72ec0b9d90 2024-04-24T08:26:06.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f72dc001a00 con 0x7f72ec0b9d90 2024-04-24T08:26:06.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 >> v1:172.21.15.88:6789/0 conn(0x7f72ec0b9d90 legacy=0x7f72ec1450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 --2- 172.21.15.88:0/3186797682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72d0005bd0 0x7f72d0005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 --2- 172.21.15.88:0/3186797682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d0006a20 0x7f72d0006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 --2- 172.21.15.88:0/3186797682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec143bb0 0x7f72d00073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec145b80 con 0x7f72d0006a20 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec1458a0 con 0x7f72d0005bd0 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f72d000dd40 con 0x7f72ec143bb0 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72ea000640 1 --2- 172.21.15.88:0/3186797682 >> v2:172.21.15.142:3300/0 conn(0x7f72ec0b44e0 0x7f72ec0b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72ea000640 1 --2- 172.21.15.88:0/3186797682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d0006a20 0x7f72d0006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72eb400640 1 --2- 172.21.15.88:0/3186797682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec143bb0 0x7f72d00073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72eaa00640 1 --2- 172.21.15.88:0/3186797682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72d0005bd0 0x7f72d0005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72ea000640 1 -- 172.21.15.88:0/3186797682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec143bb0 msgr2=0x7f72d00073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72ea000640 1 --2- 172.21.15.88:0/3186797682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec143bb0 0x7f72d00073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72ea000640 1 -- 172.21.15.88:0/3186797682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72d0005bd0 msgr2=0x7f72d0005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:06.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72ea000640 1 --2- 172.21.15.88:0/3186797682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72d0005bd0 0x7f72d0005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.833+0000 7f72ea000640 1 -- 172.21.15.88:0/3186797682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d0005740 con 0x7f72d0006a20 2024-04-24T08:26:06.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.837+0000 7f72ea000640 1 --2- 172.21.15.88:0/3186797682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d0006a20 0x7f72d0006ea0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009880 tx=0x7f72d801c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a818894525df9a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:06.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.837+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d800f040 con 0x7f72d0006a20 2024-04-24T08:26:06.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.837+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d8004020 con 0x7f72d0006a20 2024-04-24T08:26:06.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.837+0000 7f72e9600640 1 -- 172.21.15.88:0/3186797682 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d80043f0 con 0x7f72d0006a20 2024-04-24T08:26:06.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.837+0000 7f72f1e00640 1 -- 172.21.15.88:0/3186797682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d0006a20 msgr2=0x7f72d0006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.837+0000 7f72f1e00640 1 --2- 172.21.15.88:0/3186797682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d0006a20 0x7f72d0006ea0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009880 tx=0x7f72d801c5d0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.837+0000 7f72eb400640 1 -- 172.21.15.88:0/3186797682 reap_dead start 2024-04-24T08:26:06.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.837+0000 7f72f1e00640 1 -- 172.21.15.88:0/3186797682 shutdown_connections 2024-04-24T08:26:06.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.837+0000 7f72f1e00640 1 -- 172.21.15.88:0/3186797682 >> 172.21.15.88:0/3186797682 conn(0x7f72ec06c0d0 msgr2=0x7f72ec0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:06.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.837+0000 7f72f1e00640 1 -- 172.21.15.88:0/3186797682 shutdown_connections 2024-04-24T08:26:06.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.837+0000 7f72f1e00640 1 -- 172.21.15.88:0/3186797682 wait complete. 2024-04-24T08:26:06.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72f1e00640 1 Processor -- start 2024-04-24T08:26:06.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72f1e00640 1 -- start start 2024-04-24T08:26:06.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72f1e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d0006a20 0x7f72ec14a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72f1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec14aae0 0x7f72ec070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72f1e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec071130 0x7f72ec13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72f1e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec06d210 con 0x7f72d0006a20 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72f1e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec144a20 con 0x7f72ec14aae0 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72f1e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f72ec06d390 con 0x7f72ec071130 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72eaa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d0006a20 0x7f72ec14a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72eaa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d0006a20 0x7f72ec14a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54226/0 (socket says 172.21.15.88:54226) 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72eaa00640 1 -- 172.21.15.88:0/2171490539 learned_addr learned my addr 172.21.15.88:0/2171490539 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72eb400640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec071130 0x7f72ec13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72ea000640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec14aae0 0x7f72ec070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72eaa00640 1 -- 172.21.15.88:0/2171490539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec071130 msgr2=0x7f72ec13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72eaa00640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec071130 0x7f72ec13ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72eaa00640 1 -- 172.21.15.88:0/2171490539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec14aae0 msgr2=0x7f72ec070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72eaa00640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec14aae0 0x7f72ec070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72eaa00640 1 -- 172.21.15.88:0/2171490539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ec0715c0 con 0x7f72d0006a20 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72ea000640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec14aae0 0x7f72ec070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:06.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72eaa00640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d0006a20 0x7f72ec14a5a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0077f0 tx=0x7f72dc00a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:06.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72e3400640 1 -- 172.21.15.88:0/2171490539 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc0133f0 con 0x7f72d0006a20 2024-04-24T08:26:06.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72e3400640 1 -- 172.21.15.88:0/2171490539 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72dc018070 con 0x7f72d0006a20 2024-04-24T08:26:06.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72e3400640 1 -- 172.21.15.88:0/2171490539 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc0137d0 con 0x7f72d0006a20 2024-04-24T08:26:06.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72f1e00640 1 -- 172.21.15.88:0/2171490539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ec14b8f0 con 0x7f72d0006a20 2024-04-24T08:26:06.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72f1e00640 1 -- 172.21.15.88:0/2171490539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ec14cc00 con 0x7f72d0006a20 2024-04-24T08:26:06.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.841+0000 7f72f1e00640 1 -- 172.21.15.88:0/2171490539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ec14bdd0 con 0x7f72d0006a20 2024-04-24T08:26:06.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.845+0000 7f72e3400640 1 -- 172.21.15.88:0/2171490539 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72dc013970 con 0x7f72d0006a20 2024-04-24T08:26:06.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.845+0000 7f72e3400640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72cc0683b0 0x7f72cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:06.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.845+0000 7f72e3400640 1 -- 172.21.15.88:0/2171490539 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7f72dc086ef0 con 0x7f72d0006a20 2024-04-24T08:26:06.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.845+0000 7f72ea000640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72cc0683b0 0x7f72cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:06.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.845+0000 7f72ea000640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72cc0683b0 0x7f72cc06a870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f72d80ae000 tx=0x7f72d80046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:06.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:06.849+0000 7f72e3400640 1 -- 172.21.15.88:0/2171490539 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f72ec14bdd0 con 0x7f72d0006a20 2024-04-24T08:26:07.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72f1e00640 1 -- 172.21.15.88:0/2171490539 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72ec068b90 con 0x7f72d0006a20 2024-04-24T08:26:07.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72e3400640 1 -- 172.21.15.88:0/2171490539 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+12891 (secure 0 0 0) 0x7f72dc057760 con 0x7f72d0006a20 2024-04-24T08:26:07.011 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:07.011 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":25,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:26:03.946148+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:26:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72f1e00640 1 -- 172.21.15.88:0/2171490539 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72cc0683b0 msgr2=0x7f72cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72f1e00640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72cc0683b0 0x7f72cc06a870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f72d80ae000 tx=0x7f72d80046d0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72f1e00640 1 -- 172.21.15.88:0/2171490539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d0006a20 msgr2=0x7f72ec14a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72f1e00640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d0006a20 0x7f72ec14a5a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0077f0 tx=0x7f72dc00a750 comp rx=0 tx=0).stop 2024-04-24T08:26:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72f1e00640 1 -- 172.21.15.88:0/2171490539 shutdown_connections 2024-04-24T08:26:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72f1e00640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72cc0683b0 0x7f72cc06a870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72f1e00640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec071130 0x7f72ec13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72f1e00640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec14aae0 0x7f72ec070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72f1e00640 1 --2- 172.21.15.88:0/2171490539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72d0006a20 0x7f72ec14a5a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72f1e00640 1 -- 172.21.15.88:0/2171490539 >> 172.21.15.88:0/2171490539 conn(0x7f72ec06c0d0 msgr2=0x7f72ec0736a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.009+0000 7f72f1e00640 1 -- 172.21.15.88:0/2171490539 shutdown_connections 2024-04-24T08:26:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.013+0000 7f72f1e00640 1 -- 172.21.15.88:0/2171490539 wait complete. 2024-04-24T08:26:07.032 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:26:07.033 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:26:07.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.169+0000 7effe4400640 1 Processor -- start 2024-04-24T08:26:07.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.169+0000 7effe4400640 1 -- start start 2024-04-24T08:26:07.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.169+0000 7effe4400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effdc067a70 0x7effdc14b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.169+0000 7effe4400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7effdc0b5d30 0x7effdc06c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.169+0000 7effe4400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effdc067e50 con 0x7effdc073020 2024-04-24T08:26:07.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.169+0000 7effe4400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7effdc0af500 con 0x7effdc0b5d30 2024-04-24T08:26:07.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.169+0000 7effe4400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7effdc0b4790 con 0x7effdc067a70 2024-04-24T08:26:07.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.173+0000 7effe2400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7effdc0b5d30 0x7effdc06c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.173+0000 7effe2400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7effdc0b5d30 0x7effdc06c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:34402/0 (socket says 172.21.15.88:34402) 2024-04-24T08:26:07.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.173+0000 7effe2400640 1 -- 172.21.15.88:0/2090967025 learned_addr learned my addr 172.21.15.88:0/2090967025 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:07.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.173+0000 7effe1000640 1 --1- 172.21.15.88:0/2090967025 >> v1:172.21.15.142:6789/0 conn(0x7effdc073020 0x7effdc06bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:40906/0 (socket says 172.21.15.88:40906) 2024-04-24T08:26:07.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.173+0000 7effe1a00640 1 --2- 172.21.15.88:0/2090967025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effdc067a70 0x7effdc14b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.173+0000 7effe2400640 1 -- 172.21.15.88:0/2090967025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effdc067a70 msgr2=0x7effdc14b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:07.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.173+0000 7effe2400640 1 --2- 172.21.15.88:0/2090967025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effdc067a70 0x7effdc14b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.173+0000 7effe2400640 1 -- 172.21.15.88:0/2090967025 >> v1:172.21.15.142:6789/0 conn(0x7effdc073020 legacy=0x7effdc06bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.173+0000 7effe2400640 1 -- 172.21.15.88:0/2090967025 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc0b4a70 con 0x7effdc0b5d30 2024-04-24T08:26:07.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.173+0000 7effe2400640 1 --2- 172.21.15.88:0/2090967025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effdc0b5d30 0x7effdc06c1e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7effd4009870 tx=0x7effd401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9533073c3d767193 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:07.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effdbe00640 1 -- 172.21.15.88:0/2090967025 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd40b0070 con 0x7effdc0b5d30 2024-04-24T08:26:07.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effdbe00640 1 -- 172.21.15.88:0/2090967025 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd40ab600 con 0x7effdc0b5d30 2024-04-24T08:26:07.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effdbe00640 1 -- 172.21.15.88:0/2090967025 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd40ab9d0 con 0x7effdc0b5d30 2024-04-24T08:26:07.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 -- 172.21.15.88:0/2090967025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effdc0b5d30 msgr2=0x7effdc06c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 --2- 172.21.15.88:0/2090967025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effdc0b5d30 0x7effdc06c1e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7effd4009870 tx=0x7effd401c440 comp rx=0 tx=0).stop 2024-04-24T08:26:07.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 -- 172.21.15.88:0/2090967025 shutdown_connections 2024-04-24T08:26:07.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 --2- 172.21.15.88:0/2090967025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effdc0b5d30 0x7effdc06c1e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 --2- 172.21.15.88:0/2090967025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effdc067a70 0x7effdc14b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 -- 172.21.15.88:0/2090967025 >> 172.21.15.88:0/2090967025 conn(0x7effdc0b9cf0 msgr2=0x7effdc0ba100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:07.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 -- 172.21.15.88:0/2090967025 shutdown_connections 2024-04-24T08:26:07.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 -- 172.21.15.88:0/2090967025 wait complete. 2024-04-24T08:26:07.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 Processor -- start 2024-04-24T08:26:07.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 -- start start 2024-04-24T08:26:07.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effdc067a70 0x7effdc1e4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effdc073020 0x7effdc143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effdc0b5d30 0x7effdc146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7effdc155390 con 0x7effdc0b5d30 2024-04-24T08:26:07.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7effdc0b5170 con 0x7effdc073020 2024-04-24T08:26:07.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe4400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7effdc155510 con 0x7effdc067a70 2024-04-24T08:26:07.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe2400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effdc0b5d30 0x7effdc146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe2400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effdc0b5d30 0x7effdc146e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54230/0 (socket says 172.21.15.88:54230) 2024-04-24T08:26:07.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe2400640 1 -- 172.21.15.88:0/2342224261 learned_addr learned my addr 172.21.15.88:0/2342224261 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:07.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe1a00640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effdc067a70 0x7effdc1e4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe1000640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effdc073020 0x7effdc143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe2400640 1 -- 172.21.15.88:0/2342224261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effdc067a70 msgr2=0x7effdc1e4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe2400640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effdc067a70 0x7effdc1e4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe2400640 1 -- 172.21.15.88:0/2342224261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effdc073020 msgr2=0x7effdc143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe2400640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effdc073020 0x7effdc143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe2400640 1 -- 172.21.15.88:0/2342224261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc0afe30 con 0x7effdc0b5d30 2024-04-24T08:26:07.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.177+0000 7effe1000640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effdc073020 0x7effdc143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:07.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.181+0000 7effe2400640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effdc0b5d30 0x7effdc146e70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7effd40ae040 tx=0x7effd40191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:07.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.181+0000 7effd9600640 1 -- 172.21.15.88:0/2342224261 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd40b0040 con 0x7effdc0b5d30 2024-04-24T08:26:07.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.181+0000 7effd9600640 1 -- 172.21.15.88:0/2342224261 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd40b9070 con 0x7effdc0b5d30 2024-04-24T08:26:07.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.181+0000 7effd9600640 1 -- 172.21.15.88:0/2342224261 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd40b4650 con 0x7effdc0b5d30 2024-04-24T08:26:07.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.181+0000 7effe4400640 1 -- 172.21.15.88:0/2342224261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc148920 con 0x7effdc0b5d30 2024-04-24T08:26:07.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.181+0000 7effe4400640 1 -- 172.21.15.88:0/2342224261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc152610 con 0x7effdc0b5d30 2024-04-24T08:26:07.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.181+0000 7effe4400640 1 -- 172.21.15.88:0/2342224261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effdc073720 con 0x7effdc0b5d30 2024-04-24T08:26:07.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.181+0000 7effd9600640 1 -- 172.21.15.88:0/2342224261 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7effd40b47f0 con 0x7effdc0b5d30 2024-04-24T08:26:07.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.181+0000 7effd9600640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7effbc068380 0x7effbc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.181+0000 7effd9600640 1 -- 172.21.15.88:0/2342224261 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7effd411fdc0 con 0x7effdc0b5d30 2024-04-24T08:26:07.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.181+0000 7effe1a00640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7effbc068380 0x7effbc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.185+0000 7effe1a00640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7effbc068380 0x7effbc06a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7effdc13e570 tx=0x7effd000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:07.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.185+0000 7effd9600640 1 -- 172.21.15.88:0/2342224261 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7effd4016150 con 0x7effdc0b5d30 2024-04-24T08:26:07.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.341+0000 7effe4400640 1 -- 172.21.15.88:0/2342224261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7effdc068c00 con 0x7effdc0b5d30 2024-04-24T08:26:07.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effd9600640 1 -- 172.21.15.88:0/2342224261 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7effd40f07e0 con 0x7effdc0b5d30 2024-04-24T08:26:07.345 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:26:07.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effe4400640 1 -- 172.21.15.88:0/2342224261 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7effbc068380 msgr2=0x7effbc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effe4400640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7effbc068380 0x7effbc06a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7effdc13e570 tx=0x7effd000b040 comp rx=0 tx=0).stop 2024-04-24T08:26:07.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effe4400640 1 -- 172.21.15.88:0/2342224261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effdc0b5d30 msgr2=0x7effdc146e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effe4400640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effdc0b5d30 0x7effdc146e70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7effd40ae040 tx=0x7effd40191e0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effe4400640 1 -- 172.21.15.88:0/2342224261 shutdown_connections 2024-04-24T08:26:07.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effe4400640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7effbc068380 0x7effbc06a840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effe4400640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effdc0b5d30 0x7effdc146e70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effe4400640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effdc073020 0x7effdc143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effe4400640 1 --2- 172.21.15.88:0/2342224261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effdc067a70 0x7effdc1e4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effe4400640 1 -- 172.21.15.88:0/2342224261 >> 172.21.15.88:0/2342224261 conn(0x7effdc0b9cf0 msgr2=0x7effdc0ba0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:07.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effe4400640 1 -- 172.21.15.88:0/2342224261 shutdown_connections 2024-04-24T08:26:07.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.345+0000 7effe4400640 1 -- 172.21.15.88:0/2342224261 wait complete. 2024-04-24T08:26:07.366 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-24T08:26:07.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67f600640 1 Processor -- start 2024-04-24T08:26:07.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67f600640 1 -- start start 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67f600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6780b7400 0x7fe6780ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67f600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe6780a94c0 0x7fe678145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67f600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6781466b0 0x7fe678149430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67f600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fe6780b64e0 con 0x7fe6781466b0 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67f600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe6780b77e0 con 0x7fe6780a94c0 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67f600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe6780b69e0 con 0x7fe6780b7400 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67d600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6781466b0 0x7fe678149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67d600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6781466b0 0x7fe678149430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54240/0 (socket says 172.21.15.88:54240) 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67d600640 1 -- 172.21.15.88:0/1497646119 learned_addr learned my addr 172.21.15.88:0/1497646119 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe677e00640 1 --2- 172.21.15.88:0/1497646119 >> v2:172.21.15.142:3300/0 conn(0x7fe6780a94c0 0x7fe678145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67cc00640 1 --2- 172.21.15.88:0/1497646119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6780b7400 0x7fe6780ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67d600640 1 -- 172.21.15.88:0/1497646119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6780b7400 msgr2=0x7fe6780ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:07.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67d600640 1 --2- 172.21.15.88:0/1497646119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6780b7400 0x7fe6780ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67d600640 1 -- 172.21.15.88:0/1497646119 >> v2:172.21.15.142:3300/0 conn(0x7fe6780a94c0 msgr2=0x7fe678145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:07.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67d600640 1 --2- 172.21.15.88:0/1497646119 >> v2:172.21.15.142:3300/0 conn(0x7fe6780a94c0 0x7fe678145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67d600640 1 -- 172.21.15.88:0/1497646119 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6780b6700 con 0x7fe6781466b0 2024-04-24T08:26:07.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe677e00640 1 --2- 172.21.15.88:0/1497646119 >> v2:172.21.15.142:3300/0 conn(0x7fe6780a94c0 0x7fe678145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:07.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.501+0000 7fe67cc00640 1 --2- 172.21.15.88:0/1497646119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6780b7400 0x7fe6780ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:07.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe67d600640 1 --2- 172.21.15.88:0/1497646119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6781466b0 0x7fe678149430 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe6780688d0 tx=0x7fe67001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd4dad78188a69 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:07.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe677400640 1 -- 172.21.15.88:0/1497646119 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6700a56f0 con 0x7fe6781466b0 2024-04-24T08:26:07.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe677400640 1 -- 172.21.15.88:0/1497646119 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6700a5890 con 0x7fe6781466b0 2024-04-24T08:26:07.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe677400640 1 -- 172.21.15.88:0/1497646119 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6700a5c60 con 0x7fe6781466b0 2024-04-24T08:26:07.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe67f600640 1 -- 172.21.15.88:0/1497646119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6781466b0 msgr2=0x7fe678149430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe67f600640 1 --2- 172.21.15.88:0/1497646119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6781466b0 0x7fe678149430 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe6780688d0 tx=0x7fe67001c960 comp rx=0 tx=0).stop 2024-04-24T08:26:07.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe67f600640 1 -- 172.21.15.88:0/1497646119 shutdown_connections 2024-04-24T08:26:07.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe67f600640 1 --2- 172.21.15.88:0/1497646119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6781466b0 0x7fe678149430 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe67f600640 1 --2- 172.21.15.88:0/1497646119 >> v2:172.21.15.142:3300/0 conn(0x7fe6780a94c0 0x7fe678145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe67f600640 1 --2- 172.21.15.88:0/1497646119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6780b7400 0x7fe6780ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe67f600640 1 -- 172.21.15.88:0/1497646119 >> 172.21.15.88:0/1497646119 conn(0x7fe678067810 msgr2=0x7fe678067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:07.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe67f600640 1 -- 172.21.15.88:0/1497646119 shutdown_connections 2024-04-24T08:26:07.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe67f600640 1 -- 172.21.15.88:0/1497646119 wait complete. 2024-04-24T08:26:07.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.505+0000 7fe67f600640 1 Processor -- start 2024-04-24T08:26:07.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67f600640 1 -- start start 2024-04-24T08:26:07.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67f600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6780b7400 0x7fe67813d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67f600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6781466b0 0x7fe6781379d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67f600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6781ded70 0x7fe6781df220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67f600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe678152790 con 0x7fe6781466b0 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67f600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780b7ee0 con 0x7fe6780b7400 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67f600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe678152910 con 0x7fe6781ded70 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe677e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6781466b0 0x7fe6781379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe677e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6781466b0 0x7fe6781379d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54248/0 (socket says 172.21.15.88:54248) 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe677e00640 1 -- 172.21.15.88:0/2130086506 learned_addr learned my addr 172.21.15.88:0/2130086506 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67cc00640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6780b7400 0x7fe67813d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67d600640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6781ded70 0x7fe6781df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe677e00640 1 -- 172.21.15.88:0/2130086506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6781ded70 msgr2=0x7fe6781df220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe677e00640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6781ded70 0x7fe6781df220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe677e00640 1 -- 172.21.15.88:0/2130086506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6780b7400 msgr2=0x7fe67813d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe677e00640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6780b7400 0x7fe67813d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe677e00640 1 -- 172.21.15.88:0/2130086506 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe678136ff0 con 0x7fe6781466b0 2024-04-24T08:26:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67d600640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6781ded70 0x7fe6781df220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe677e00640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6781466b0 0x7fe6781379d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe66400c7f0 tx=0x7fe66400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe674c00640 1 -- 172.21.15.88:0/2130086506 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664015070 con 0x7fe6781466b0 2024-04-24T08:26:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe674c00640 1 -- 172.21.15.88:0/2130086506 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6640077c0 con 0x7fe6781466b0 2024-04-24T08:26:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67f600640 1 -- 172.21.15.88:0/2130086506 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6781df760 con 0x7fe6781466b0 2024-04-24T08:26:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe674c00640 1 -- 172.21.15.88:0/2130086506 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664007bb0 con 0x7fe6781466b0 2024-04-24T08:26:07.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67f600640 1 -- 172.21.15.88:0/2130086506 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe678136310 con 0x7fe6781466b0 2024-04-24T08:26:07.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.509+0000 7fe67f600640 1 -- 172.21.15.88:0/2130086506 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe678068b90 con 0x7fe6781466b0 2024-04-24T08:26:07.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.513+0000 7fe674c00640 1 -- 172.21.15.88:0/2130086506 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe664018070 con 0x7fe6781466b0 2024-04-24T08:26:07.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.513+0000 7fe674c00640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe658068380 0x7fe65806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.513+0000 7fe674c00640 1 -- 172.21.15.88:0/2130086506 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7fe6640866c0 con 0x7fe6781466b0 2024-04-24T08:26:07.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.513+0000 7fe67cc00640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe658068380 0x7fe65806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.513+0000 7fe67cc00640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe658068380 0x7fe65806a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe6780b56c0 tx=0x7fe668008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:07.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.517+0000 7fe674c00640 1 -- 172.21.15.88:0/2130086506 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe6640568e0 con 0x7fe6781466b0 2024-04-24T08:26:07.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.673+0000 7fe67f600640 1 -- 172.21.15.88:0/2130086506 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe678150560 con 0x7fe6781466b0 2024-04-24T08:26:07.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.673+0000 7fe674c00640 1 -- 172.21.15.88:0/2130086506 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v25) ==== 84+0+65 (secure 0 0 0) 0x7fe66405abe0 con 0x7fe6781466b0 2024-04-24T08:26:07.676 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:07.677 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2024-04-24T08:26:07.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-24T08:26:07.677 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2024-04-24T08:26:07.677 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2024-04-24T08:26:07.677 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:07.677 INFO:teuthology.orchestra.run.smithi088.stdout:] 2024-04-24T08:26:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.677+0000 7fe67f600640 1 -- 172.21.15.88:0/2130086506 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe658068380 msgr2=0x7fe65806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.677+0000 7fe67f600640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe658068380 0x7fe65806a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe6780b56c0 tx=0x7fe668008040 comp rx=0 tx=0).stop 2024-04-24T08:26:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.677+0000 7fe67f600640 1 -- 172.21.15.88:0/2130086506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6781466b0 msgr2=0x7fe6781379d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.677+0000 7fe67f600640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6781466b0 0x7fe6781379d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe66400c7f0 tx=0x7fe66400ccb0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.677+0000 7fe67f600640 1 -- 172.21.15.88:0/2130086506 shutdown_connections 2024-04-24T08:26:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.677+0000 7fe67f600640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe658068380 0x7fe65806a840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.677+0000 7fe67f600640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6781ded70 0x7fe6781df220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.677+0000 7fe67f600640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6781466b0 0x7fe6781379d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.677+0000 7fe67f600640 1 --2- 172.21.15.88:0/2130086506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6780b7400 0x7fe67813d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.677+0000 7fe67f600640 1 -- 172.21.15.88:0/2130086506 >> 172.21.15.88:0/2130086506 conn(0x7fe678067810 msgr2=0x7fe678145c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.677+0000 7fe67f600640 1 -- 172.21.15.88:0/2130086506 shutdown_connections 2024-04-24T08:26:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.677+0000 7fe67f600640 1 -- 172.21.15.88:0/2130086506 wait complete. 2024-04-24T08:26:07.697 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-24T08:26:07.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-24T08:26:07.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.833+0000 7f0e67800640 1 Processor -- start 2024-04-24T08:26:07.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.833+0000 7f0e67800640 1 -- start start 2024-04-24T08:26:07.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.833+0000 7f0e67800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e600b9d90 0x7f0e6006d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.833+0000 7f0e67800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e601461e0 0x7f0e60150470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.833+0000 7f0e67800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e600ba170 con 0x7f0e600b3e20 2024-04-24T08:26:07.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.833+0000 7f0e67800640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f0e6009cca0 con 0x7f0e601461e0 2024-04-24T08:26:07.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.833+0000 7f0e67800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0e60149930 con 0x7f0e600b9d90 2024-04-24T08:26:07.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.837+0000 7f0e65800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e601461e0 0x7f0e60150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.837+0000 7f0e65800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e601461e0 0x7f0e60150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59648/0 (socket says 172.21.15.88:59648) 2024-04-24T08:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.837+0000 7f0e65800640 1 -- 172.21.15.88:0/1697675363 learned_addr learned my addr 172.21.15.88:0/1697675363 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.837+0000 7f0e64e00640 1 --2- 172.21.15.88:0/1697675363 >> v2:172.21.15.142:3300/0 conn(0x7f0e600b9d90 0x7f0e6006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.837+0000 7f0e65800640 1 -- 172.21.15.88:0/1697675363 >> v2:172.21.15.142:3300/0 conn(0x7f0e600b9d90 msgr2=0x7f0e6006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.837+0000 7f0e65800640 1 --2- 172.21.15.88:0/1697675363 >> v2:172.21.15.142:3300/0 conn(0x7f0e600b9d90 0x7f0e6006d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.837+0000 7f0e65800640 1 -- 172.21.15.88:0/1697675363 >> v1:172.21.15.142:6789/0 conn(0x7f0e600b3e20 legacy=0x7f0e6006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.837+0000 7f0e65800640 1 -- 172.21.15.88:0/1697675363 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e60149c10 con 0x7f0e601461e0 2024-04-24T08:26:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.837+0000 7f0e65800640 1 --2- 172.21.15.88:0/1697675363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e601461e0 0x7f0e60150470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0e6009c610 tx=0x7f0e5801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9247394c3aeb1734 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.837+0000 7f0e5f400640 1 -- 172.21.15.88:0/1697675363 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e580b0070 con 0x7f0e601461e0 2024-04-24T08:26:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.837+0000 7f0e5f400640 1 -- 172.21.15.88:0/1697675363 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e580ab600 con 0x7f0e601461e0 2024-04-24T08:26:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.837+0000 7f0e5f400640 1 -- 172.21.15.88:0/1697675363 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e580ab9d0 con 0x7f0e601461e0 2024-04-24T08:26:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 -- 172.21.15.88:0/1697675363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e601461e0 msgr2=0x7f0e60150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 --2- 172.21.15.88:0/1697675363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e601461e0 0x7f0e60150470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0e6009c610 tx=0x7f0e5801c490 comp rx=0 tx=0).stop 2024-04-24T08:26:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 -- 172.21.15.88:0/1697675363 shutdown_connections 2024-04-24T08:26:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 --2- 172.21.15.88:0/1697675363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e601461e0 0x7f0e60150470 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 --2- 172.21.15.88:0/1697675363 >> v2:172.21.15.142:3300/0 conn(0x7f0e600b9d90 0x7f0e6006d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 -- 172.21.15.88:0/1697675363 >> 172.21.15.88:0/1697675363 conn(0x7f0e6006c0d0 msgr2=0x7f0e600b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 -- 172.21.15.88:0/1697675363 shutdown_connections 2024-04-24T08:26:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 -- 172.21.15.88:0/1697675363 wait complete. 2024-04-24T08:26:07.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 Processor -- start 2024-04-24T08:26:07.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 -- start start 2024-04-24T08:26:07.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e600b3e20 0x7f0e600b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e600b9d90 0x7f0e60072c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e601461e0 0x7f0e601434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6009c020 con 0x7f0e600b9d90 2024-04-24T08:26:07.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6006e070 con 0x7f0e601461e0 2024-04-24T08:26:07.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e67800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0e601531d0 con 0x7f0e600b3e20 2024-04-24T08:26:07.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e5fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e600b9d90 0x7f0e60072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e5fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e600b9d90 0x7f0e60072c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59660/0 (socket says 172.21.15.88:59660) 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e5fe00640 1 -- 172.21.15.88:0/2284300864 learned_addr learned my addr 172.21.15.88:0/2284300864 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e64e00640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e600b3e20 0x7f0e600b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e65800640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e601461e0 0x7f0e601434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e5fe00640 1 -- 172.21.15.88:0/2284300864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e600b3e20 msgr2=0x7f0e600b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e5fe00640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e600b3e20 0x7f0e600b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e5fe00640 1 -- 172.21.15.88:0/2284300864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e601461e0 msgr2=0x7f0e601434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e5fe00640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e601461e0 0x7f0e601434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e5fe00640 1 -- 172.21.15.88:0/2284300864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e601442e0 con 0x7f0e600b9d90 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e5fe00640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e600b9d90 0x7f0e60072c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c420 tx=0x7f0e4c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.841+0000 7f0e5cc00640 1 -- 172.21.15.88:0/2284300864 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c0052d0 con 0x7f0e600b9d90 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.845+0000 7f0e5cc00640 1 -- 172.21.15.88:0/2284300864 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e4c005470 con 0x7f0e600b9d90 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.845+0000 7f0e5cc00640 1 -- 172.21.15.88:0/2284300864 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c007260 con 0x7f0e600b9d90 2024-04-24T08:26:07.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.845+0000 7f0e67800640 1 -- 172.21.15.88:0/2284300864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e60072510 con 0x7f0e600b9d90 2024-04-24T08:26:07.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.845+0000 7f0e67800640 1 -- 172.21.15.88:0/2284300864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e60144000 con 0x7f0e600b9d90 2024-04-24T08:26:07.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.845+0000 7f0e67800640 1 -- 172.21.15.88:0/2284300864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e60068ca0 con 0x7f0e600b9d90 2024-04-24T08:26:07.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.845+0000 7f0e5cc00640 1 -- 172.21.15.88:0/2284300864 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0e4c007400 con 0x7f0e600b9d90 2024-04-24T08:26:07.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.845+0000 7f0e5cc00640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0e40068380 0x7f0e4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:07.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.845+0000 7f0e5cc00640 1 -- 172.21.15.88:0/2284300864 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7f0e4c085b40 con 0x7f0e600b9d90 2024-04-24T08:26:07.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.845+0000 7f0e64e00640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0e40068380 0x7f0e4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:07.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.845+0000 7f0e64e00640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0e40068380 0x7f0e4006a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0e50007330 tx=0x7f0e5000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:07.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:07.849+0000 7f0e5cc00640 1 -- 172.21.15.88:0/2284300864 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e4c056440 con 0x7f0e600b9d90 2024-04-24T08:26:08.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.009+0000 7f0e67800640 1 -- 172.21.15.88:0/2284300864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0e600ae650 con 0x7f0e600b9d90 2024-04-24T08:26:08.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.973+0000 7f0e5cc00640 1 -- 172.21.15.88:0/2284300864 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v26) ==== 138+0+0 (secure 0 0 0) 0x7f0e4c055d40 con 0x7f0e600b9d90 2024-04-24T08:26:08.976 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2024-04-24T08:26:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.977+0000 7f0e67800640 1 -- 172.21.15.88:0/2284300864 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0e40068380 msgr2=0x7f0e4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.977+0000 7f0e67800640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0e40068380 0x7f0e4006a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0e50007330 tx=0x7f0e5000b040 comp rx=0 tx=0).stop 2024-04-24T08:26:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.977+0000 7f0e67800640 1 -- 172.21.15.88:0/2284300864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e600b9d90 msgr2=0x7f0e60072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.977+0000 7f0e67800640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e600b9d90 0x7f0e60072c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c420 tx=0x7f0e4c00c8e0 comp rx=0 tx=0).stop 2024-04-24T08:26:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.977+0000 7f0e67800640 1 -- 172.21.15.88:0/2284300864 shutdown_connections 2024-04-24T08:26:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.977+0000 7f0e67800640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0e40068380 0x7f0e4006a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.977+0000 7f0e67800640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e601461e0 0x7f0e601434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.977+0000 7f0e67800640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e600b9d90 0x7f0e60072c80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.977+0000 7f0e67800640 1 --2- 172.21.15.88:0/2284300864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e600b3e20 0x7f0e600b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.977+0000 7f0e67800640 1 -- 172.21.15.88:0/2284300864 >> 172.21.15.88:0/2284300864 conn(0x7f0e6006c0d0 msgr2=0x7f0e6006d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.977+0000 7f0e67800640 1 -- 172.21.15.88:0/2284300864 shutdown_connections 2024-04-24T08:26:08.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:08.977+0000 7f0e67800640 1 -- 172.21.15.88:0/2284300864 wait complete. 2024-04-24T08:26:09.006 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-24T08:26:09.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7faca4a00640 1 Processor -- start 2024-04-24T08:26:09.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7faca4a00640 1 -- start start 2024-04-24T08:26:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7faca4a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faca00b2d00 0x7faca00b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7faca4a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faca006d210 0x7faca0145a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7faca4a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faca00b30e0 con 0x7faca0073cd0 2024-04-24T08:26:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7faca4a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7faca006db70 con 0x7faca006d210 2024-04-24T08:26:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7faca4a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faca006e580 con 0x7faca00b2d00 2024-04-24T08:26:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac95400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faca006d210 0x7faca0145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac9de00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faca00b2d00 0x7faca00b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac95400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faca006d210 0x7faca0145a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:42100/0 (socket says 172.21.15.88:42100) 2024-04-24T08:26:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac9e800640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7faca0073cd0 0x7faca0149000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:35338/0 (socket says 172.21.15.88:35338) 2024-04-24T08:26:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac95400640 1 -- 172.21.15.88:0/961545282 learned_addr learned my addr 172.21.15.88:0/961545282 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac9de00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faca00b2d00 0x7faca00b65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:50908/0 (socket says 172.21.15.88:50908) 2024-04-24T08:26:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac9d400640 1 -- 172.21.15.88:0/961545282 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1047754843 0 0) 0x7faca00b30e0 con 0x7faca0073cd0 2024-04-24T08:26:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac9d400640 1 -- 172.21.15.88:0/961545282 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac84003530 con 0x7faca0073cd0 2024-04-24T08:26:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac9de00640 1 -- 172.21.15.88:0/961545282 >> v2:172.21.15.142:3300/0 conn(0x7faca006d210 msgr2=0x7faca0145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac9de00640 1 --2- 172.21.15.88:0/961545282 >> v2:172.21.15.142:3300/0 conn(0x7faca006d210 0x7faca0145a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac9de00640 1 -- 172.21.15.88:0/961545282 >> v1:172.21.15.142:6789/0 conn(0x7faca0073cd0 legacy=0x7faca0149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac9de00640 1 -- 172.21.15.88:0/961545282 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca00b6b30 con 0x7faca00b2d00 2024-04-24T08:26:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.153+0000 7fac95400640 1 --2- 172.21.15.88:0/961545282 >> v2:172.21.15.142:3300/0 conn(0x7faca006d210 0x7faca0145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:26:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7fac9de00640 1 --2- 172.21.15.88:0/961545282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faca00b2d00 0x7faca00b65f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac90009d90 tx=0x7fac9001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1d6a17cbcb068be server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:09.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7fac9d400640 1 -- 172.21.15.88:0/961545282 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac900b2070 con 0x7faca00b2d00 2024-04-24T08:26:09.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7fac9d400640 1 -- 172.21.15.88:0/961545282 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac900a5820 con 0x7faca00b2d00 2024-04-24T08:26:09.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7fac9d400640 1 -- 172.21.15.88:0/961545282 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac900a5bf0 con 0x7faca00b2d00 2024-04-24T08:26:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7faca4a00640 1 -- 172.21.15.88:0/961545282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faca00b2d00 msgr2=0x7faca00b65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7faca4a00640 1 --2- 172.21.15.88:0/961545282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faca00b2d00 0x7faca00b65f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac90009d90 tx=0x7fac9001c850 comp rx=0 tx=0).stop 2024-04-24T08:26:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7faca4a00640 1 -- 172.21.15.88:0/961545282 shutdown_connections 2024-04-24T08:26:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7faca4a00640 1 --2- 172.21.15.88:0/961545282 >> v2:172.21.15.142:3300/0 conn(0x7faca006d210 0x7faca0145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7faca4a00640 1 --2- 172.21.15.88:0/961545282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faca00b2d00 0x7faca00b65f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7faca4a00640 1 -- 172.21.15.88:0/961545282 >> 172.21.15.88:0/961545282 conn(0x7faca00b9390 msgr2=0x7faca00b97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7faca4a00640 1 -- 172.21.15.88:0/961545282 shutdown_connections 2024-04-24T08:26:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7faca4a00640 1 -- 172.21.15.88:0/961545282 wait complete. 2024-04-24T08:26:09.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7faca4a00640 1 Processor -- start 2024-04-24T08:26:09.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.157+0000 7faca4a00640 1 -- start start 2024-04-24T08:26:09.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7faca4a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faca006d210 0x7faca00b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:09.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7faca4a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faca0073cd0 0x7faca0146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:09.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7faca4a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faca00b2d00 0x7faca01472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:09.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7faca4a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faca0153740 con 0x7faca00b2d00 2024-04-24T08:26:09.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7faca4a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faca01535c0 con 0x7faca0073cd0 2024-04-24T08:26:09.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7faca4a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faca01538c0 con 0x7faca006d210 2024-04-24T08:26:09.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac9e800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faca00b2d00 0x7faca01472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:09.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac9e800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faca00b2d00 0x7faca01472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59672/0 (socket says 172.21.15.88:59672) 2024-04-24T08:26:09.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac9e800640 1 -- 172.21.15.88:0/69255440 learned_addr learned my addr 172.21.15.88:0/69255440 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:09.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac9de00640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faca006d210 0x7faca00b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:09.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac95400640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faca0073cd0 0x7faca0146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:09.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac9e800640 1 -- 172.21.15.88:0/69255440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faca006d210 msgr2=0x7faca00b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:09.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac9e800640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faca006d210 0x7faca00b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:09.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac9e800640 1 -- 172.21.15.88:0/69255440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faca0073cd0 msgr2=0x7faca0146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:09.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac9e800640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faca0073cd0 0x7faca0146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:09.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac9e800640 1 -- 172.21.15.88:0/69255440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca01e0d70 con 0x7faca00b2d00 2024-04-24T08:26:09.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac9e800640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faca00b2d00 0x7faca01472c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fac9800c480 tx=0x7fac9800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:09.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac96a00640 1 -- 172.21.15.88:0/69255440 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98018070 con 0x7faca00b2d00 2024-04-24T08:26:09.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac96a00640 1 -- 172.21.15.88:0/69255440 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac98007480 con 0x7faca00b2d00 2024-04-24T08:26:09.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7fac96a00640 1 -- 172.21.15.88:0/69255440 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac980047f0 con 0x7faca00b2d00 2024-04-24T08:26:09.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7faca4a00640 1 -- 172.21.15.88:0/69255440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca01403e0 con 0x7faca00b2d00 2024-04-24T08:26:09.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7faca4a00640 1 -- 172.21.15.88:0/69255440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca01e1010 con 0x7faca00b2d00 2024-04-24T08:26:09.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.161+0000 7faca4a00640 1 -- 172.21.15.88:0/69255440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca0068b90 con 0x7faca00b2d00 2024-04-24T08:26:09.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.165+0000 7fac96a00640 1 -- 172.21.15.88:0/69255440 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac98004990 con 0x7faca00b2d00 2024-04-24T08:26:09.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.165+0000 7fac96a00640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fac7c068380 0x7fac7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:09.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.165+0000 7fac96a00640 1 -- 172.21.15.88:0/69255440 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5227+0+0 (secure 0 0 0) 0x7fac980859e0 con 0x7faca00b2d00 2024-04-24T08:26:09.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.165+0000 7fac9de00640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fac7c068380 0x7fac7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:09.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.165+0000 7fac9de00640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fac7c068380 0x7fac7c06a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fac900af000 tx=0x7fac900a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:09.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.169+0000 7fac96a00640 1 -- 172.21.15.88:0/69255440 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fac98055b20 con 0x7faca00b2d00 2024-04-24T08:26:09.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.325+0000 7faca4a00640 1 -- 172.21.15.88:0/69255440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7faca00b4d20 con 0x7faca00b2d00 2024-04-24T08:26:09.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.981+0000 7fac96a00640 1 -- 172.21.15.88:0/69255440 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v27) ==== 170+0+0 (secure 0 0 0) 0x7fac98059e20 con 0x7faca00b2d00 2024-04-24T08:26:09.984 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2024-04-24T08:26:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.985+0000 7faca4a00640 1 -- 172.21.15.88:0/69255440 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fac7c068380 msgr2=0x7fac7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.985+0000 7faca4a00640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fac7c068380 0x7fac7c06a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fac900af000 tx=0x7fac900a7070 comp rx=0 tx=0).stop 2024-04-24T08:26:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.985+0000 7faca4a00640 1 -- 172.21.15.88:0/69255440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faca00b2d00 msgr2=0x7faca01472c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.985+0000 7faca4a00640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faca00b2d00 0x7faca01472c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fac9800c480 tx=0x7fac9800c940 comp rx=0 tx=0).stop 2024-04-24T08:26:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.985+0000 7faca4a00640 1 -- 172.21.15.88:0/69255440 shutdown_connections 2024-04-24T08:26:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.985+0000 7faca4a00640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fac7c068380 0x7fac7c06a840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.985+0000 7faca4a00640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faca00b2d00 0x7faca01472c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.985+0000 7faca4a00640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faca0073cd0 0x7faca0146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.985+0000 7faca4a00640 1 --2- 172.21.15.88:0/69255440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faca006d210 0x7faca00b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.985+0000 7faca4a00640 1 -- 172.21.15.88:0/69255440 >> 172.21.15.88:0/69255440 conn(0x7faca00b9390 msgr2=0x7faca00aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.985+0000 7faca4a00640 1 -- 172.21.15.88:0/69255440 shutdown_connections 2024-04-24T08:26:09.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:09.985+0000 7faca4a00640 1 -- 172.21.15.88:0/69255440 wait complete. 2024-04-24T08:26:10.022 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-24T08:26:10.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c3000640 1 Processor -- start 2024-04-24T08:26:10.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c3000640 1 -- start start 2024-04-24T08:26:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c3000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb2bc0ae4e0 0x7fb2bc13e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c3000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2bc0737c0 0x7fb2bc13eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c3000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc0b0580 con 0x7fb2bc0b01a0 2024-04-24T08:26:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c3000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb2bc0b59d0 con 0x7fb2bc0737c0 2024-04-24T08:26:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c3000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb2bc0ae970 con 0x7fb2bc0ae4e0 2024-04-24T08:26:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c1000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2bc0737c0 0x7fb2bc13eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c1000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2bc0737c0 0x7fb2bc13eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59682/0 (socket says 172.21.15.88:59682) 2024-04-24T08:26:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c1000640 1 -- 172.21.15.88:0/3874873107 learned_addr learned my addr 172.21.15.88:0/3874873107 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2bb400640 1 --2- 172.21.15.88:0/3874873107 >> v2:172.21.15.142:3300/0 conn(0x7fb2bc0ae4e0 0x7fb2bc13e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c1000640 1 -- 172.21.15.88:0/3874873107 >> v2:172.21.15.142:3300/0 conn(0x7fb2bc0ae4e0 msgr2=0x7fb2bc13e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c1000640 1 --2- 172.21.15.88:0/3874873107 >> v2:172.21.15.142:3300/0 conn(0x7fb2bc0ae4e0 0x7fb2bc13e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c1000640 1 -- 172.21.15.88:0/3874873107 >> v1:172.21.15.142:6789/0 conn(0x7fb2bc0b01a0 legacy=0x7fb2bc06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2c1000640 1 -- 172.21.15.88:0/3874873107 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc0b53a0 con 0x7fb2bc0737c0 2024-04-24T08:26:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.161+0000 7fb2bb400640 1 --2- 172.21.15.88:0/3874873107 >> v2:172.21.15.142:3300/0 conn(0x7fb2bc0ae4e0 0x7fb2bc13e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:10.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2c1000640 1 --2- 172.21.15.88:0/3874873107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc0737c0 0x7fb2bc13eec0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc06ec10 tx=0x7fb2b401ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557d5578d8f8fe44 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2baa00640 1 -- 172.21.15.88:0/3874873107 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40b4070 con 0x7fb2bc0737c0 2024-04-24T08:26:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2baa00640 1 -- 172.21.15.88:0/3874873107 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b40a7970 con 0x7fb2bc0737c0 2024-04-24T08:26:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2baa00640 1 -- 172.21.15.88:0/3874873107 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc06e470 con 0x7fb2bc0737c0 2024-04-24T08:26:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2c3000640 1 -- 172.21.15.88:0/3874873107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc0737c0 msgr2=0x7fb2bc13eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2c3000640 1 --2- 172.21.15.88:0/3874873107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc0737c0 0x7fb2bc13eec0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc06ec10 tx=0x7fb2b401ea90 comp rx=0 tx=0).stop 2024-04-24T08:26:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2c3000640 1 -- 172.21.15.88:0/3874873107 shutdown_connections 2024-04-24T08:26:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2c3000640 1 --2- 172.21.15.88:0/3874873107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc0737c0 0x7fb2bc13eec0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2c3000640 1 --2- 172.21.15.88:0/3874873107 >> v2:172.21.15.142:3300/0 conn(0x7fb2bc0ae4e0 0x7fb2bc13e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2c3000640 1 -- 172.21.15.88:0/3874873107 >> 172.21.15.88:0/3874873107 conn(0x7fb2bc0b9690 msgr2=0x7fb2bc0b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2c3000640 1 -- 172.21.15.88:0/3874873107 shutdown_connections 2024-04-24T08:26:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2c3000640 1 -- 172.21.15.88:0/3874873107 wait complete. 2024-04-24T08:26:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2c3000640 1 Processor -- start 2024-04-24T08:26:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2c3000640 1 -- start start 2024-04-24T08:26:10.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.165+0000 7fb2c3000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2bc0737c0 0x7fb2bc0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:10.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c3000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2bc0b01a0 0x7fb2bc1e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c3000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc1e1200 0x7fb2bc13b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c3000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc09b5f0 con 0x7fb2bc1e1200 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c3000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc09b470 con 0x7fb2bc0737c0 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c3000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb2bc09b770 con 0x7fb2bc0b01a0 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c1000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc1e1200 0x7fb2bc13b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c1000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc1e1200 0x7fb2bc13b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59686/0 (socket says 172.21.15.88:59686) 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c1000640 1 -- 172.21.15.88:0/2020346336 learned_addr learned my addr 172.21.15.88:0/2020346336 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2bbe00640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2bc0737c0 0x7fb2bc0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2bb400640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2bc0b01a0 0x7fb2bc1e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c1000640 1 -- 172.21.15.88:0/2020346336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2bc0b01a0 msgr2=0x7fb2bc1e0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c1000640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2bc0b01a0 0x7fb2bc1e0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c1000640 1 -- 172.21.15.88:0/2020346336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2bc0737c0 msgr2=0x7fb2bc0b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c1000640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2bc0737c0 0x7fb2bc0b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:10.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c1000640 1 -- 172.21.15.88:0/2020346336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc1e07c0 con 0x7fb2bc1e1200 2024-04-24T08:26:10.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c1000640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc1e1200 0x7fb2bc13b590 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb2b401c6c0 tx=0x7fb2b401d2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:10.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2b3e00640 1 -- 172.21.15.88:0/2020346336 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40bf070 con 0x7fb2bc1e1200 2024-04-24T08:26:10.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2b3e00640 1 -- 172.21.15.88:0/2020346336 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b40afaa0 con 0x7fb2bc1e1200 2024-04-24T08:26:10.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c3000640 1 -- 172.21.15.88:0/2020346336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2bc0b23b0 con 0x7fb2bc1e1200 2024-04-24T08:26:10.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2b3e00640 1 -- 172.21.15.88:0/2020346336 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40b4070 con 0x7fb2bc1e1200 2024-04-24T08:26:10.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c3000640 1 -- 172.21.15.88:0/2020346336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2bc0b2040 con 0x7fb2bc1e1200 2024-04-24T08:26:10.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2c3000640 1 -- 172.21.15.88:0/2020346336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2bc1e0990 con 0x7fb2bc1e1200 2024-04-24T08:26:10.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.169+0000 7fb2b3e00640 1 -- 172.21.15.88:0/2020346336 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb2b40c2070 con 0x7fb2bc1e1200 2024-04-24T08:26:10.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.173+0000 7fb2b3e00640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb29c0683b0 0x7fb29c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:10.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.173+0000 7fb2b3e00640 1 -- 172.21.15.88:0/2020346336 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5609+0+0 (secure 0 0 0) 0x7fb2b4121080 con 0x7fb2bc1e1200 2024-04-24T08:26:10.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.173+0000 7fb2bbe00640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb29c0683b0 0x7fb29c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:10.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.173+0000 7fb2bbe00640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb29c0683b0 0x7fb29c06a870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009f20 tx=0x7fb2ac0094d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:10.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.177+0000 7fb2b3e00640 1 -- 172.21.15.88:0/2020346336 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb2b40187a0 con 0x7fb2bc1e1200 2024-04-24T08:26:10.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.365+0000 7fb2c3000640 1 -- 172.21.15.88:0/2020346336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb2bc068c00 con 0x7fb2bc1e1200 2024-04-24T08:26:10.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.985+0000 7fb2b3e00640 1 -- 172.21.15.88:0/2020346336 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fb2b40f1680 con 0x7fb2bc1e1200 2024-04-24T08:26:10.986 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 4 and data pool 5 2024-04-24T08:26:10.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.985+0000 7fb2c3000640 1 -- 172.21.15.88:0/2020346336 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb29c0683b0 msgr2=0x7fb29c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:10.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.985+0000 7fb2c3000640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb29c0683b0 0x7fb29c06a870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009f20 tx=0x7fb2ac0094d0 comp rx=0 tx=0).stop 2024-04-24T08:26:10.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.985+0000 7fb2c3000640 1 -- 172.21.15.88:0/2020346336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc1e1200 msgr2=0x7fb2bc13b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:10.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.985+0000 7fb2c3000640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc1e1200 0x7fb2bc13b590 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb2b401c6c0 tx=0x7fb2b401d2d0 comp rx=0 tx=0).stop 2024-04-24T08:26:10.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.985+0000 7fb2c3000640 1 -- 172.21.15.88:0/2020346336 shutdown_connections 2024-04-24T08:26:10.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.985+0000 7fb2c3000640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb29c0683b0 0x7fb29c06a870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:10.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.985+0000 7fb2c3000640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc1e1200 0x7fb2bc13b590 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:10.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.985+0000 7fb2c3000640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2bc0b01a0 0x7fb2bc1e0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:10.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.985+0000 7fb2c3000640 1 --2- 172.21.15.88:0/2020346336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2bc0737c0 0x7fb2bc0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:10.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.985+0000 7fb2c3000640 1 -- 172.21.15.88:0/2020346336 >> 172.21.15.88:0/2020346336 conn(0x7fb2bc0b9690 msgr2=0x7fb2bc13dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:10.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.989+0000 7fb2c3000640 1 -- 172.21.15.88:0/2020346336 shutdown_connections 2024-04-24T08:26:10.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:10.989+0000 7fb2c3000640 1 -- 172.21.15.88:0/2020346336 wait complete. 2024-04-24T08:26:11.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:26:11.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.169+0000 7f3ea4400640 1 Processor -- start 2024-04-24T08:26:11.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.169+0000 7f3ea4400640 1 -- start start 2024-04-24T08:26:11.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.169+0000 7f3ea4400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e9c0b9d90 0x7f3e9c06d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.169+0000 7f3ea4400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c145f20 0x7f3e9c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.169+0000 7f3ea4400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e9c0ba170 con 0x7f3e9c09be30 2024-04-24T08:26:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.169+0000 7f3ea4400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3e9c09cd30 con 0x7f3e9c0b9d90 2024-04-24T08:26:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.169+0000 7f3ea4400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9c14a060 con 0x7f3e9c145f20 2024-04-24T08:26:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.169+0000 7f3ea1a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e9c0b9d90 0x7f3e9c06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.169+0000 7f3ea1a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e9c0b9d90 0x7f3e9c06d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59688/0 (socket says 172.21.15.88:59688) 2024-04-24T08:26:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.169+0000 7f3ea1a00640 1 -- 172.21.15.88:0/3304143410 learned_addr learned my addr 172.21.15.88:0/3304143410 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.173+0000 7f3ea2400640 1 --2- 172.21.15.88:0/3304143410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c145f20 0x7f3e9c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.173+0000 7f3ea1a00640 1 -- 172.21.15.88:0/3304143410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c145f20 msgr2=0x7f3e9c1504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.173+0000 7f3ea1a00640 1 --2- 172.21.15.88:0/3304143410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c145f20 0x7f3e9c1504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.173+0000 7f3ea1a00640 1 -- 172.21.15.88:0/3304143410 >> v1:172.21.15.142:6789/0 conn(0x7f3e9c09be30 legacy=0x7f3e9c06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.173+0000 7f3ea1a00640 1 -- 172.21.15.88:0/3304143410 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c149860 con 0x7f3e9c0b9d90 2024-04-24T08:26:11.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.173+0000 7f3ea1a00640 1 --2- 172.21.15.88:0/3304143410 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e9c0b9d90 0x7f3e9c06d210 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009870 tx=0x7f3e9001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3884a4ca36abff4f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:11.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.173+0000 7f3e9be00640 1 -- 172.21.15.88:0/3304143410 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900b1070 con 0x7f3e9c0b9d90 2024-04-24T08:26:11.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.173+0000 7f3e9be00640 1 -- 172.21.15.88:0/3304143410 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e900ac640 con 0x7f3e9c0b9d90 2024-04-24T08:26:11.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.173+0000 7f3e9be00640 1 -- 172.21.15.88:0/3304143410 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900aca10 con 0x7f3e9c0b9d90 2024-04-24T08:26:11.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.173+0000 7f3ea4400640 1 -- 172.21.15.88:0/3304143410 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e9c0b9d90 msgr2=0x7f3e9c06d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.173+0000 7f3ea4400640 1 --2- 172.21.15.88:0/3304143410 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e9c0b9d90 0x7f3e9c06d210 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009870 tx=0x7f3e9001c440 comp rx=0 tx=0).stop 2024-04-24T08:26:11.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 -- 172.21.15.88:0/3304143410 shutdown_connections 2024-04-24T08:26:11.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 --2- 172.21.15.88:0/3304143410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c145f20 0x7f3e9c1504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 --2- 172.21.15.88:0/3304143410 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e9c0b9d90 0x7f3e9c06d210 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 -- 172.21.15.88:0/3304143410 >> 172.21.15.88:0/3304143410 conn(0x7f3e9c06c0d0 msgr2=0x7f3e9c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:11.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 -- 172.21.15.88:0/3304143410 shutdown_connections 2024-04-24T08:26:11.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 -- 172.21.15.88:0/3304143410 wait complete. 2024-04-24T08:26:11.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 Processor -- start 2024-04-24T08:26:11.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 -- start start 2024-04-24T08:26:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e9c09be30 0x7f3e9c1e3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c0b9d90 0x7f3e9c14f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9c145f20 0x7f3e9c14fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c0b3fa0 con 0x7f3e9c09be30 2024-04-24T08:26:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c0b3e20 con 0x7f3e9c145f20 2024-04-24T08:26:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9c06de60 con 0x7f3e9c0b9d90 2024-04-24T08:26:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea1a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e9c09be30 0x7f3e9c1e3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea1a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e9c09be30 0x7f3e9c1e3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59702/0 (socket says 172.21.15.88:59702) 2024-04-24T08:26:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea1a00640 1 -- 172.21.15.88:0/1722197317 learned_addr learned my addr 172.21.15.88:0/1722197317 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea2400640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9c145f20 0x7f3e9c14fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea1000640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c0b9d90 0x7f3e9c14f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea1a00640 1 -- 172.21.15.88:0/1722197317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c0b9d90 msgr2=0x7f3e9c14f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea1a00640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c0b9d90 0x7f3e9c14f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea1a00640 1 -- 172.21.15.88:0/1722197317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9c145f20 msgr2=0x7f3e9c14fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea1a00640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9c145f20 0x7f3e9c14fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea1a00640 1 -- 172.21.15.88:0/1722197317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c09b160 con 0x7f3e9c09be30 2024-04-24T08:26:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea1a00640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e9c09be30 0x7f3e9c1e3d30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3e900af040 tx=0x7f3e9001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3e99600640 1 -- 172.21.15.88:0/1722197317 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900bb020 con 0x7f3e9c09be30 2024-04-24T08:26:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3e99600640 1 -- 172.21.15.88:0/1722197317 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e900b7640 con 0x7f3e9c09be30 2024-04-24T08:26:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3e99600640 1 -- 172.21.15.88:0/1722197317 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900b1040 con 0x7f3e9c09be30 2024-04-24T08:26:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 -- 172.21.15.88:0/1722197317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9c1e4580 con 0x7f3e9c09be30 2024-04-24T08:26:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.177+0000 7f3ea4400640 1 -- 172.21.15.88:0/1722197317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9c13fe40 con 0x7f3e9c09be30 2024-04-24T08:26:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.181+0000 7f3ea4400640 1 -- 172.21.15.88:0/1722197317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e9c068b90 con 0x7f3e9c09be30 2024-04-24T08:26:11.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.181+0000 7f3e99600640 1 -- 172.21.15.88:0/1722197317 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e900be020 con 0x7f3e9c09be30 2024-04-24T08:26:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.181+0000 7f3e99600640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3e7c068380 0x7f3e7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.181+0000 7f3e99600640 1 -- 172.21.15.88:0/1722197317 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5709+0+0 (secure 0 0 0) 0x7f3e90120d20 con 0x7f3e9c09be30 2024-04-24T08:26:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.181+0000 7f3ea1000640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3e7c068380 0x7f3e7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.181+0000 7f3ea1000640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3e7c068380 0x7f3e7c06a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0af230 tx=0x7f3e88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:11.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.185+0000 7f3e99600640 1 -- 172.21.15.88:0/1722197317 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3e900c5030 con 0x7f3e9c09be30 2024-04-24T08:26:11.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 -- 172.21.15.88:0/1722197317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e9c073f10 con 0x7f3e9c09be30 2024-04-24T08:26:11.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3e99600640 1 -- 172.21.15.88:0/1722197317 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+16682 (secure 0 0 0) 0x7f3e90016150 con 0x7f3e9c09be30 2024-04-24T08:26:11.347 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:11.347 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:26:10.368065+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:26:08.022146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T08:26:09.337841+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:26:11.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 -- 172.21.15.88:0/1722197317 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3e7c068380 msgr2=0x7f3e7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3e7c068380 0x7f3e7c06a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0af230 tx=0x7f3e88009040 comp rx=0 tx=0).stop 2024-04-24T08:26:11.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 -- 172.21.15.88:0/1722197317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e9c09be30 msgr2=0x7f3e9c1e3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e9c09be30 0x7f3e9c1e3d30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3e900af040 tx=0x7f3e9001ac80 comp rx=0 tx=0).stop 2024-04-24T08:26:11.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 -- 172.21.15.88:0/1722197317 shutdown_connections 2024-04-24T08:26:11.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3e7c068380 0x7f3e7c06a840 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9c145f20 0x7f3e9c14fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c0b9d90 0x7f3e9c14f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 --2- 172.21.15.88:0/1722197317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e9c09be30 0x7f3e9c1e3d30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 -- 172.21.15.88:0/1722197317 >> 172.21.15.88:0/1722197317 conn(0x7f3e9c06c0d0 msgr2=0x7f3e9c144ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:11.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 -- 172.21.15.88:0/1722197317 shutdown_connections 2024-04-24T08:26:11.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.345+0000 7f3ea4400640 1 -- 172.21.15.88:0/1722197317 wait complete. 2024-04-24T08:26:11.370 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:26:11.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.501+0000 7fda3e800640 1 Processor -- start 2024-04-24T08:26:11.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.501+0000 7fda3e800640 1 -- start start 2024-04-24T08:26:11.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.505+0000 7fda3e800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda380b7400 0x7fda380ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.505+0000 7fda3e800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda380b64e0 con 0x7fda380a94c0 2024-04-24T08:26:11.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.505+0000 7fda3e800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda380b77e0 con 0x7fda38145ec0 2024-04-24T08:26:11.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.505+0000 7fda3e800640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fda380b69e0 con 0x7fda380b7400 2024-04-24T08:26:11.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.505+0000 7fda37400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda380b7400 0x7fda380ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.505+0000 7fda2fe00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fda380a94c0 0x7fda381466b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38012/0 (socket says 172.21.15.88:38012) 2024-04-24T08:26:11.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.505+0000 7fda2fe00640 1 -- 172.21.15.88:0/1844574315 learned_addr learned my addr 172.21.15.88:0/1844574315 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:11.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.505+0000 7fda37400640 1 -- 172.21.15.88:0/1844574315 >> v1:172.21.15.142:6789/0 conn(0x7fda38145ec0 legacy=0x7fda38150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.505+0000 7fda37400640 1 -- 172.21.15.88:0/1844574315 >> v1:172.21.15.88:6789/0 conn(0x7fda380a94c0 legacy=0x7fda381466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.505+0000 7fda37400640 1 -- 172.21.15.88:0/1844574315 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda380b6700 con 0x7fda380b7400 2024-04-24T08:26:11.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.505+0000 7fda36a00640 1 -- 172.21.15.88:0/1844574315 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 391490898 0 0) 0x7fda380b64e0 con 0x7fda380a94c0 2024-04-24T08:26:11.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda37400640 1 --2- 172.21.15.88:0/1844574315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda380b7400 0x7fda380ab360 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fda280097c0 tx=0x7fda2801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90df61cdafa0ce0c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:11.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda36a00640 1 -- 172.21.15.88:0/1844574315 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda280b0070 con 0x7fda380b7400 2024-04-24T08:26:11.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda36a00640 1 -- 172.21.15.88:0/1844574315 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda280ab600 con 0x7fda380b7400 2024-04-24T08:26:11.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda36a00640 1 -- 172.21.15.88:0/1844574315 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda280ab9d0 con 0x7fda380b7400 2024-04-24T08:26:11.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 -- 172.21.15.88:0/1844574315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda380b7400 msgr2=0x7fda380ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 --2- 172.21.15.88:0/1844574315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda380b7400 0x7fda380ab360 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fda280097c0 tx=0x7fda2801c410 comp rx=0 tx=0).stop 2024-04-24T08:26:11.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 -- 172.21.15.88:0/1844574315 shutdown_connections 2024-04-24T08:26:11.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 --2- 172.21.15.88:0/1844574315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda380b7400 0x7fda380ab360 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 -- 172.21.15.88:0/1844574315 >> 172.21.15.88:0/1844574315 conn(0x7fda38067810 msgr2=0x7fda38067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:11.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 -- 172.21.15.88:0/1844574315 shutdown_connections 2024-04-24T08:26:11.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 -- 172.21.15.88:0/1844574315 wait complete. 2024-04-24T08:26:11.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 Processor -- start 2024-04-24T08:26:11.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 -- start start 2024-04-24T08:26:11.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda380b7400 0x7fda3813e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda38145ec0 0x7fda381388e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3813dae0 0x7fda38149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fda380b7cd0 con 0x7fda3813dae0 2024-04-24T08:26:11.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fda380b5eb0 con 0x7fda38145ec0 2024-04-24T08:26:11.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda3e800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fda380b7e50 con 0x7fda380b7400 2024-04-24T08:26:11.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda37e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3813dae0 0x7fda38149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda37e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3813dae0 0x7fda38149cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59730/0 (socket says 172.21.15.88:59730) 2024-04-24T08:26:11.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.509+0000 7fda37e00640 1 -- 172.21.15.88:0/3908916525 learned_addr learned my addr 172.21.15.88:0/3908916525 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:11.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda2fe00640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda38145ec0 0x7fda381388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda37400640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda380b7400 0x7fda3813e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda37e00640 1 -- 172.21.15.88:0/3908916525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda380b7400 msgr2=0x7fda3813e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda37e00640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda380b7400 0x7fda3813e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda37e00640 1 -- 172.21.15.88:0/3908916525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda38145ec0 msgr2=0x7fda381388e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda37e00640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda38145ec0 0x7fda381388e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda37e00640 1 -- 172.21.15.88:0/3908916525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda38148ae0 con 0x7fda3813dae0 2024-04-24T08:26:11.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda37e00640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3813dae0 0x7fda38149cc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fda3000c7a0 tx=0x7fda3000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:11.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda2f400640 1 -- 172.21.15.88:0/3908916525 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30015d70 con 0x7fda3813dae0 2024-04-24T08:26:11.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda2f400640 1 -- 172.21.15.88:0/3908916525 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda30003980 con 0x7fda3813dae0 2024-04-24T08:26:11.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda2f400640 1 -- 172.21.15.88:0/3908916525 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30003d70 con 0x7fda3813dae0 2024-04-24T08:26:11.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda3e800640 1 -- 172.21.15.88:0/3908916525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3813e1c0 con 0x7fda3813dae0 2024-04-24T08:26:11.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda3e800640 1 -- 172.21.15.88:0/3908916525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda381393e0 con 0x7fda3813dae0 2024-04-24T08:26:11.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda3e800640 1 -- 172.21.15.88:0/3908916525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda38068b90 con 0x7fda3813dae0 2024-04-24T08:26:11.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.513+0000 7fda2f400640 1 -- 172.21.15.88:0/3908916525 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fda300050d0 con 0x7fda3813dae0 2024-04-24T08:26:11.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.517+0000 7fda2f400640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fda14068380 0x7fda1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.517+0000 7fda2f400640 1 -- 172.21.15.88:0/3908916525 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5709+0+0 (secure 0 0 0) 0x7fda3008eb00 con 0x7fda3813dae0 2024-04-24T08:26:11.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.517+0000 7fda37400640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fda14068380 0x7fda1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.517+0000 7fda37400640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fda14068380 0x7fda1406a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fda280ad000 tx=0x7fda280a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:11.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.521+0000 7fda2f400640 1 -- 172.21.15.88:0/3908916525 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fda3005f150 con 0x7fda3813dae0 2024-04-24T08:26:11.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.677+0000 7fda3e800640 1 -- 172.21.15.88:0/3908916525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda38149a20 con 0x7fda3813dae0 2024-04-24T08:26:11.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.677+0000 7fda2f400640 1 -- 172.21.15.88:0/3908916525 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+16682 (secure 0 0 0) 0x7fda3005ea50 con 0x7fda3813dae0 2024-04-24T08:26:11.680 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:11.680 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:26:10.368065+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:26:08.022146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T08:26:09.337841+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:26:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.681+0000 7fda3e800640 1 -- 172.21.15.88:0/3908916525 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fda14068380 msgr2=0x7fda1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.681+0000 7fda3e800640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fda14068380 0x7fda1406a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fda280ad000 tx=0x7fda280a6000 comp rx=0 tx=0).stop 2024-04-24T08:26:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.681+0000 7fda3e800640 1 -- 172.21.15.88:0/3908916525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3813dae0 msgr2=0x7fda38149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.681+0000 7fda3e800640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3813dae0 0x7fda38149cc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fda3000c7a0 tx=0x7fda3000cc60 comp rx=0 tx=0).stop 2024-04-24T08:26:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.681+0000 7fda3e800640 1 -- 172.21.15.88:0/3908916525 shutdown_connections 2024-04-24T08:26:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.681+0000 7fda3e800640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fda14068380 0x7fda1406a840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.681+0000 7fda3e800640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3813dae0 0x7fda38149cc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.681+0000 7fda3e800640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda38145ec0 0x7fda381388e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.681+0000 7fda3e800640 1 --2- 172.21.15.88:0/3908916525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda380b7400 0x7fda3813e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.681+0000 7fda3e800640 1 -- 172.21.15.88:0/3908916525 >> 172.21.15.88:0/3908916525 conn(0x7fda38067810 msgr2=0x7fda38145580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:11.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.681+0000 7fda3e800640 1 -- 172.21.15.88:0/3908916525 shutdown_connections 2024-04-24T08:26:11.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.681+0000 7fda3e800640 1 -- 172.21.15.88:0/3908916525 wait complete. 2024-04-24T08:26:11.701 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-24T08:26:11.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.837+0000 7f4fca200640 1 Processor -- start 2024-04-24T08:26:11.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.837+0000 7f4fca200640 1 -- start start 2024-04-24T08:26:11.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.841+0000 7f4fca200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fc40b01a0 0x7f4fc406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.841+0000 7f4fca200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc40b0580 con 0x7f4fc413f090 2024-04-24T08:26:11.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.841+0000 7f4fca200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc40b59d0 con 0x7f4fc40ae4e0 2024-04-24T08:26:11.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.841+0000 7f4fca200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f4fc40ae970 con 0x7f4fc40b01a0 2024-04-24T08:26:11.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.841+0000 7f4fc3e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4fc413f090 0x7f4fc414f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38022/0 (socket says 172.21.15.88:38022) 2024-04-24T08:26:11.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.841+0000 7f4fc3400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fc40b01a0 0x7f4fc406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.841+0000 7f4fc3e00640 1 -- 172.21.15.88:0/2637960056 learned_addr learned my addr 172.21.15.88:0/2637960056 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:11.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.841+0000 7f4fc3400640 1 -- 172.21.15.88:0/2637960056 >> v1:172.21.15.142:6789/0 conn(0x7f4fc40ae4e0 legacy=0x7f4fc413e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.841+0000 7f4fc3400640 1 -- 172.21.15.88:0/2637960056 >> v1:172.21.15.88:6789/0 conn(0x7f4fc413f090 legacy=0x7f4fc414f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.841+0000 7f4fc3400640 1 -- 172.21.15.88:0/2637960056 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc40b53a0 con 0x7f4fc40b01a0 2024-04-24T08:26:11.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.841+0000 7f4fc2000640 1 -- 172.21.15.88:0/2637960056 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335423930 0 0) 0x7f4fc40b0580 con 0x7f4fc413f090 2024-04-24T08:26:11.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fc3400640 1 --2- 172.21.15.88:0/2637960056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc40b01a0 0x7f4fc406d2a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40097c0 tx=0x7f4fb401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d22d5073f40e5c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:11.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fc2000640 1 -- 172.21.15.88:0/2637960056 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40b0070 con 0x7f4fc40b01a0 2024-04-24T08:26:11.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fc2000640 1 -- 172.21.15.88:0/2637960056 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb40ab600 con 0x7f4fc40b01a0 2024-04-24T08:26:11.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fc2000640 1 -- 172.21.15.88:0/2637960056 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40ab9d0 con 0x7f4fc40b01a0 2024-04-24T08:26:11.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 -- 172.21.15.88:0/2637960056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc40b01a0 msgr2=0x7f4fc406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 --2- 172.21.15.88:0/2637960056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc40b01a0 0x7f4fc406d2a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40097c0 tx=0x7f4fb401c380 comp rx=0 tx=0).stop 2024-04-24T08:26:11.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 -- 172.21.15.88:0/2637960056 shutdown_connections 2024-04-24T08:26:11.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 --2- 172.21.15.88:0/2637960056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc40b01a0 0x7f4fc406d2a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 -- 172.21.15.88:0/2637960056 >> 172.21.15.88:0/2637960056 conn(0x7f4fc40b9690 msgr2=0x7f4fc40b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:11.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 -- 172.21.15.88:0/2637960056 shutdown_connections 2024-04-24T08:26:11.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 -- 172.21.15.88:0/2637960056 wait complete. 2024-04-24T08:26:11.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 Processor -- start 2024-04-24T08:26:11.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 -- start start 2024-04-24T08:26:11.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fc40b01a0 0x7f4fc41e0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc413f090 0x7f4fc4072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc40726a0 0x7f4fc4141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4153780 con 0x7f4fc413f090 2024-04-24T08:26:11.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc406e470 con 0x7f4fc40726a0 2024-04-24T08:26:11.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fca200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc4153900 con 0x7f4fc40b01a0 2024-04-24T08:26:11.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fc2a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc413f090 0x7f4fc4072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fc2a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc413f090 0x7f4fc4072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59750/0 (socket says 172.21.15.88:59750) 2024-04-24T08:26:11.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fc2a00640 1 -- 172.21.15.88:0/1063980818 learned_addr learned my addr 172.21.15.88:0/1063980818 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:11.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fc3400640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fc40b01a0 0x7f4fc41e0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fc3e00640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc40726a0 0x7f4fc4141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fc2a00640 1 -- 172.21.15.88:0/1063980818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fc40b01a0 msgr2=0x7f4fc41e0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.845+0000 7f4fc2a00640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fc40b01a0 0x7f4fc41e0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fc2a00640 1 -- 172.21.15.88:0/1063980818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc40726a0 msgr2=0x7f4fc4141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:11.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fc2a00640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc40726a0 0x7f4fc4141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:11.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fc2a00640 1 -- 172.21.15.88:0/1063980818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc4070b20 con 0x7f4fc413f090 2024-04-24T08:26:11.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fc3400640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fc40b01a0 0x7f4fc41e0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:11.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fc2a00640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc413f090 0x7f4fc4072160 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000c500 tx=0x7f4fb000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:11.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fbb400640 1 -- 172.21.15.88:0/1063980818 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0016020 con 0x7f4fc413f090 2024-04-24T08:26:11.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fbb400640 1 -- 172.21.15.88:0/1063980818 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb0005220 con 0x7f4fc413f090 2024-04-24T08:26:11.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fca200640 1 -- 172.21.15.88:0/1063980818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc4070d90 con 0x7f4fc413f090 2024-04-24T08:26:11.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fbb400640 1 -- 172.21.15.88:0/1063980818 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0007030 con 0x7f4fc413f090 2024-04-24T08:26:11.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fca200640 1 -- 172.21.15.88:0/1063980818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc41e1220 con 0x7f4fc413f090 2024-04-24T08:26:11.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fca200640 1 -- 172.21.15.88:0/1063980818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc4068c00 con 0x7f4fc413f090 2024-04-24T08:26:11.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fbb400640 1 -- 172.21.15.88:0/1063980818 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4fb00071f0 con 0x7f4fc413f090 2024-04-24T08:26:11.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fbb400640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4fa4068380 0x7f4fa406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:11.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fbb400640 1 -- 172.21.15.88:0/1063980818 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5709+0+0 (secure 0 0 0) 0x7f4fb0086460 con 0x7f4fc413f090 2024-04-24T08:26:11.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.849+0000 7f4fc3400640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4fa4068380 0x7f4fa406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:11.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.853+0000 7f4fc3400640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4fa4068380 0x7f4fa406a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40ad000 tx=0x7f4fb40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:11.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:11.853+0000 7f4fbb400640 1 -- 172.21.15.88:0/1063980818 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4fb0020020 con 0x7f4fc413f090 2024-04-24T08:26:12.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:12.049+0000 7f4fca200640 1 -- 172.21.15.88:0/1063980818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4fc40b8690 con 0x7f4fc413f090 2024-04-24T08:26:13.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.005+0000 7f4fbb400640 1 -- 172.21.15.88:0/1063980818 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f4fb0056990 con 0x7f4fc413f090 2024-04-24T08:26:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.009+0000 7f4fca200640 1 -- 172.21.15.88:0/1063980818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4fa4068380 msgr2=0x7f4fa406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.009+0000 7f4fca200640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4fa4068380 0x7f4fa406a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40ad000 tx=0x7f4fb40a6000 comp rx=0 tx=0).stop 2024-04-24T08:26:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.009+0000 7f4fca200640 1 -- 172.21.15.88:0/1063980818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc413f090 msgr2=0x7f4fc4072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.009+0000 7f4fca200640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc413f090 0x7f4fc4072160 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000c500 tx=0x7f4fb000c9c0 comp rx=0 tx=0).stop 2024-04-24T08:26:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.009+0000 7f4fca200640 1 -- 172.21.15.88:0/1063980818 shutdown_connections 2024-04-24T08:26:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.009+0000 7f4fca200640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f4fa4068380 0x7f4fa406a840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.009+0000 7f4fca200640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc40726a0 0x7f4fc4141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.009+0000 7f4fca200640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc413f090 0x7f4fc4072160 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.009+0000 7f4fca200640 1 --2- 172.21.15.88:0/1063980818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fc40b01a0 0x7f4fc41e0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.009+0000 7f4fca200640 1 -- 172.21.15.88:0/1063980818 >> 172.21.15.88:0/1063980818 conn(0x7f4fc40b9690 msgr2=0x7f4fc40b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.009+0000 7f4fca200640 1 -- 172.21.15.88:0/1063980818 shutdown_connections 2024-04-24T08:26:13.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.009+0000 7f4fca200640 1 -- 172.21.15.88:0/1063980818 wait complete. 2024-04-24T08:26:13.035 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-24T08:26:13.036 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-24T08:26:13.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9950a00640 1 Processor -- start 2024-04-24T08:26:13.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9950a00640 1 -- start start 2024-04-24T08:26:13.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9950a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f994c0b01a0 0x7f994c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:13.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9950a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f994c13f090 0x7f994c14f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:13.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9950a00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f994c0b0580 con 0x7f994c0ae4e0 2024-04-24T08:26:13.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9950a00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f994c0b59d0 con 0x7f994c0b01a0 2024-04-24T08:26:13.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9950a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f994c0ae970 con 0x7f994c13f090 2024-04-24T08:26:13.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9949e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f994c0b01a0 0x7f994c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:13.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9941400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f994c0ae4e0 0x7f994c13e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38032/0 (socket says 172.21.15.88:38032) 2024-04-24T08:26:13.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9941400640 1 -- 172.21.15.88:0/3104255060 learned_addr learned my addr 172.21.15.88:0/3104255060 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:13.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f994a800640 1 --2- 172.21.15.88:0/3104255060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f994c13f090 0x7f994c14f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:13.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9949400640 1 -- 172.21.15.88:0/3104255060 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994692030 0 0) 0x7f994c0b0580 con 0x7f994c0ae4e0 2024-04-24T08:26:13.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9949400640 1 -- 172.21.15.88:0/3104255060 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9930003530 con 0x7f994c0ae4e0 2024-04-24T08:26:13.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9949e00640 1 -- 172.21.15.88:0/3104255060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f994c13f090 msgr2=0x7f994c14f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:13.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9949e00640 1 --2- 172.21.15.88:0/3104255060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f994c13f090 0x7f994c14f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:13.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9949e00640 1 -- 172.21.15.88:0/3104255060 >> v1:172.21.15.88:6789/0 conn(0x7f994c0ae4e0 legacy=0x7f994c13e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:13.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.177+0000 7f9949e00640 1 -- 172.21.15.88:0/3104255060 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c0b53a0 con 0x7f994c0b01a0 2024-04-24T08:26:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9949e00640 1 --2- 172.21.15.88:0/3104255060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f994c0b01a0 0x7f994c06d2a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f993c009d90 tx=0x7f993c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87419f8fadd5b7e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9949400640 1 -- 172.21.15.88:0/3104255060 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c0b2070 con 0x7f994c0b01a0 2024-04-24T08:26:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9949400640 1 -- 172.21.15.88:0/3104255060 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993c0a5820 con 0x7f994c0b01a0 2024-04-24T08:26:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9949400640 1 -- 172.21.15.88:0/3104255060 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c0a5bf0 con 0x7f994c0b01a0 2024-04-24T08:26:13.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9950a00640 1 -- 172.21.15.88:0/3104255060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f994c0b01a0 msgr2=0x7f994c06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:13.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9950a00640 1 --2- 172.21.15.88:0/3104255060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f994c0b01a0 0x7f994c06d2a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f993c009d90 tx=0x7f993c01c850 comp rx=0 tx=0).stop 2024-04-24T08:26:13.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9950a00640 1 -- 172.21.15.88:0/3104255060 shutdown_connections 2024-04-24T08:26:13.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9950a00640 1 --2- 172.21.15.88:0/3104255060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f994c13f090 0x7f994c14f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:13.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9950a00640 1 --2- 172.21.15.88:0/3104255060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f994c0b01a0 0x7f994c06d2a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:13.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9950a00640 1 -- 172.21.15.88:0/3104255060 >> 172.21.15.88:0/3104255060 conn(0x7f994c0b9690 msgr2=0x7f994c0b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:13.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9950a00640 1 -- 172.21.15.88:0/3104255060 shutdown_connections 2024-04-24T08:26:13.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9950a00640 1 -- 172.21.15.88:0/3104255060 wait complete. 2024-04-24T08:26:13.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9950a00640 1 Processor -- start 2024-04-24T08:26:13.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.181+0000 7f9950a00640 1 -- start start 2024-04-24T08:26:13.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9950a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f994c0b01a0 0x7f994c072d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:13.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9950a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f994c13f090 0x7f994c071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:13.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9950a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f994c151d60 0x7f994c0b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:13.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9950a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f994c150300 con 0x7f994c151d60 2024-04-24T08:26:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9950a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f994c150180 con 0x7f994c13f090 2024-04-24T08:26:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9950a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f994c150480 con 0x7f994c0b01a0 2024-04-24T08:26:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f994a800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f994c151d60 0x7f994c0b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f994a800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f994c151d60 0x7f994c0b8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59762/0 (socket says 172.21.15.88:59762) 2024-04-24T08:26:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f994a800640 1 -- 172.21.15.88:0/972342744 learned_addr learned my addr 172.21.15.88:0/972342744 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f994a800640 1 -- 172.21.15.88:0/972342744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f994c0b01a0 msgr2=0x7f994c072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f994a800640 1 --2- 172.21.15.88:0/972342744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f994c0b01a0 0x7f994c072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f994a800640 1 -- 172.21.15.88:0/972342744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f994c13f090 msgr2=0x7f994c071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f994a800640 1 --2- 172.21.15.88:0/972342744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f994c13f090 0x7f994c071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f994a800640 1 -- 172.21.15.88:0/972342744 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c070fa0 con 0x7f994c151d60 2024-04-24T08:26:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f994a800640 1 --2- 172.21.15.88:0/972342744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f994c151d60 0x7f994c0b8a00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f994400e820 tx=0x7f994400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9942a00640 1 -- 172.21.15.88:0/972342744 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944017070 con 0x7f994c151d60 2024-04-24T08:26:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9942a00640 1 -- 172.21.15.88:0/972342744 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994400c940 con 0x7f994c151d60 2024-04-24T08:26:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9942a00640 1 -- 172.21.15.88:0/972342744 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994400cd10 con 0x7f994c151d60 2024-04-24T08:26:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9950a00640 1 -- 172.21.15.88:0/972342744 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994c0b8520 con 0x7f994c151d60 2024-04-24T08:26:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9950a00640 1 -- 172.21.15.88:0/972342744 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994c071220 con 0x7f994c151d60 2024-04-24T08:26:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9950a00640 1 -- 172.21.15.88:0/972342744 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994c068c00 con 0x7f994c151d60 2024-04-24T08:26:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.185+0000 7f9942a00640 1 -- 172.21.15.88:0/972342744 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f994401a070 con 0x7f994c151d60 2024-04-24T08:26:13.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.189+0000 7f9942a00640 1 --2- 172.21.15.88:0/972342744 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9928068380 0x7f992806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:13.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.189+0000 7f9942a00640 1 -- 172.21.15.88:0/972342744 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f99440867f0 con 0x7f994c151d60 2024-04-24T08:26:13.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.189+0000 7f9949e00640 1 --2- 172.21.15.88:0/972342744 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9928068380 0x7f992806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:13.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.189+0000 7f9949e00640 1 --2- 172.21.15.88:0/972342744 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9928068380 0x7f992806a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f993c0af000 tx=0x7f993c004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:13.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.193+0000 7f9942a00640 1 -- 172.21.15.88:0/972342744 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f994c070fa0 con 0x7f994c151d60 2024-04-24T08:26:13.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:13.381+0000 7f9950a00640 1 -- 172.21.15.88:0/972342744 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f994c0b86f0 con 0x7f994c151d60 2024-04-24T08:26:13.951 INFO:tasks.ceph.mds.a.smithi088.stderr:2024-04-24T08:26:13.949+0000 7fdb31600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T08:26:14.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9942a00640 1 -- 172.21.15.88:0/972342744 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f9944056da0 con 0x7f994c151d60 2024-04-24T08:26:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9950a00640 1 -- 172.21.15.88:0/972342744 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9928068380 msgr2=0x7f992806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9950a00640 1 --2- 172.21.15.88:0/972342744 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9928068380 0x7f992806a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f993c0af000 tx=0x7f993c004ac0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9950a00640 1 -- 172.21.15.88:0/972342744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f994c151d60 msgr2=0x7f994c0b8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9950a00640 1 --2- 172.21.15.88:0/972342744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f994c151d60 0x7f994c0b8a00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f994400e820 tx=0x7f994400ece0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9950a00640 1 -- 172.21.15.88:0/972342744 shutdown_connections 2024-04-24T08:26:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9950a00640 1 --2- 172.21.15.88:0/972342744 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f9928068380 0x7f992806a840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9950a00640 1 --2- 172.21.15.88:0/972342744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f994c151d60 0x7f994c0b8a00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9950a00640 1 --2- 172.21.15.88:0/972342744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f994c13f090 0x7f994c071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9950a00640 1 --2- 172.21.15.88:0/972342744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f994c0b01a0 0x7f994c072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9950a00640 1 -- 172.21.15.88:0/972342744 >> 172.21.15.88:0/972342744 conn(0x7f994c0b9690 msgr2=0x7f994c0b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9950a00640 1 -- 172.21.15.88:0/972342744 shutdown_connections 2024-04-24T08:26:14.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.009+0000 7f9950a00640 1 -- 172.21.15.88:0/972342744 wait complete. 2024-04-24T08:26:14.034 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-24T08:26:14.034 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:26:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.165+0000 7fc0eaa00640 1 Processor -- start 2024-04-24T08:26:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.165+0000 7fc0eaa00640 1 -- start start 2024-04-24T08:26:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0eaa00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0e409c730 0x7fc0e409e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0eaa00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc0e414b370 0x7fc0e414b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0eaa00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0e409cb10 con 0x7fc0e40afe00 2024-04-24T08:26:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0eaa00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e40b9ea0 con 0x7fc0e414b370 2024-04-24T08:26:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0eaa00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e40b02e0 con 0x7fc0e409c730 2024-04-24T08:26:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0e3400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc0e40afe00 0x7fc0e40986a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38040/0 (socket says 172.21.15.88:38040) 2024-04-24T08:26:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0e3400640 1 -- 172.21.15.88:0/899011379 learned_addr learned my addr 172.21.15.88:0/899011379 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0e8a00640 1 --2- 172.21.15.88:0/899011379 >> v2:172.21.15.88:3300/0 conn(0x7fc0e414b370 0x7fc0e414b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0e3e00640 1 --2- 172.21.15.88:0/899011379 >> v2:172.21.15.142:3300/0 conn(0x7fc0e409c730 0x7fc0e409e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0e8a00640 1 -- 172.21.15.88:0/899011379 >> v2:172.21.15.142:3300/0 conn(0x7fc0e409c730 msgr2=0x7fc0e409e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0e8a00640 1 --2- 172.21.15.88:0/899011379 >> v2:172.21.15.142:3300/0 conn(0x7fc0e409c730 0x7fc0e409e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0e2a00640 1 -- 172.21.15.88:0/899011379 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424516711 0 0) 0x7fc0e409cb10 con 0x7fc0e40afe00 2024-04-24T08:26:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0e8a00640 1 -- 172.21.15.88:0/899011379 >> v1:172.21.15.88:6789/0 conn(0x7fc0e40afe00 legacy=0x7fc0e40986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.169+0000 7fc0e8a00640 1 -- 172.21.15.88:0/899011379 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e40b9b30 con 0x7fc0e414b370 2024-04-24T08:26:14.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0e8a00640 1 --2- 172.21.15.88:0/899011379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e414b370 0x7fc0e414b7c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc0e406c9d0 tx=0x7fc0dc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d053d3cd1da08670 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:14.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0e2a00640 1 -- 172.21.15.88:0/899011379 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc0b2070 con 0x7fc0e414b370 2024-04-24T08:26:14.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0e2a00640 1 -- 172.21.15.88:0/899011379 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0dc0a57f0 con 0x7fc0e414b370 2024-04-24T08:26:14.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0e2a00640 1 -- 172.21.15.88:0/899011379 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc0a5bc0 con 0x7fc0e414b370 2024-04-24T08:26:14.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 -- 172.21.15.88:0/899011379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e414b370 msgr2=0x7fc0e414b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 --2- 172.21.15.88:0/899011379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e414b370 0x7fc0e414b7c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc0e406c9d0 tx=0x7fc0dc01c930 comp rx=0 tx=0).stop 2024-04-24T08:26:14.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 -- 172.21.15.88:0/899011379 shutdown_connections 2024-04-24T08:26:14.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 --2- 172.21.15.88:0/899011379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e414b370 0x7fc0e414b7c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 --2- 172.21.15.88:0/899011379 >> v2:172.21.15.142:3300/0 conn(0x7fc0e409c730 0x7fc0e409e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 -- 172.21.15.88:0/899011379 >> 172.21.15.88:0/899011379 conn(0x7fc0e406c0d0 msgr2=0x7fc0e40b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 -- 172.21.15.88:0/899011379 shutdown_connections 2024-04-24T08:26:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 -- 172.21.15.88:0/899011379 wait complete. 2024-04-24T08:26:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 Processor -- start 2024-04-24T08:26:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 -- start start 2024-04-24T08:26:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e409c730 0x7fc0e41e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e40afe00 0x7fc0e41e4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0e414b370 0x7fc0e4071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e4155250 con 0x7fc0e40afe00 2024-04-24T08:26:14.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e41550d0 con 0x7fc0e409c730 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.173+0000 7fc0eaa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e41553d0 con 0x7fc0e414b370 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0e3400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e40afe00 0x7fc0e41e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0e3400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e40afe00 0x7fc0e41e4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59782/0 (socket says 172.21.15.88:59782) 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0e3400640 1 -- 172.21.15.88:0/2952011747 learned_addr learned my addr 172.21.15.88:0/2952011747 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0e3400640 1 -- 172.21.15.88:0/2952011747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0e414b370 msgr2=0x7fc0e4071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0e3400640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0e414b370 0x7fc0e4071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0e3400640 1 -- 172.21.15.88:0/2952011747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e409c730 msgr2=0x7fc0e41e3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0e3e00640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e409c730 0x7fc0e41e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0e3400640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e409c730 0x7fc0e41e3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0e3400640 1 -- 172.21.15.88:0/2952011747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e4147d40 con 0x7fc0e40afe00 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0e3e00640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e409c730 0x7fc0e41e3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0e3400640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e40afe00 0x7fc0e41e4040 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000c520 tx=0x7fc0d000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0dbe00640 1 -- 172.21.15.88:0/2952011747 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0018070 con 0x7fc0e40afe00 2024-04-24T08:26:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0dbe00640 1 -- 172.21.15.88:0/2952011747 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d00074e0 con 0x7fc0e40afe00 2024-04-24T08:26:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0dbe00640 1 -- 172.21.15.88:0/2952011747 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00049f0 con 0x7fc0e40afe00 2024-04-24T08:26:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0eaa00640 1 -- 172.21.15.88:0/2952011747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e4147fe0 con 0x7fc0e40afe00 2024-04-24T08:26:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0eaa00640 1 -- 172.21.15.88:0/2952011747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e41e4580 con 0x7fc0e40afe00 2024-04-24T08:26:14.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0eaa00640 1 -- 172.21.15.88:0/2952011747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e4068b90 con 0x7fc0e40afe00 2024-04-24T08:26:14.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0dbe00640 1 -- 172.21.15.88:0/2952011747 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc0d0004b90 con 0x7fc0e40afe00 2024-04-24T08:26:14.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0dbe00640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc0c40683b0 0x7fc0c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.177+0000 7fc0dbe00640 1 -- 172.21.15.88:0/2952011747 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fc0d0085cf0 con 0x7fc0e40afe00 2024-04-24T08:26:14.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.181+0000 7fc0e3e00640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc0c40683b0 0x7fc0c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.181+0000 7fc0e3e00640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc0c40683b0 0x7fc0c406a870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009ae0 tx=0x7fc0d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:14.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.181+0000 7fc0dbe00640 1 -- 172.21.15.88:0/2952011747 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc0d008a070 con 0x7fc0e40afe00 2024-04-24T08:26:14.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.369+0000 7fc0eaa00640 1 -- 172.21.15.88:0/2952011747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0e406ea30 con 0x7fc0e40afe00 2024-04-24T08:26:14.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0dbe00640 1 -- 172.21.15.88:0/2952011747 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3534 (secure 0 0 0) 0x7fc0d0056340 con 0x7fc0e40afe00 2024-04-24T08:26:14.374 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:14.374 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1471179990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1471179990},{"type":"v1","addr":"172.21.15.142:6833","nonce":1471179990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:26:10.368031+0000","modified":"2024-04-24T08:26:13.385291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3724486177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3724486177},{"type":"v1","addr":"172.21.15.88:6835","nonce":3724486177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4962,"qdb_cluster":[4962]},"id":2}]} 2024-04-24T08:26:14.374 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 16 2024-04-24T08:26:14.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0eaa00640 1 -- 172.21.15.88:0/2952011747 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc0c40683b0 msgr2=0x7fc0c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0eaa00640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc0c40683b0 0x7fc0c406a870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009ae0 tx=0x7fc0d4008040 comp rx=0 tx=0).stop 2024-04-24T08:26:14.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0eaa00640 1 -- 172.21.15.88:0/2952011747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e40afe00 msgr2=0x7fc0e41e4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0eaa00640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e40afe00 0x7fc0e41e4040 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000c520 tx=0x7fc0d000c9e0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0eaa00640 1 -- 172.21.15.88:0/2952011747 shutdown_connections 2024-04-24T08:26:14.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0eaa00640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc0c40683b0 0x7fc0c406a870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0eaa00640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0e414b370 0x7fc0e4071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0eaa00640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e40afe00 0x7fc0e41e4040 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0eaa00640 1 --2- 172.21.15.88:0/2952011747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e409c730 0x7fc0e41e3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0eaa00640 1 -- 172.21.15.88:0/2952011747 >> 172.21.15.88:0/2952011747 conn(0x7fc0e406c0d0 msgr2=0x7fc0e40b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:14.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0eaa00640 1 -- 172.21.15.88:0/2952011747 shutdown_connections 2024-04-24T08:26:14.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.373+0000 7fc0eaa00640 1 -- 172.21.15.88:0/2952011747 wait complete. 2024-04-24T08:26:14.395 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:26:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.525+0000 7f23e3200640 1 Processor -- start 2024-04-24T08:26:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.525+0000 7f23e3200640 1 -- start start 2024-04-24T08:26:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23e3200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40b3e50 0x7f23e4148070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23e3200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23e40b2550 0x7f23e41485b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23e3200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e40b4230 con 0x7f23e413e460 2024-04-24T08:26:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23e3200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f23e40b2c30 con 0x7f23e40b2550 2024-04-24T08:26:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23e3200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f23e40b3440 con 0x7f23e40b3e50 2024-04-24T08:26:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23e2800640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f23e413e460 0x7f23e413e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38042/0 (socket says 172.21.15.88:38042) 2024-04-24T08:26:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23e2800640 1 -- 172.21.15.88:0/327988439 learned_addr learned my addr 172.21.15.88:0/327988439 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23d9400640 1 --2- 172.21.15.88:0/327988439 >> v2:172.21.15.142:3300/0 conn(0x7f23e40b2550 0x7f23e41485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23e1e00640 1 --2- 172.21.15.88:0/327988439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40b3e50 0x7f23e4148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23e1400640 1 -- 172.21.15.88:0/327988439 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3143389644 0 0) 0x7f23e40b4230 con 0x7f23e413e460 2024-04-24T08:26:14.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23e1400640 1 -- 172.21.15.88:0/327988439 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23c8003530 con 0x7f23e413e460 2024-04-24T08:26:14.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23e1400640 1 -- 172.21.15.88:0/327988439 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 785643279 0 0) 0x7f23c8003530 con 0x7f23e413e460 2024-04-24T08:26:14.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23d9400640 1 -- 172.21.15.88:0/327988439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40b3e50 msgr2=0x7f23e4148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:14.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23d9400640 1 --2- 172.21.15.88:0/327988439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40b3e50 0x7f23e4148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23d9400640 1 -- 172.21.15.88:0/327988439 >> v1:172.21.15.88:6789/0 conn(0x7f23e413e460 legacy=0x7f23e413e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23d9400640 1 -- 172.21.15.88:0/327988439 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e40b2e80 con 0x7f23e40b2550 2024-04-24T08:26:14.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.529+0000 7f23e1e00640 1 --2- 172.21.15.88:0/327988439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40b3e50 0x7f23e4148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:26:14.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23d9400640 1 --2- 172.21.15.88:0/327988439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40b2550 0x7f23e41485b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00bfa0 tx=0x7f23cc01e970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6c5720b5e72a916 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:14.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e1400640 1 -- 172.21.15.88:0/327988439 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc001680 con 0x7f23e40b2550 2024-04-24T08:26:14.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e1400640 1 -- 172.21.15.88:0/327988439 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23cc00b0d0 con 0x7f23e40b2550 2024-04-24T08:26:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e1400640 1 -- 172.21.15.88:0/327988439 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0a7590 con 0x7f23e40b2550 2024-04-24T08:26:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e3200640 1 -- 172.21.15.88:0/327988439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40b2550 msgr2=0x7f23e41485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e3200640 1 --2- 172.21.15.88:0/327988439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40b2550 0x7f23e41485b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00bfa0 tx=0x7f23cc01e970 comp rx=0 tx=0).stop 2024-04-24T08:26:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e3200640 1 -- 172.21.15.88:0/327988439 shutdown_connections 2024-04-24T08:26:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e3200640 1 --2- 172.21.15.88:0/327988439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40b2550 0x7f23e41485b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e3200640 1 --2- 172.21.15.88:0/327988439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40b3e50 0x7f23e4148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e3200640 1 -- 172.21.15.88:0/327988439 >> 172.21.15.88:0/327988439 conn(0x7f23e40b91f0 msgr2=0x7f23e40b9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:14.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e3200640 1 -- 172.21.15.88:0/327988439 shutdown_connections 2024-04-24T08:26:14.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e3200640 1 -- 172.21.15.88:0/327988439 wait complete. 2024-04-24T08:26:14.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e3200640 1 Processor -- start 2024-04-24T08:26:14.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.533+0000 7f23e3200640 1 -- start start 2024-04-24T08:26:14.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e3200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e40b2550 0x7f23e40b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40b3e50 0x7f23e4140a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e3200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e413e460 0x7f23e4141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e3200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f23e40b4e10 con 0x7f23e40b2550 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e3200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f23e40b4c90 con 0x7f23e40b3e50 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e3200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f23e40b4f90 con 0x7f23e413e460 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e1e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e40b2550 0x7f23e40b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e1e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e40b2550 0x7f23e40b84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59792/0 (socket says 172.21.15.88:59792) 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e1e00640 1 -- 172.21.15.88:0/3373241073 learned_addr learned my addr 172.21.15.88:0/3373241073 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e1e00640 1 -- 172.21.15.88:0/3373241073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e413e460 msgr2=0x7f23e4141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e1e00640 1 --2- 172.21.15.88:0/3373241073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e413e460 0x7f23e4141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e1e00640 1 -- 172.21.15.88:0/3373241073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40b3e50 msgr2=0x7f23e4140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e1e00640 1 --2- 172.21.15.88:0/3373241073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40b3e50 0x7f23e4140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e1e00640 1 -- 172.21.15.88:0/3373241073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e4140f40 con 0x7f23e40b2550 2024-04-24T08:26:14.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e1e00640 1 --2- 172.21.15.88:0/3373241073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e40b2550 0x7f23e40b84f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f23d400ebe0 tx=0x7f23d400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:14.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23daa00640 1 -- 172.21.15.88:0/3373241073 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4017070 con 0x7f23e40b2550 2024-04-24T08:26:14.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23daa00640 1 -- 172.21.15.88:0/3373241073 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d400cc30 con 0x7f23e40b2550 2024-04-24T08:26:14.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23daa00640 1 -- 172.21.15.88:0/3373241073 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4013470 con 0x7f23e40b2550 2024-04-24T08:26:14.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e3200640 1 -- 172.21.15.88:0/3373241073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e413fa10 con 0x7f23e40b2550 2024-04-24T08:26:14.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e3200640 1 -- 172.21.15.88:0/3373241073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e41414a0 con 0x7f23e40b2550 2024-04-24T08:26:14.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23e3200640 1 -- 172.21.15.88:0/3373241073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e4068b20 con 0x7f23e40b2550 2024-04-24T08:26:14.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.537+0000 7f23daa00640 1 -- 172.21.15.88:0/3373241073 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f23d401a070 con 0x7f23e40b2550 2024-04-24T08:26:14.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.541+0000 7f23daa00640 1 --2- 172.21.15.88:0/3373241073 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f23c0068380 0x7f23c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.541+0000 7f23daa00640 1 -- 172.21.15.88:0/3373241073 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f23d40868f0 con 0x7f23e40b2550 2024-04-24T08:26:14.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.541+0000 7f23d9400640 1 --2- 172.21.15.88:0/3373241073 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f23c0068380 0x7f23c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.541+0000 7f23d9400640 1 --2- 172.21.15.88:0/3373241073 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f23c0068380 0x7f23c006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0b0000 tx=0x7f23cc004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:14.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.545+0000 7f23daa00640 1 -- 172.21.15.88:0/3373241073 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f23e4140f40 con 0x7f23e40b2550 2024-04-24T08:26:14.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.701+0000 7f23e3200640 1 -- 172.21.15.88:0/3373241073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23e4070c30 con 0x7f23e40b2550 2024-04-24T08:26:14.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.701+0000 7f23daa00640 1 -- 172.21.15.88:0/3373241073 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+16669 (secure 0 0 0) 0x7f23d4056ea0 con 0x7f23e40b2550 2024-04-24T08:26:14.703 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:14.704 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:26:11.996420+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:26:08.022146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T08:26:09.337841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:26:14.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.701+0000 7f23e3200640 1 -- 172.21.15.88:0/3373241073 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f23c0068380 msgr2=0x7f23c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.701+0000 7f23e3200640 1 --2- 172.21.15.88:0/3373241073 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f23c0068380 0x7f23c006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0b0000 tx=0x7f23cc004ac0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.701+0000 7f23e3200640 1 -- 172.21.15.88:0/3373241073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e40b2550 msgr2=0x7f23e40b84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.701+0000 7f23e3200640 1 --2- 172.21.15.88:0/3373241073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e40b2550 0x7f23e40b84f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f23d400ebe0 tx=0x7f23d400c520 comp rx=0 tx=0).stop 2024-04-24T08:26:14.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.701+0000 7f23e3200640 1 -- 172.21.15.88:0/3373241073 shutdown_connections 2024-04-24T08:26:14.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.701+0000 7f23e3200640 1 --2- 172.21.15.88:0/3373241073 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f23c0068380 0x7f23c006a840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.701+0000 7f23e3200640 1 --2- 172.21.15.88:0/3373241073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e413e460 0x7f23e4141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.701+0000 7f23e3200640 1 --2- 172.21.15.88:0/3373241073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40b3e50 0x7f23e4140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.701+0000 7f23e3200640 1 --2- 172.21.15.88:0/3373241073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e40b2550 0x7f23e40b84f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.701+0000 7f23e3200640 1 -- 172.21.15.88:0/3373241073 >> 172.21.15.88:0/3373241073 conn(0x7f23e40b91f0 msgr2=0x7f23e413b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:14.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.705+0000 7f23e3200640 1 -- 172.21.15.88:0/3373241073 shutdown_connections 2024-04-24T08:26:14.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.705+0000 7f23e3200640 1 -- 172.21.15.88:0/3373241073 wait complete. 2024-04-24T08:26:14.724 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-24T08:26:14.724 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:26:14.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77b0a00640 1 Processor -- start 2024-04-24T08:26:14.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77b0a00640 1 -- start start 2024-04-24T08:26:14.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77b0a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77ac06cbe0 0x7f77ac0b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77b0a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f77ac14c2c0 0x7f77ac152a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77b0a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ac06eb00 con 0x7f77ac06e720 2024-04-24T08:26:14.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77b0a00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f77ac14be30 con 0x7f77ac06cbe0 2024-04-24T08:26:14.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77b0a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f77ac14b7e0 con 0x7f77ac14c2c0 2024-04-24T08:26:14.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77a3e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77ac06cbe0 0x7f77ac0b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77a3e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77ac06cbe0 0x7f77ac0b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59802/0 (socket says 172.21.15.88:59802) 2024-04-24T08:26:14.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77a3e00640 1 -- 172.21.15.88:0/173730312 learned_addr learned my addr 172.21.15.88:0/173730312 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:14.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77aa800640 1 --2- 172.21.15.88:0/173730312 >> v2:172.21.15.142:3300/0 conn(0x7f77ac14c2c0 0x7f77ac152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77a3e00640 1 -- 172.21.15.88:0/173730312 >> v2:172.21.15.142:3300/0 conn(0x7f77ac14c2c0 msgr2=0x7f77ac152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:14.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77a3e00640 1 --2- 172.21.15.88:0/173730312 >> v2:172.21.15.142:3300/0 conn(0x7f77ac14c2c0 0x7f77ac152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77a3e00640 1 -- 172.21.15.88:0/173730312 >> v1:172.21.15.142:6789/0 conn(0x7f77ac06e720 legacy=0x7f77ac0b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:14.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77a3e00640 1 -- 172.21.15.88:0/173730312 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac14bac0 con 0x7f77ac06cbe0 2024-04-24T08:26:14.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.857+0000 7f77aa800640 1 --2- 172.21.15.88:0/173730312 >> v2:172.21.15.142:3300/0 conn(0x7f77ac14c2c0 0x7f77ac152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:14.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77a3e00640 1 --2- 172.21.15.88:0/173730312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ac06cbe0 0x7f77ac0b7720 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0725b0 tx=0x7f779401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2410665f5120dcc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:14.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77a9400640 1 -- 172.21.15.88:0/173730312 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77940b0070 con 0x7f77ac06cbe0 2024-04-24T08:26:14.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77a9400640 1 -- 172.21.15.88:0/173730312 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77940ab600 con 0x7f77ac06cbe0 2024-04-24T08:26:14.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77a9400640 1 -- 172.21.15.88:0/173730312 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77940ab9d0 con 0x7f77ac06cbe0 2024-04-24T08:26:14.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77b0a00640 1 -- 172.21.15.88:0/173730312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ac06cbe0 msgr2=0x7f77ac0b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77b0a00640 1 --2- 172.21.15.88:0/173730312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ac06cbe0 0x7f77ac0b7720 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0725b0 tx=0x7f779401c3c0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77b0a00640 1 -- 172.21.15.88:0/173730312 shutdown_connections 2024-04-24T08:26:14.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77b0a00640 1 --2- 172.21.15.88:0/173730312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ac06cbe0 0x7f77ac0b7720 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77b0a00640 1 --2- 172.21.15.88:0/173730312 >> v2:172.21.15.142:3300/0 conn(0x7f77ac14c2c0 0x7f77ac152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77b0a00640 1 -- 172.21.15.88:0/173730312 >> 172.21.15.88:0/173730312 conn(0x7f77ac067810 msgr2=0x7f77ac067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:14.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77b0a00640 1 -- 172.21.15.88:0/173730312 shutdown_connections 2024-04-24T08:26:14.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77b0a00640 1 -- 172.21.15.88:0/173730312 wait complete. 2024-04-24T08:26:14.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.861+0000 7f77b0a00640 1 Processor -- start 2024-04-24T08:26:14.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77b0a00640 1 -- start start 2024-04-24T08:26:14.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77b0a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ac06cbe0 0x7f77ac143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77b0a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77ac06e720 0x7f77ac0ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77b0a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77ac14c2c0 0x7f77ac144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77b0a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac155970 con 0x7f77ac06cbe0 2024-04-24T08:26:14.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77b0a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac0b7e70 con 0x7f77ac14c2c0 2024-04-24T08:26:14.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77b0a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f77ac155af0 con 0x7f77ac06e720 2024-04-24T08:26:14.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a9e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ac06cbe0 0x7f77ac143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a9e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ac06cbe0 0x7f77ac143320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59808/0 (socket says 172.21.15.88:59808) 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a9e00640 1 -- 172.21.15.88:0/3903589325 learned_addr learned my addr 172.21.15.88:0/3903589325 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a3e00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77ac06e720 0x7f77ac0ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77aa800640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77ac14c2c0 0x7f77ac144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a9e00640 1 -- 172.21.15.88:0/3903589325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77ac06e720 msgr2=0x7f77ac0ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a9e00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77ac06e720 0x7f77ac0ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a9e00640 1 -- 172.21.15.88:0/3903589325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77ac14c2c0 msgr2=0x7f77ac144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a9e00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77ac14c2c0 0x7f77ac144680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a9e00640 1 -- 172.21.15.88:0/3903589325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac0695c0 con 0x7f77ac06cbe0 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a3e00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77ac06e720 0x7f77ac0ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a9e00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ac06cbe0 0x7f77ac143320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f779c00c480 tx=0x7f779c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a2000640 1 -- 172.21.15.88:0/3903589325 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c012830 con 0x7f77ac06cbe0 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a2000640 1 -- 172.21.15.88:0/3903589325 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779c017070 con 0x7f77ac06cbe0 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77b0a00640 1 -- 172.21.15.88:0/3903589325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ac14c9f0 con 0x7f77ac06cbe0 2024-04-24T08:26:14.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a2000640 1 -- 172.21.15.88:0/3903589325 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c012c30 con 0x7f77ac06cbe0 2024-04-24T08:26:14.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77b0a00640 1 -- 172.21.15.88:0/3903589325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ac1e12e0 con 0x7f77ac06cbe0 2024-04-24T08:26:14.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77b0a00640 1 -- 172.21.15.88:0/3903589325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ac068b90 con 0x7f77ac06cbe0 2024-04-24T08:26:14.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.865+0000 7f77a2000640 1 -- 172.21.15.88:0/3903589325 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f779c01c460 con 0x7f77ac06cbe0 2024-04-24T08:26:14.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.869+0000 7f77a2000640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7788068380 0x7f778806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:14.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.869+0000 7f77a2000640 1 -- 172.21.15.88:0/3903589325 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f779c0867a0 con 0x7f77ac06cbe0 2024-04-24T08:26:14.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.869+0000 7f77a3e00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7788068380 0x7f778806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:14.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.869+0000 7f77a3e00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7788068380 0x7f778806a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f77940ad000 tx=0x7f7794008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:14.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:14.873+0000 7f77a2000640 1 -- 172.21.15.88:0/3903589325 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f779c056d50 con 0x7f77ac06cbe0 2024-04-24T08:26:15.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.029+0000 7f77b0a00640 1 -- 172.21.15.88:0/3903589325 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77ac145c60 con 0x7f7788068380 2024-04-24T08:26:15.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.037+0000 7f77a2000640 1 -- 172.21.15.88:0/3903589325 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246632 (secure 0 0 0) 0x7f77ac145c60 con 0x7f7788068380 2024-04-24T08:26:15.041 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:15.042 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:26:15.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.041+0000 7f77b0a00640 1 -- 172.21.15.88:0/3903589325 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7788068380 msgr2=0x7f778806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.041+0000 7f77b0a00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7788068380 0x7f778806a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f77940ad000 tx=0x7f7794008040 comp rx=0 tx=0).stop 2024-04-24T08:26:15.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.041+0000 7f77b0a00640 1 -- 172.21.15.88:0/3903589325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ac06cbe0 msgr2=0x7f77ac143320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.041+0000 7f77b0a00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ac06cbe0 0x7f77ac143320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f779c00c480 tx=0x7f779c00c940 comp rx=0 tx=0).stop 2024-04-24T08:26:15.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.041+0000 7f77b0a00640 1 -- 172.21.15.88:0/3903589325 shutdown_connections 2024-04-24T08:26:15.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.041+0000 7f77b0a00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f7788068380 0x7f778806a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.041+0000 7f77b0a00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77ac14c2c0 0x7f77ac144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.041+0000 7f77b0a00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77ac06e720 0x7f77ac0ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.041+0000 7f77b0a00640 1 --2- 172.21.15.88:0/3903589325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ac06cbe0 0x7f77ac143320 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.041+0000 7f77b0a00640 1 -- 172.21.15.88:0/3903589325 >> 172.21.15.88:0/3903589325 conn(0x7f77ac067810 msgr2=0x7f77ac0b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:15.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.041+0000 7f77b0a00640 1 -- 172.21.15.88:0/3903589325 shutdown_connections 2024-04-24T08:26:15.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.041+0000 7f77b0a00640 1 -- 172.21.15.88:0/3903589325 wait complete. 2024-04-24T08:26:15.060 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-24T08:26:14.997702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219552,"kb_used_data":3388,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755168,"statfs":{"total":773094113280,"available":772869292032,"internally_reserved":0,"allocated":3469312,"data_stored":2012279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001963"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.989140+0000","last_change":"2024-04-24T08:26:09.989140+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.989140+0000","last_undegraded":"2024-04-24T08:26:09.989140+0000","last_fullsized":"2024-04-24T08:26:09.989140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001542+0000","last_change":"2024-04-24T08:26:10.001542+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001542+0000","last_undegraded":"2024-04-24T08:26:10.001542+0000","last_fullsized":"2024-04-24T08:26:10.001542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.989547+0000","last_change":"2024-04-24T08:26:09.989547+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.989547+0000","last_undegraded":"2024-04-24T08:26:09.989547+0000","last_fullsized":"2024-04-24T08:26:09.989547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.000316+0000","last_change":"2024-04-24T08:26:10.000316+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.000316+0000","last_undegraded":"2024-04-24T08:26:10.000316+0000","last_fullsized":"2024-04-24T08:26:10.000316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993335+0000","last_change":"2024-04-24T08:26:09.993335+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993335+0000","last_undegraded":"2024-04-24T08:26:09.993335+0000","last_fullsized":"2024-04-24T08:26:09.993335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996148+0000","last_change":"2024-04-24T08:26:09.996148+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996148+0000","last_undegraded":"2024-04-24T08:26:09.996148+0000","last_fullsized":"2024-04-24T08:26:09.996148+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.998223+0000","last_change":"2024-04-24T08:26:09.998223+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.998223+0000","last_undegraded":"2024-04-24T08:26:09.998223+0000","last_fullsized":"2024-04-24T08:26:09.998223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.005694+0000","last_change":"2024-04-24T08:26:10.005694+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.005694+0000","last_undegraded":"2024-04-24T08:26:10.005694+0000","last_fullsized":"2024-04-24T08:26:10.005694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994611+0000","last_change":"2024-04-24T08:26:09.994611+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994611+0000","last_undegraded":"2024-04-24T08:26:09.994611+0000","last_fullsized":"2024-04-24T08:26:09.994611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001178+0000","last_change":"2024-04-24T08:26:10.001178+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001178+0000","last_undegraded":"2024-04-24T08:26:10.001178+0000","last_fullsized":"2024-04-24T08:26:10.001178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.000368+0000","last_change":"2024-04-24T08:26:10.000368+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.000368+0000","last_undegraded":"2024-04-24T08:26:10.000368+0000","last_fullsized":"2024-04-24T08:26:10.000368+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.989129+0000","last_change":"2024-04-24T08:26:09.989129+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.989129+0000","last_undegraded":"2024-04-24T08:26:09.989129+0000","last_fullsized":"2024-04-24T08:26:09.989129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992725+0000","last_change":"2024-04-24T08:26:09.992725+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992725+0000","last_undegraded":"2024-04-24T08:26:09.992725+0000","last_fullsized":"2024-04-24T08:26:09.992725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.995485+0000","last_change":"2024-04-24T08:26:09.995485+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.995485+0000","last_undegraded":"2024-04-24T08:26:09.995485+0000","last_fullsized":"2024-04-24T08:26:09.995485+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988040+0000","last_change":"2024-04-24T08:26:09.988040+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988040+0000","last_undegraded":"2024-04-24T08:26:09.988040+0000","last_fullsized":"2024-04-24T08:26:09.988040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997371+0000","last_change":"2024-04-24T08:26:09.997371+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997371+0000","last_undegraded":"2024-04-24T08:26:09.997371+0000","last_fullsized":"2024-04-24T08:26:09.997371+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.003109+0000","last_change":"2024-04-24T08:26:10.003109+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.003109+0000","last_undegraded":"2024-04-24T08:26:10.003109+0000","last_fullsized":"2024-04-24T08:26:10.003109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001167+0000","last_change":"2024-04-24T08:26:10.001167+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001167+0000","last_undegraded":"2024-04-24T08:26:10.001167+0000","last_fullsized":"2024-04-24T08:26:10.001167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997140+0000","last_change":"2024-04-24T08:26:09.997140+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997140+0000","last_undegraded":"2024-04-24T08:26:09.997140+0000","last_fullsized":"2024-04-24T08:26:09.997140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992158+0000","last_change":"2024-04-24T08:26:09.992158+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992158+0000","last_undegraded":"2024-04-24T08:26:09.992158+0000","last_fullsized":"2024-04-24T08:26:09.992158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997888+0000","last_change":"2024-04-24T08:26:09.997888+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997888+0000","last_undegraded":"2024-04-24T08:26:09.997888+0000","last_fullsized":"2024-04-24T08:26:09.997888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992820+0000","last_change":"2024-04-24T08:26:09.992820+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992820+0000","last_undegraded":"2024-04-24T08:26:09.992820+0000","last_fullsized":"2024-04-24T08:26:09.992820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993036+0000","last_change":"2024-04-24T08:26:09.993036+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993036+0000","last_undegraded":"2024-04-24T08:26:09.993036+0000","last_fullsized":"2024-04-24T08:26:09.993036+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988436+0000","last_change":"2024-04-24T08:26:09.988436+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988436+0000","last_undegraded":"2024-04-24T08:26:09.988436+0000","last_fullsized":"2024-04-24T08:26:09.988436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001660+0000","last_change":"2024-04-24T08:26:10.001660+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001660+0000","last_undegraded":"2024-04-24T08:26:10.001660+0000","last_fullsized":"2024-04-24T08:26:10.001660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.000817+0000","last_change":"2024-04-24T08:26:10.000817+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.000817+0000","last_undegraded":"2024-04-24T08:26:10.000817+0000","last_fullsized":"2024-04-24T08:26:10.000817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.002837+0000","last_change":"2024-04-24T08:26:10.002837+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.002837+0000","last_undegraded":"2024-04-24T08:26:10.002837+0000","last_fullsized":"2024-04-24T08:26:10.002837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988697+0000","last_change":"2024-04-24T08:26:09.988697+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988697+0000","last_undegraded":"2024-04-24T08:26:09.988697+0000","last_fullsized":"2024-04-24T08:26:09.988697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996359+0000","last_change":"2024-04-24T08:26:09.996359+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996359+0000","last_undegraded":"2024-04-24T08:26:09.996359+0000","last_fullsized":"2024-04-24T08:26:09.996359+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.004718+0000","last_change":"2024-04-24T08:26:10.004718+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.004718+0000","last_undegraded":"2024-04-24T08:26:10.004718+0000","last_fullsized":"2024-04-24T08:26:10.004718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988191+0000","last_change":"2024-04-24T08:26:09.988191+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988191+0000","last_undegraded":"2024-04-24T08:26:09.988191+0000","last_fullsized":"2024-04-24T08:26:09.988191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001488+0000","last_change":"2024-04-24T08:26:10.001488+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001488+0000","last_undegraded":"2024-04-24T08:26:10.001488+0000","last_fullsized":"2024-04-24T08:26:10.001488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994075+0000","last_change":"2024-04-24T08:26:09.994075+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994075+0000","last_undegraded":"2024-04-24T08:26:09.994075+0000","last_fullsized":"2024-04-24T08:26:09.994075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.010907+0000","last_change":"2024-04-24T08:26:10.005901+0000","last_active":"2024-04-24T08:26:10.010907+0000","last_peered":"2024-04-24T08:26:10.010907+0000","last_clean":"2024-04-24T08:26:10.010907+0000","last_became_active":"2024-04-24T08:26:10.005611+0000","last_became_peered":"2024-04-24T08:26:10.005611+0000","last_unstale":"2024-04-24T08:26:10.010907+0000","last_undegraded":"2024-04-24T08:26:10.010907+0000","last_fullsized":"2024-04-24T08:26:10.010907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.987621+0000","last_change":"2024-04-24T08:26:09.987621+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.987621+0000","last_undegraded":"2024-04-24T08:26:09.987621+0000","last_fullsized":"2024-04-24T08:26:09.987621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015491+0000","last_change":"2024-04-24T08:26:10.012103+0000","last_active":"2024-04-24T08:26:10.015491+0000","last_peered":"2024-04-24T08:26:10.015491+0000","last_clean":"2024-04-24T08:26:10.015491+0000","last_became_active":"2024-04-24T08:26:10.011846+0000","last_became_peered":"2024-04-24T08:26:10.011846+0000","last_unstale":"2024-04-24T08:26:10.015491+0000","last_undegraded":"2024-04-24T08:26:10.015491+0000","last_fullsized":"2024-04-24T08:26:10.015491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:04.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.995850+0000","last_change":"2024-04-24T08:26:09.995850+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.995850+0000","last_undegraded":"2024-04-24T08:26:09.995850+0000","last_fullsized":"2024-04-24T08:26:09.995850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016320+0000","last_change":"2024-04-24T08:26:10.013217+0000","last_active":"2024-04-24T08:26:10.016320+0000","last_peered":"2024-04-24T08:26:10.016320+0000","last_clean":"2024-04-24T08:26:10.016320+0000","last_became_active":"2024-04-24T08:26:10.012939+0000","last_became_peered":"2024-04-24T08:26:10.012939+0000","last_unstale":"2024-04-24T08:26:10.016320+0000","last_undegraded":"2024-04-24T08:26:10.016320+0000","last_fullsized":"2024-04-24T08:26:10.016320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:01:44.547438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.999811+0000","last_change":"2024-04-24T08:26:09.999811+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.999811+0000","last_undegraded":"2024-04-24T08:26:09.999811+0000","last_fullsized":"2024-04-24T08:26:09.999811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.012245+0000","last_change":"2024-04-24T08:26:10.005714+0000","last_active":"2024-04-24T08:26:10.012245+0000","last_peered":"2024-04-24T08:26:10.012245+0000","last_clean":"2024-04-24T08:26:10.012245+0000","last_became_active":"2024-04-24T08:26:10.005299+0000","last_became_peered":"2024-04-24T08:26:10.005299+0000","last_unstale":"2024-04-24T08:26:10.012245+0000","last_undegraded":"2024-04-24T08:26:10.012245+0000","last_fullsized":"2024-04-24T08:26:10.012245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:09:35.770606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997862+0000","last_change":"2024-04-24T08:26:09.997862+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997862+0000","last_undegraded":"2024-04-24T08:26:09.997862+0000","last_fullsized":"2024-04-24T08:26:09.997862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.013755+0000","last_change":"2024-04-24T08:26:10.010287+0000","last_active":"2024-04-24T08:26:10.013755+0000","last_peered":"2024-04-24T08:26:10.013755+0000","last_clean":"2024-04-24T08:26:10.013755+0000","last_became_active":"2024-04-24T08:26:10.009987+0000","last_became_peered":"2024-04-24T08:26:10.009987+0000","last_unstale":"2024-04-24T08:26:10.013755+0000","last_undegraded":"2024-04-24T08:26:10.013755+0000","last_fullsized":"2024-04-24T08:26:10.013755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:15:15.487296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988157+0000","last_change":"2024-04-24T08:26:09.988157+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988157+0000","last_undegraded":"2024-04-24T08:26:09.988157+0000","last_fullsized":"2024-04-24T08:26:09.988157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.011071+0000","last_change":"2024-04-24T08:26:10.008606+0000","last_active":"2024-04-24T08:26:10.011071+0000","last_peered":"2024-04-24T08:26:10.011071+0000","last_clean":"2024-04-24T08:26:10.011071+0000","last_became_active":"2024-04-24T08:26:10.008258+0000","last_became_peered":"2024-04-24T08:26:10.008258+0000","last_unstale":"2024-04-24T08:26:10.011071+0000","last_undegraded":"2024-04-24T08:26:10.011071+0000","last_fullsized":"2024-04-24T08:26:10.011071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:51.723825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993839+0000","last_change":"2024-04-24T08:26:09.993839+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993839+0000","last_undegraded":"2024-04-24T08:26:09.993839+0000","last_fullsized":"2024-04-24T08:26:09.993839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.010113+0000","last_change":"2024-04-24T08:26:10.002814+0000","last_active":"2024-04-24T08:26:10.010113+0000","last_peered":"2024-04-24T08:26:10.010113+0000","last_clean":"2024-04-24T08:26:10.010113+0000","last_became_active":"2024-04-24T08:26:10.002502+0000","last_became_peered":"2024-04-24T08:26:10.002502+0000","last_unstale":"2024-04-24T08:26:10.010113+0000","last_undegraded":"2024-04-24T08:26:10.010113+0000","last_fullsized":"2024-04-24T08:26:10.010113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:45.812010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.995713+0000","last_change":"2024-04-24T08:26:09.995713+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.995713+0000","last_undegraded":"2024-04-24T08:26:09.995713+0000","last_fullsized":"2024-04-24T08:26:09.995713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.006092+0000","last_change":"2024-04-24T08:26:10.002174+0000","last_active":"2024-04-24T08:26:10.006092+0000","last_peered":"2024-04-24T08:26:10.006092+0000","last_clean":"2024-04-24T08:26:10.006092+0000","last_became_active":"2024-04-24T08:26:10.001830+0000","last_became_peered":"2024-04-24T08:26:10.001830+0000","last_unstale":"2024-04-24T08:26:10.006092+0000","last_undegraded":"2024-04-24T08:26:10.006092+0000","last_fullsized":"2024-04-24T08:26:10.006092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:55:48.686733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988552+0000","last_change":"2024-04-24T08:26:09.988552+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988552+0000","last_undegraded":"2024-04-24T08:26:09.988552+0000","last_fullsized":"2024-04-24T08:26:09.988552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016286+0000","last_change":"2024-04-24T08:26:10.013100+0000","last_active":"2024-04-24T08:26:10.016286+0000","last_peered":"2024-04-24T08:26:10.016286+0000","last_clean":"2024-04-24T08:26:10.016286+0000","last_became_active":"2024-04-24T08:26:10.012809+0000","last_became_peered":"2024-04-24T08:26:10.012809+0000","last_unstale":"2024-04-24T08:26:10.016286+0000","last_undegraded":"2024-04-24T08:26:10.016286+0000","last_fullsized":"2024-04-24T08:26:10.016286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:14:20.203803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997134+0000","last_change":"2024-04-24T08:26:09.997134+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997134+0000","last_undegraded":"2024-04-24T08:26:09.997134+0000","last_fullsized":"2024-04-24T08:26:09.997134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.014517+0000","last_change":"2024-04-24T08:26:10.011789+0000","last_active":"2024-04-24T08:26:10.014517+0000","last_peered":"2024-04-24T08:26:10.014517+0000","last_clean":"2024-04-24T08:26:10.014517+0000","last_became_active":"2024-04-24T08:26:10.011489+0000","last_became_peered":"2024-04-24T08:26:10.011489+0000","last_unstale":"2024-04-24T08:26:10.014517+0000","last_undegraded":"2024-04-24T08:26:10.014517+0000","last_fullsized":"2024-04-24T08:26:10.014517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:16.723467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994423+0000","last_change":"2024-04-24T08:26:09.994423+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994423+0000","last_undegraded":"2024-04-24T08:26:09.994423+0000","last_fullsized":"2024-04-24T08:26:09.994423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015964+0000","last_change":"2024-04-24T08:26:10.011485+0000","last_active":"2024-04-24T08:26:10.015964+0000","last_peered":"2024-04-24T08:26:10.015964+0000","last_clean":"2024-04-24T08:26:10.015964+0000","last_became_active":"2024-04-24T08:26:10.011166+0000","last_became_peered":"2024-04-24T08:26:10.011166+0000","last_unstale":"2024-04-24T08:26:10.015964+0000","last_undegraded":"2024-04-24T08:26:10.015964+0000","last_fullsized":"2024-04-24T08:26:10.015964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:30:20.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.990398+0000","last_change":"2024-04-24T08:26:09.990398+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.990398+0000","last_undegraded":"2024-04-24T08:26:09.990398+0000","last_fullsized":"2024-04-24T08:26:09.990398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016157+0000","last_change":"2024-04-24T08:26:10.011337+0000","last_active":"2024-04-24T08:26:10.016157+0000","last_peered":"2024-04-24T08:26:10.016157+0000","last_clean":"2024-04-24T08:26:10.016157+0000","last_became_active":"2024-04-24T08:26:10.010603+0000","last_became_peered":"2024-04-24T08:26:10.010603+0000","last_unstale":"2024-04-24T08:26:10.016157+0000","last_undegraded":"2024-04-24T08:26:10.016157+0000","last_fullsized":"2024-04-24T08:26:10.016157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:11:48.720898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.999314+0000","last_change":"2024-04-24T08:26:09.999314+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.999314+0000","last_undegraded":"2024-04-24T08:26:09.999314+0000","last_fullsized":"2024-04-24T08:26:09.999314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.005926+0000","last_change":"2024-04-24T08:26:10.001398+0000","last_active":"2024-04-24T08:26:10.005926+0000","last_peered":"2024-04-24T08:26:10.005926+0000","last_clean":"2024-04-24T08:26:10.005926+0000","last_became_active":"2024-04-24T08:26:10.001113+0000","last_became_peered":"2024-04-24T08:26:10.001113+0000","last_unstale":"2024-04-24T08:26:10.005926+0000","last_undegraded":"2024-04-24T08:26:10.005926+0000","last_fullsized":"2024-04-24T08:26:10.005926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:20:07.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994268+0000","last_change":"2024-04-24T08:26:09.994268+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994268+0000","last_undegraded":"2024-04-24T08:26:09.994268+0000","last_fullsized":"2024-04-24T08:26:09.994268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016340+0000","last_change":"2024-04-24T08:26:10.015151+0000","last_active":"2024-04-24T08:26:10.016340+0000","last_peered":"2024-04-24T08:26:10.016340+0000","last_clean":"2024-04-24T08:26:10.016340+0000","last_became_active":"2024-04-24T08:26:10.014720+0000","last_became_peered":"2024-04-24T08:26:10.014720+0000","last_unstale":"2024-04-24T08:26:10.016340+0000","last_undegraded":"2024-04-24T08:26:10.016340+0000","last_fullsized":"2024-04-24T08:26:10.016340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:16.723467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001133+0000","last_change":"2024-04-24T08:26:10.001133+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001133+0000","last_undegraded":"2024-04-24T08:26:10.001133+0000","last_fullsized":"2024-04-24T08:26:10.001133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.017783+0000","last_change":"2024-04-24T08:26:10.013550+0000","last_active":"2024-04-24T08:26:10.017783+0000","last_peered":"2024-04-24T08:26:10.017783+0000","last_clean":"2024-04-24T08:26:10.017783+0000","last_became_active":"2024-04-24T08:26:10.013258+0000","last_became_peered":"2024-04-24T08:26:10.013258+0000","last_unstale":"2024-04-24T08:26:10.017783+0000","last_undegraded":"2024-04-24T08:26:10.017783+0000","last_fullsized":"2024-04-24T08:26:10.017783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:30:20.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.987613+0000","last_change":"2024-04-24T08:26:09.987613+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.987613+0000","last_undegraded":"2024-04-24T08:26:09.987613+0000","last_fullsized":"2024-04-24T08:26:09.987613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.010630+0000","last_change":"2024-04-24T08:26:10.007972+0000","last_active":"2024-04-24T08:26:10.010630+0000","last_peered":"2024-04-24T08:26:10.010630+0000","last_clean":"2024-04-24T08:26:10.010630+0000","last_became_active":"2024-04-24T08:26:10.007685+0000","last_became_peered":"2024-04-24T08:26:10.007685+0000","last_unstale":"2024-04-24T08:26:10.010630+0000","last_undegraded":"2024-04-24T08:26:10.010630+0000","last_fullsized":"2024-04-24T08:26:10.010630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:23:53.043096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996807+0000","last_change":"2024-04-24T08:26:09.996807+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996807+0000","last_undegraded":"2024-04-24T08:26:09.996807+0000","last_fullsized":"2024-04-24T08:26:09.996807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.017970+0000","last_change":"2024-04-24T08:26:10.016657+0000","last_active":"2024-04-24T08:26:10.017970+0000","last_peered":"2024-04-24T08:26:10.017970+0000","last_clean":"2024-04-24T08:26:10.017970+0000","last_became_active":"2024-04-24T08:26:10.016354+0000","last_became_peered":"2024-04-24T08:26:10.016354+0000","last_unstale":"2024-04-24T08:26:10.017970+0000","last_undegraded":"2024-04-24T08:26:10.017970+0000","last_fullsized":"2024-04-24T08:26:10.017970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:04.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992534+0000","last_change":"2024-04-24T08:26:09.992534+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992534+0000","last_undegraded":"2024-04-24T08:26:09.992534+0000","last_fullsized":"2024-04-24T08:26:09.992534+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.006115+0000","last_change":"2024-04-24T08:26:10.002133+0000","last_active":"2024-04-24T08:26:10.006115+0000","last_peered":"2024-04-24T08:26:10.006115+0000","last_clean":"2024-04-24T08:26:10.006115+0000","last_became_active":"2024-04-24T08:26:10.001823+0000","last_became_peered":"2024-04-24T08:26:10.001823+0000","last_unstale":"2024-04-24T08:26:10.006115+0000","last_undegraded":"2024-04-24T08:26:10.006115+0000","last_fullsized":"2024-04-24T08:26:10.006115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:05:49.885137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.999846+0000","last_change":"2024-04-24T08:26:09.999846+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.999846+0000","last_undegraded":"2024-04-24T08:26:09.999846+0000","last_fullsized":"2024-04-24T08:26:09.999846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.013709+0000","last_change":"2024-04-24T08:26:10.009750+0000","last_active":"2024-04-24T08:26:10.013709+0000","last_peered":"2024-04-24T08:26:10.013709+0000","last_clean":"2024-04-24T08:26:10.013709+0000","last_became_active":"2024-04-24T08:26:10.009495+0000","last_became_peered":"2024-04-24T08:26:10.009495+0000","last_unstale":"2024-04-24T08:26:10.013709+0000","last_undegraded":"2024-04-24T08:26:10.013709+0000","last_fullsized":"2024-04-24T08:26:10.013709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:10:46.621628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992115+0000","last_change":"2024-04-24T08:26:09.992115+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992115+0000","last_undegraded":"2024-04-24T08:26:09.992115+0000","last_fullsized":"2024-04-24T08:26:09.992115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015858+0000","last_change":"2024-04-24T08:26:10.012977+0000","last_active":"2024-04-24T08:26:10.015858+0000","last_peered":"2024-04-24T08:26:10.015858+0000","last_clean":"2024-04-24T08:26:10.015858+0000","last_became_active":"2024-04-24T08:26:10.012687+0000","last_became_peered":"2024-04-24T08:26:10.012687+0000","last_unstale":"2024-04-24T08:26:10.015858+0000","last_undegraded":"2024-04-24T08:26:10.015858+0000","last_fullsized":"2024-04-24T08:26:10.015858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:23:23.672009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991117+0000","last_change":"2024-04-24T08:26:09.991117+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991117+0000","last_undegraded":"2024-04-24T08:26:09.991117+0000","last_fullsized":"2024-04-24T08:26:09.991117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.008963+0000","last_change":"2024-04-24T08:26:10.005338+0000","last_active":"2024-04-24T08:26:10.008963+0000","last_peered":"2024-04-24T08:26:10.008963+0000","last_clean":"2024-04-24T08:26:10.008963+0000","last_became_active":"2024-04-24T08:26:10.005060+0000","last_became_peered":"2024-04-24T08:26:10.005060+0000","last_unstale":"2024-04-24T08:26:10.008963+0000","last_undegraded":"2024-04-24T08:26:10.008963+0000","last_fullsized":"2024-04-24T08:26:10.008963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991413+0000","last_change":"2024-04-24T08:26:09.991413+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991413+0000","last_undegraded":"2024-04-24T08:26:09.991413+0000","last_fullsized":"2024-04-24T08:26:09.991413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.012942+0000","last_change":"2024-04-24T08:26:10.010459+0000","last_active":"2024-04-24T08:26:10.012942+0000","last_peered":"2024-04-24T08:26:10.012942+0000","last_clean":"2024-04-24T08:26:10.012942+0000","last_became_active":"2024-04-24T08:26:10.005710+0000","last_became_peered":"2024-04-24T08:26:10.005710+0000","last_unstale":"2024-04-24T08:26:10.012942+0000","last_undegraded":"2024-04-24T08:26:10.012942+0000","last_fullsized":"2024-04-24T08:26:10.012942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991033+0000","last_change":"2024-04-24T08:26:09.991033+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991033+0000","last_undegraded":"2024-04-24T08:26:09.991033+0000","last_fullsized":"2024-04-24T08:26:09.991033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.013572+0000","last_change":"2024-04-24T08:26:10.009111+0000","last_active":"2024-04-24T08:26:10.013572+0000","last_peered":"2024-04-24T08:26:10.013572+0000","last_clean":"2024-04-24T08:26:10.013572+0000","last_became_active":"2024-04-24T08:26:10.008830+0000","last_became_peered":"2024-04-24T08:26:10.008830+0000","last_unstale":"2024-04-24T08:26:10.013572+0000","last_undegraded":"2024-04-24T08:26:10.013572+0000","last_fullsized":"2024-04-24T08:26:10.013572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:59.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.003297+0000","last_change":"2024-04-24T08:26:10.003297+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.003297+0000","last_undegraded":"2024-04-24T08:26:10.003297+0000","last_fullsized":"2024-04-24T08:26:10.003297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015985+0000","last_change":"2024-04-24T08:26:10.011543+0000","last_active":"2024-04-24T08:26:10.015985+0000","last_peered":"2024-04-24T08:26:10.015985+0000","last_clean":"2024-04-24T08:26:10.015985+0000","last_became_active":"2024-04-24T08:26:10.011213+0000","last_became_peered":"2024-04-24T08:26:10.011213+0000","last_unstale":"2024-04-24T08:26:10.015985+0000","last_undegraded":"2024-04-24T08:26:10.015985+0000","last_fullsized":"2024-04-24T08:26:10.015985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:51:57.825752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991598+0000","last_change":"2024-04-24T08:26:09.991598+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991598+0000","last_undegraded":"2024-04-24T08:26:09.991598+0000","last_fullsized":"2024-04-24T08:26:09.991598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015668+0000","last_change":"2024-04-24T08:26:10.009102+0000","last_active":"2024-04-24T08:26:10.015668+0000","last_peered":"2024-04-24T08:26:10.015668+0000","last_clean":"2024-04-24T08:26:10.015668+0000","last_became_active":"2024-04-24T08:26:10.008736+0000","last_became_peered":"2024-04-24T08:26:10.008736+0000","last_unstale":"2024-04-24T08:26:10.015668+0000","last_undegraded":"2024-04-24T08:26:10.015668+0000","last_fullsized":"2024-04-24T08:26:10.015668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.990275+0000","last_change":"2024-04-24T08:26:09.990275+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.990275+0000","last_undegraded":"2024-04-24T08:26:09.990275+0000","last_fullsized":"2024-04-24T08:26:09.990275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.014497+0000","last_change":"2024-04-24T08:26:10.009630+0000","last_active":"2024-04-24T08:26:10.014497+0000","last_peered":"2024-04-24T08:26:10.014497+0000","last_clean":"2024-04-24T08:26:10.014497+0000","last_became_active":"2024-04-24T08:26:10.009059+0000","last_became_peered":"2024-04-24T08:26:10.009059+0000","last_unstale":"2024-04-24T08:26:10.014497+0000","last_undegraded":"2024-04-24T08:26:10.014497+0000","last_fullsized":"2024-04-24T08:26:10.014497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994586+0000","last_change":"2024-04-24T08:26:09.994586+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994586+0000","last_undegraded":"2024-04-24T08:26:09.994586+0000","last_fullsized":"2024-04-24T08:26:09.994586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.009768+0000","last_change":"2024-04-24T08:26:10.005806+0000","last_active":"2024-04-24T08:26:10.009768+0000","last_peered":"2024-04-24T08:26:10.009768+0000","last_clean":"2024-04-24T08:26:10.009768+0000","last_became_active":"2024-04-24T08:26:10.005520+0000","last_became_peered":"2024-04-24T08:26:10.005520+0000","last_unstale":"2024-04-24T08:26:10.009768+0000","last_undegraded":"2024-04-24T08:26:10.009768+0000","last_fullsized":"2024-04-24T08:26:10.009768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.987633+0000","last_change":"2024-04-24T08:26:09.987633+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.987633+0000","last_undegraded":"2024-04-24T08:26:09.987633+0000","last_fullsized":"2024-04-24T08:26:09.987633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.009382+0000","last_change":"2024-04-24T08:26:10.006176+0000","last_active":"2024-04-24T08:26:10.009382+0000","last_peered":"2024-04-24T08:26:10.009382+0000","last_clean":"2024-04-24T08:26:10.009382+0000","last_became_active":"2024-04-24T08:26:10.005931+0000","last_became_peered":"2024-04-24T08:26:10.005931+0000","last_unstale":"2024-04-24T08:26:10.009382+0000","last_undegraded":"2024-04-24T08:26:10.009382+0000","last_fullsized":"2024-04-24T08:26:10.009382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993430+0000","last_change":"2024-04-24T08:26:09.993430+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993430+0000","last_undegraded":"2024-04-24T08:26:09.993430+0000","last_fullsized":"2024-04-24T08:26:09.993430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015554+0000","last_change":"2024-04-24T08:26:10.008690+0000","last_active":"2024-04-24T08:26:10.015554+0000","last_peered":"2024-04-24T08:26:10.015554+0000","last_clean":"2024-04-24T08:26:10.015554+0000","last_became_active":"2024-04-24T08:26:10.008368+0000","last_became_peered":"2024-04-24T08:26:10.008368+0000","last_unstale":"2024-04-24T08:26:10.015554+0000","last_undegraded":"2024-04-24T08:26:10.015554+0000","last_fullsized":"2024-04-24T08:26:10.015554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994343+0000","last_change":"2024-04-24T08:26:09.994343+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994343+0000","last_undegraded":"2024-04-24T08:26:09.994343+0000","last_fullsized":"2024-04-24T08:26:09.994343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.002793+0000","last_change":"2024-04-24T08:26:09.999108+0000","last_active":"2024-04-24T08:26:10.002793+0000","last_peered":"2024-04-24T08:26:10.002793+0000","last_clean":"2024-04-24T08:26:10.002793+0000","last_became_active":"2024-04-24T08:26:09.998732+0000","last_became_peered":"2024-04-24T08:26:09.998732+0000","last_unstale":"2024-04-24T08:26:10.002793+0000","last_undegraded":"2024-04-24T08:26:10.002793+0000","last_fullsized":"2024-04-24T08:26:10.002793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:09:35.770606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996199+0000","last_change":"2024-04-24T08:26:09.996199+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996199+0000","last_undegraded":"2024-04-24T08:26:09.996199+0000","last_fullsized":"2024-04-24T08:26:09.996199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.017806+0000","last_change":"2024-04-24T08:26:10.014147+0000","last_active":"2024-04-24T08:26:10.017806+0000","last_peered":"2024-04-24T08:26:10.017806+0000","last_clean":"2024-04-24T08:26:10.017806+0000","last_became_active":"2024-04-24T08:26:10.013893+0000","last_became_peered":"2024-04-24T08:26:10.013893+0000","last_unstale":"2024-04-24T08:26:10.017806+0000","last_undegraded":"2024-04-24T08:26:10.017806+0000","last_fullsized":"2024-04-24T08:26:10.017806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:51:57.825752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997779+0000","last_change":"2024-04-24T08:26:09.997779+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997779+0000","last_undegraded":"2024-04-24T08:26:09.997779+0000","last_fullsized":"2024-04-24T08:26:09.997779+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.011350+0000","last_change":"2024-04-24T08:26:10.004578+0000","last_active":"2024-04-24T08:26:10.011350+0000","last_peered":"2024-04-24T08:26:10.011350+0000","last_clean":"2024-04-24T08:26:10.011350+0000","last_became_active":"2024-04-24T08:26:10.004401+0000","last_became_peered":"2024-04-24T08:26:10.004401+0000","last_unstale":"2024-04-24T08:26:10.011350+0000","last_undegraded":"2024-04-24T08:26:10.011350+0000","last_fullsized":"2024-04-24T08:26:10.011350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.008124+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:26:10.008124+0000","last_peered":"2024-04-24T08:26:10.008124+0000","last_clean":"2024-04-24T08:26:10.008124+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:26:10.008124+0000","last_undegraded":"2024-04-24T08:26:10.008124+0000","last_fullsized":"2024-04-24T08:26:10.008124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":695038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":689221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:26:15.064 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:26:15.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30bca00640 1 Processor -- start 2024-04-24T08:26:15.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30bca00640 1 -- start start 2024-04-24T08:26:15.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30bca00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f30b806d470 0x7f30b8144b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30bca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b80b3e20 0x7f30b80afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30bca00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b81450d0 con 0x7f30b809cc40 2024-04-24T08:26:15.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30bca00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f30b80b5b40 con 0x7f30b806d470 2024-04-24T08:26:15.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30bca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f30b8144700 con 0x7f30b80b3e20 2024-04-24T08:26:15.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30b5e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f30b806d470 0x7f30b8144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30b5e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f30b806d470 0x7f30b8144b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:42252/0 (socket says 172.21.15.88:42252) 2024-04-24T08:26:15.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30b5e00640 1 -- 172.21.15.88:0/1371637109 learned_addr learned my addr 172.21.15.88:0/1371637109 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:15.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30b6800640 1 --1- 172.21.15.88:0/1371637109 >> v1:172.21.15.142:6789/0 conn(0x7f30b809cc40 0x7f30b81476f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:35406/0 (socket says 172.21.15.88:35406) 2024-04-24T08:26:15.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30b5400640 1 --2- 172.21.15.88:0/1371637109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b80b3e20 0x7f30b80afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30b5e00640 1 -- 172.21.15.88:0/1371637109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b80b3e20 msgr2=0x7f30b80afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:15.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.237+0000 7f30b5e00640 1 --2- 172.21.15.88:0/1371637109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b80b3e20 0x7f30b80afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30b5e00640 1 -- 172.21.15.88:0/1371637109 >> v1:172.21.15.142:6789/0 conn(0x7f30b809cc40 legacy=0x7f30b81476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30b5e00640 1 -- 172.21.15.88:0/1371637109 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b8144390 con 0x7f30b806d470 2024-04-24T08:26:15.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30b4a00640 1 -- 172.21.15.88:0/1371637109 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520089058 0 0) 0x7f30b81450d0 con 0x7f30b809cc40 2024-04-24T08:26:15.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30b5400640 1 --2- 172.21.15.88:0/1371637109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b80b3e20 0x7f30b80afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:26:15.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30b5e00640 1 --2- 172.21.15.88:0/1371637109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b806d470 0x7f30b8144b90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009e50 tx=0x7f30a801c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5affdedbbd026389 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:15.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30b4a00640 1 -- 172.21.15.88:0/1371637109 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a80a5550 con 0x7f30b806d470 2024-04-24T08:26:15.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30b4a00640 1 -- 172.21.15.88:0/1371637109 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a80a56f0 con 0x7f30b806d470 2024-04-24T08:26:15.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30b4a00640 1 -- 172.21.15.88:0/1371637109 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a80a5ac0 con 0x7f30b806d470 2024-04-24T08:26:15.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30bca00640 1 -- 172.21.15.88:0/1371637109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b806d470 msgr2=0x7f30b8144b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30bca00640 1 --2- 172.21.15.88:0/1371637109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b806d470 0x7f30b8144b90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009e50 tx=0x7f30a801c910 comp rx=0 tx=0).stop 2024-04-24T08:26:15.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30bca00640 1 -- 172.21.15.88:0/1371637109 shutdown_connections 2024-04-24T08:26:15.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30bca00640 1 --2- 172.21.15.88:0/1371637109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b80b3e20 0x7f30b80afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30bca00640 1 --2- 172.21.15.88:0/1371637109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b806d470 0x7f30b8144b90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30bca00640 1 -- 172.21.15.88:0/1371637109 >> 172.21.15.88:0/1371637109 conn(0x7f30b806c0d0 msgr2=0x7f30b80b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:15.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30bca00640 1 -- 172.21.15.88:0/1371637109 shutdown_connections 2024-04-24T08:26:15.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.241+0000 7f30bca00640 1 -- 172.21.15.88:0/1371637109 wait complete. 2024-04-24T08:26:15.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30bca00640 1 Processor -- start 2024-04-24T08:26:15.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30bca00640 1 -- start start 2024-04-24T08:26:15.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30bca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b806d470 0x7f30b8072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30bca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b809cc40 0x7f30b81452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30bca00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b80b3e20 0x7f30b81404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30bca00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f30b8148190 con 0x7f30b80b3e20 2024-04-24T08:26:15.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30bca00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f30b8148010 con 0x7f30b806d470 2024-04-24T08:26:15.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30bca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f30b8148310 con 0x7f30b809cc40 2024-04-24T08:26:15.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30b6800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b80b3e20 0x7f30b81404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30b6800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b80b3e20 0x7f30b81404a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59814/0 (socket says 172.21.15.88:59814) 2024-04-24T08:26:15.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30b6800640 1 -- 172.21.15.88:0/2511263654 learned_addr learned my addr 172.21.15.88:0/2511263654 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:15.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30b5e00640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b806d470 0x7f30b8072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30b5400640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b809cc40 0x7f30b81452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30b6800640 1 -- 172.21.15.88:0/2511263654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b809cc40 msgr2=0x7f30b81452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30b6800640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b809cc40 0x7f30b81452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30b6800640 1 -- 172.21.15.88:0/2511263654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b806d470 msgr2=0x7f30b8072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30b6800640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b806d470 0x7f30b8072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30b6800640 1 -- 172.21.15.88:0/2511263654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b80b0820 con 0x7f30b80b3e20 2024-04-24T08:26:15.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30b6800640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b80b3e20 0x7f30b81404a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f30b000c480 tx=0x7f30b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:15.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30ae000640 1 -- 172.21.15.88:0/2511263654 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0018070 con 0x7f30b80b3e20 2024-04-24T08:26:15.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30ae000640 1 -- 172.21.15.88:0/2511263654 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b00074e0 con 0x7f30b80b3e20 2024-04-24T08:26:15.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30ae000640 1 -- 172.21.15.88:0/2511263654 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0004a30 con 0x7f30b80b3e20 2024-04-24T08:26:15.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30bca00640 1 -- 172.21.15.88:0/2511263654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b8070f10 con 0x7f30b80b3e20 2024-04-24T08:26:15.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.245+0000 7f30bca00640 1 -- 172.21.15.88:0/2511263654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b8147170 con 0x7f30b80b3e20 2024-04-24T08:26:15.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.249+0000 7f30bca00640 1 -- 172.21.15.88:0/2511263654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b8068b90 con 0x7f30b80b3e20 2024-04-24T08:26:15.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.249+0000 7f30ae000640 1 -- 172.21.15.88:0/2511263654 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f30b001b070 con 0x7f30b80b3e20 2024-04-24T08:26:15.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.249+0000 7f30ae000640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3098068380 0x7f309806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.249+0000 7f30ae000640 1 -- 172.21.15.88:0/2511263654 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f30b0085c80 con 0x7f30b80b3e20 2024-04-24T08:26:15.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.249+0000 7f30b5e00640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3098068380 0x7f309806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.249+0000 7f30b5e00640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3098068380 0x7f309806a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f30a80ae000 tx=0x7f30a80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:15.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.253+0000 7f30ae000640 1 -- 172.21.15.88:0/2511263654 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f30b0055b50 con 0x7f30b80b3e20 2024-04-24T08:26:15.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.405+0000 7f30bca00640 1 -- 172.21.15.88:0/2511263654 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30b8141b90 con 0x7f3098068380 2024-04-24T08:26:15.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30ae000640 1 -- 172.21.15.88:0/2511263654 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246632 (secure 0 0 0) 0x7f30b8141b90 con 0x7f3098068380 2024-04-24T08:26:15.416 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:15.418 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:26:15.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30bca00640 1 -- 172.21.15.88:0/2511263654 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3098068380 msgr2=0x7f309806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30bca00640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3098068380 0x7f309806a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f30a80ae000 tx=0x7f30a80a7070 comp rx=0 tx=0).stop 2024-04-24T08:26:15.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30bca00640 1 -- 172.21.15.88:0/2511263654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b80b3e20 msgr2=0x7f30b81404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30bca00640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b80b3e20 0x7f30b81404a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f30b000c480 tx=0x7f30b000c940 comp rx=0 tx=0).stop 2024-04-24T08:26:15.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30bca00640 1 -- 172.21.15.88:0/2511263654 shutdown_connections 2024-04-24T08:26:15.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30bca00640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3098068380 0x7f309806a840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30bca00640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b80b3e20 0x7f30b81404a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30bca00640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b809cc40 0x7f30b81452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30bca00640 1 --2- 172.21.15.88:0/2511263654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b806d470 0x7f30b8072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30bca00640 1 -- 172.21.15.88:0/2511263654 >> 172.21.15.88:0/2511263654 conn(0x7f30b806c0d0 msgr2=0x7f30b80aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:15.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30bca00640 1 -- 172.21.15.88:0/2511263654 shutdown_connections 2024-04-24T08:26:15.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.413+0000 7f30bca00640 1 -- 172.21.15.88:0/2511263654 wait complete. 2024-04-24T08:26:15.436 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-24T08:26:14.997702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219552,"kb_used_data":3388,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755168,"statfs":{"total":773094113280,"available":772869292032,"internally_reserved":0,"allocated":3469312,"data_stored":2012279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001963"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.989140+0000","last_change":"2024-04-24T08:26:09.989140+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.989140+0000","last_undegraded":"2024-04-24T08:26:09.989140+0000","last_fullsized":"2024-04-24T08:26:09.989140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001542+0000","last_change":"2024-04-24T08:26:10.001542+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001542+0000","last_undegraded":"2024-04-24T08:26:10.001542+0000","last_fullsized":"2024-04-24T08:26:10.001542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.989547+0000","last_change":"2024-04-24T08:26:09.989547+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.989547+0000","last_undegraded":"2024-04-24T08:26:09.989547+0000","last_fullsized":"2024-04-24T08:26:09.989547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.000316+0000","last_change":"2024-04-24T08:26:10.000316+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.000316+0000","last_undegraded":"2024-04-24T08:26:10.000316+0000","last_fullsized":"2024-04-24T08:26:10.000316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993335+0000","last_change":"2024-04-24T08:26:09.993335+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993335+0000","last_undegraded":"2024-04-24T08:26:09.993335+0000","last_fullsized":"2024-04-24T08:26:09.993335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996148+0000","last_change":"2024-04-24T08:26:09.996148+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996148+0000","last_undegraded":"2024-04-24T08:26:09.996148+0000","last_fullsized":"2024-04-24T08:26:09.996148+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.998223+0000","last_change":"2024-04-24T08:26:09.998223+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.998223+0000","last_undegraded":"2024-04-24T08:26:09.998223+0000","last_fullsized":"2024-04-24T08:26:09.998223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.005694+0000","last_change":"2024-04-24T08:26:10.005694+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.005694+0000","last_undegraded":"2024-04-24T08:26:10.005694+0000","last_fullsized":"2024-04-24T08:26:10.005694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994611+0000","last_change":"2024-04-24T08:26:09.994611+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994611+0000","last_undegraded":"2024-04-24T08:26:09.994611+0000","last_fullsized":"2024-04-24T08:26:09.994611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001178+0000","last_change":"2024-04-24T08:26:10.001178+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001178+0000","last_undegraded":"2024-04-24T08:26:10.001178+0000","last_fullsized":"2024-04-24T08:26:10.001178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.000368+0000","last_change":"2024-04-24T08:26:10.000368+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.000368+0000","last_undegraded":"2024-04-24T08:26:10.000368+0000","last_fullsized":"2024-04-24T08:26:10.000368+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.989129+0000","last_change":"2024-04-24T08:26:09.989129+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.989129+0000","last_undegraded":"2024-04-24T08:26:09.989129+0000","last_fullsized":"2024-04-24T08:26:09.989129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992725+0000","last_change":"2024-04-24T08:26:09.992725+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992725+0000","last_undegraded":"2024-04-24T08:26:09.992725+0000","last_fullsized":"2024-04-24T08:26:09.992725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.995485+0000","last_change":"2024-04-24T08:26:09.995485+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.995485+0000","last_undegraded":"2024-04-24T08:26:09.995485+0000","last_fullsized":"2024-04-24T08:26:09.995485+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988040+0000","last_change":"2024-04-24T08:26:09.988040+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988040+0000","last_undegraded":"2024-04-24T08:26:09.988040+0000","last_fullsized":"2024-04-24T08:26:09.988040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997371+0000","last_change":"2024-04-24T08:26:09.997371+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997371+0000","last_undegraded":"2024-04-24T08:26:09.997371+0000","last_fullsized":"2024-04-24T08:26:09.997371+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.003109+0000","last_change":"2024-04-24T08:26:10.003109+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.003109+0000","last_undegraded":"2024-04-24T08:26:10.003109+0000","last_fullsized":"2024-04-24T08:26:10.003109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001167+0000","last_change":"2024-04-24T08:26:10.001167+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001167+0000","last_undegraded":"2024-04-24T08:26:10.001167+0000","last_fullsized":"2024-04-24T08:26:10.001167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997140+0000","last_change":"2024-04-24T08:26:09.997140+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997140+0000","last_undegraded":"2024-04-24T08:26:09.997140+0000","last_fullsized":"2024-04-24T08:26:09.997140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992158+0000","last_change":"2024-04-24T08:26:09.992158+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992158+0000","last_undegraded":"2024-04-24T08:26:09.992158+0000","last_fullsized":"2024-04-24T08:26:09.992158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997888+0000","last_change":"2024-04-24T08:26:09.997888+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997888+0000","last_undegraded":"2024-04-24T08:26:09.997888+0000","last_fullsized":"2024-04-24T08:26:09.997888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992820+0000","last_change":"2024-04-24T08:26:09.992820+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992820+0000","last_undegraded":"2024-04-24T08:26:09.992820+0000","last_fullsized":"2024-04-24T08:26:09.992820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993036+0000","last_change":"2024-04-24T08:26:09.993036+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993036+0000","last_undegraded":"2024-04-24T08:26:09.993036+0000","last_fullsized":"2024-04-24T08:26:09.993036+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988436+0000","last_change":"2024-04-24T08:26:09.988436+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988436+0000","last_undegraded":"2024-04-24T08:26:09.988436+0000","last_fullsized":"2024-04-24T08:26:09.988436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001660+0000","last_change":"2024-04-24T08:26:10.001660+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001660+0000","last_undegraded":"2024-04-24T08:26:10.001660+0000","last_fullsized":"2024-04-24T08:26:10.001660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.000817+0000","last_change":"2024-04-24T08:26:10.000817+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.000817+0000","last_undegraded":"2024-04-24T08:26:10.000817+0000","last_fullsized":"2024-04-24T08:26:10.000817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.002837+0000","last_change":"2024-04-24T08:26:10.002837+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.002837+0000","last_undegraded":"2024-04-24T08:26:10.002837+0000","last_fullsized":"2024-04-24T08:26:10.002837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988697+0000","last_change":"2024-04-24T08:26:09.988697+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988697+0000","last_undegraded":"2024-04-24T08:26:09.988697+0000","last_fullsized":"2024-04-24T08:26:09.988697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996359+0000","last_change":"2024-04-24T08:26:09.996359+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996359+0000","last_undegraded":"2024-04-24T08:26:09.996359+0000","last_fullsized":"2024-04-24T08:26:09.996359+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.004718+0000","last_change":"2024-04-24T08:26:10.004718+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.004718+0000","last_undegraded":"2024-04-24T08:26:10.004718+0000","last_fullsized":"2024-04-24T08:26:10.004718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988191+0000","last_change":"2024-04-24T08:26:09.988191+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988191+0000","last_undegraded":"2024-04-24T08:26:09.988191+0000","last_fullsized":"2024-04-24T08:26:09.988191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001488+0000","last_change":"2024-04-24T08:26:10.001488+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001488+0000","last_undegraded":"2024-04-24T08:26:10.001488+0000","last_fullsized":"2024-04-24T08:26:10.001488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994075+0000","last_change":"2024-04-24T08:26:09.994075+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994075+0000","last_undegraded":"2024-04-24T08:26:09.994075+0000","last_fullsized":"2024-04-24T08:26:09.994075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.010907+0000","last_change":"2024-04-24T08:26:10.005901+0000","last_active":"2024-04-24T08:26:10.010907+0000","last_peered":"2024-04-24T08:26:10.010907+0000","last_clean":"2024-04-24T08:26:10.010907+0000","last_became_active":"2024-04-24T08:26:10.005611+0000","last_became_peered":"2024-04-24T08:26:10.005611+0000","last_unstale":"2024-04-24T08:26:10.010907+0000","last_undegraded":"2024-04-24T08:26:10.010907+0000","last_fullsized":"2024-04-24T08:26:10.010907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.987621+0000","last_change":"2024-04-24T08:26:09.987621+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.987621+0000","last_undegraded":"2024-04-24T08:26:09.987621+0000","last_fullsized":"2024-04-24T08:26:09.987621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015491+0000","last_change":"2024-04-24T08:26:10.012103+0000","last_active":"2024-04-24T08:26:10.015491+0000","last_peered":"2024-04-24T08:26:10.015491+0000","last_clean":"2024-04-24T08:26:10.015491+0000","last_became_active":"2024-04-24T08:26:10.011846+0000","last_became_peered":"2024-04-24T08:26:10.011846+0000","last_unstale":"2024-04-24T08:26:10.015491+0000","last_undegraded":"2024-04-24T08:26:10.015491+0000","last_fullsized":"2024-04-24T08:26:10.015491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:04.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.995850+0000","last_change":"2024-04-24T08:26:09.995850+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.995850+0000","last_undegraded":"2024-04-24T08:26:09.995850+0000","last_fullsized":"2024-04-24T08:26:09.995850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016320+0000","last_change":"2024-04-24T08:26:10.013217+0000","last_active":"2024-04-24T08:26:10.016320+0000","last_peered":"2024-04-24T08:26:10.016320+0000","last_clean":"2024-04-24T08:26:10.016320+0000","last_became_active":"2024-04-24T08:26:10.012939+0000","last_became_peered":"2024-04-24T08:26:10.012939+0000","last_unstale":"2024-04-24T08:26:10.016320+0000","last_undegraded":"2024-04-24T08:26:10.016320+0000","last_fullsized":"2024-04-24T08:26:10.016320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:01:44.547438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.999811+0000","last_change":"2024-04-24T08:26:09.999811+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.999811+0000","last_undegraded":"2024-04-24T08:26:09.999811+0000","last_fullsized":"2024-04-24T08:26:09.999811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.012245+0000","last_change":"2024-04-24T08:26:10.005714+0000","last_active":"2024-04-24T08:26:10.012245+0000","last_peered":"2024-04-24T08:26:10.012245+0000","last_clean":"2024-04-24T08:26:10.012245+0000","last_became_active":"2024-04-24T08:26:10.005299+0000","last_became_peered":"2024-04-24T08:26:10.005299+0000","last_unstale":"2024-04-24T08:26:10.012245+0000","last_undegraded":"2024-04-24T08:26:10.012245+0000","last_fullsized":"2024-04-24T08:26:10.012245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:09:35.770606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997862+0000","last_change":"2024-04-24T08:26:09.997862+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997862+0000","last_undegraded":"2024-04-24T08:26:09.997862+0000","last_fullsized":"2024-04-24T08:26:09.997862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.013755+0000","last_change":"2024-04-24T08:26:10.010287+0000","last_active":"2024-04-24T08:26:10.013755+0000","last_peered":"2024-04-24T08:26:10.013755+0000","last_clean":"2024-04-24T08:26:10.013755+0000","last_became_active":"2024-04-24T08:26:10.009987+0000","last_became_peered":"2024-04-24T08:26:10.009987+0000","last_unstale":"2024-04-24T08:26:10.013755+0000","last_undegraded":"2024-04-24T08:26:10.013755+0000","last_fullsized":"2024-04-24T08:26:10.013755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:15:15.487296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988157+0000","last_change":"2024-04-24T08:26:09.988157+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988157+0000","last_undegraded":"2024-04-24T08:26:09.988157+0000","last_fullsized":"2024-04-24T08:26:09.988157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.011071+0000","last_change":"2024-04-24T08:26:10.008606+0000","last_active":"2024-04-24T08:26:10.011071+0000","last_peered":"2024-04-24T08:26:10.011071+0000","last_clean":"2024-04-24T08:26:10.011071+0000","last_became_active":"2024-04-24T08:26:10.008258+0000","last_became_peered":"2024-04-24T08:26:10.008258+0000","last_unstale":"2024-04-24T08:26:10.011071+0000","last_undegraded":"2024-04-24T08:26:10.011071+0000","last_fullsized":"2024-04-24T08:26:10.011071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:51.723825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993839+0000","last_change":"2024-04-24T08:26:09.993839+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993839+0000","last_undegraded":"2024-04-24T08:26:09.993839+0000","last_fullsized":"2024-04-24T08:26:09.993839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.010113+0000","last_change":"2024-04-24T08:26:10.002814+0000","last_active":"2024-04-24T08:26:10.010113+0000","last_peered":"2024-04-24T08:26:10.010113+0000","last_clean":"2024-04-24T08:26:10.010113+0000","last_became_active":"2024-04-24T08:26:10.002502+0000","last_became_peered":"2024-04-24T08:26:10.002502+0000","last_unstale":"2024-04-24T08:26:10.010113+0000","last_undegraded":"2024-04-24T08:26:10.010113+0000","last_fullsized":"2024-04-24T08:26:10.010113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:45.812010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.995713+0000","last_change":"2024-04-24T08:26:09.995713+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.995713+0000","last_undegraded":"2024-04-24T08:26:09.995713+0000","last_fullsized":"2024-04-24T08:26:09.995713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.006092+0000","last_change":"2024-04-24T08:26:10.002174+0000","last_active":"2024-04-24T08:26:10.006092+0000","last_peered":"2024-04-24T08:26:10.006092+0000","last_clean":"2024-04-24T08:26:10.006092+0000","last_became_active":"2024-04-24T08:26:10.001830+0000","last_became_peered":"2024-04-24T08:26:10.001830+0000","last_unstale":"2024-04-24T08:26:10.006092+0000","last_undegraded":"2024-04-24T08:26:10.006092+0000","last_fullsized":"2024-04-24T08:26:10.006092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:55:48.686733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988552+0000","last_change":"2024-04-24T08:26:09.988552+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988552+0000","last_undegraded":"2024-04-24T08:26:09.988552+0000","last_fullsized":"2024-04-24T08:26:09.988552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016286+0000","last_change":"2024-04-24T08:26:10.013100+0000","last_active":"2024-04-24T08:26:10.016286+0000","last_peered":"2024-04-24T08:26:10.016286+0000","last_clean":"2024-04-24T08:26:10.016286+0000","last_became_active":"2024-04-24T08:26:10.012809+0000","last_became_peered":"2024-04-24T08:26:10.012809+0000","last_unstale":"2024-04-24T08:26:10.016286+0000","last_undegraded":"2024-04-24T08:26:10.016286+0000","last_fullsized":"2024-04-24T08:26:10.016286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:14:20.203803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997134+0000","last_change":"2024-04-24T08:26:09.997134+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997134+0000","last_undegraded":"2024-04-24T08:26:09.997134+0000","last_fullsized":"2024-04-24T08:26:09.997134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.014517+0000","last_change":"2024-04-24T08:26:10.011789+0000","last_active":"2024-04-24T08:26:10.014517+0000","last_peered":"2024-04-24T08:26:10.014517+0000","last_clean":"2024-04-24T08:26:10.014517+0000","last_became_active":"2024-04-24T08:26:10.011489+0000","last_became_peered":"2024-04-24T08:26:10.011489+0000","last_unstale":"2024-04-24T08:26:10.014517+0000","last_undegraded":"2024-04-24T08:26:10.014517+0000","last_fullsized":"2024-04-24T08:26:10.014517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:16.723467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994423+0000","last_change":"2024-04-24T08:26:09.994423+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994423+0000","last_undegraded":"2024-04-24T08:26:09.994423+0000","last_fullsized":"2024-04-24T08:26:09.994423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015964+0000","last_change":"2024-04-24T08:26:10.011485+0000","last_active":"2024-04-24T08:26:10.015964+0000","last_peered":"2024-04-24T08:26:10.015964+0000","last_clean":"2024-04-24T08:26:10.015964+0000","last_became_active":"2024-04-24T08:26:10.011166+0000","last_became_peered":"2024-04-24T08:26:10.011166+0000","last_unstale":"2024-04-24T08:26:10.015964+0000","last_undegraded":"2024-04-24T08:26:10.015964+0000","last_fullsized":"2024-04-24T08:26:10.015964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:30:20.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.990398+0000","last_change":"2024-04-24T08:26:09.990398+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.990398+0000","last_undegraded":"2024-04-24T08:26:09.990398+0000","last_fullsized":"2024-04-24T08:26:09.990398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016157+0000","last_change":"2024-04-24T08:26:10.011337+0000","last_active":"2024-04-24T08:26:10.016157+0000","last_peered":"2024-04-24T08:26:10.016157+0000","last_clean":"2024-04-24T08:26:10.016157+0000","last_became_active":"2024-04-24T08:26:10.010603+0000","last_became_peered":"2024-04-24T08:26:10.010603+0000","last_unstale":"2024-04-24T08:26:10.016157+0000","last_undegraded":"2024-04-24T08:26:10.016157+0000","last_fullsized":"2024-04-24T08:26:10.016157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:11:48.720898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.999314+0000","last_change":"2024-04-24T08:26:09.999314+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.999314+0000","last_undegraded":"2024-04-24T08:26:09.999314+0000","last_fullsized":"2024-04-24T08:26:09.999314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.005926+0000","last_change":"2024-04-24T08:26:10.001398+0000","last_active":"2024-04-24T08:26:10.005926+0000","last_peered":"2024-04-24T08:26:10.005926+0000","last_clean":"2024-04-24T08:26:10.005926+0000","last_became_active":"2024-04-24T08:26:10.001113+0000","last_became_peered":"2024-04-24T08:26:10.001113+0000","last_unstale":"2024-04-24T08:26:10.005926+0000","last_undegraded":"2024-04-24T08:26:10.005926+0000","last_fullsized":"2024-04-24T08:26:10.005926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:20:07.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994268+0000","last_change":"2024-04-24T08:26:09.994268+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994268+0000","last_undegraded":"2024-04-24T08:26:09.994268+0000","last_fullsized":"2024-04-24T08:26:09.994268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016340+0000","last_change":"2024-04-24T08:26:10.015151+0000","last_active":"2024-04-24T08:26:10.016340+0000","last_peered":"2024-04-24T08:26:10.016340+0000","last_clean":"2024-04-24T08:26:10.016340+0000","last_became_active":"2024-04-24T08:26:10.014720+0000","last_became_peered":"2024-04-24T08:26:10.014720+0000","last_unstale":"2024-04-24T08:26:10.016340+0000","last_undegraded":"2024-04-24T08:26:10.016340+0000","last_fullsized":"2024-04-24T08:26:10.016340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:16.723467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001133+0000","last_change":"2024-04-24T08:26:10.001133+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001133+0000","last_undegraded":"2024-04-24T08:26:10.001133+0000","last_fullsized":"2024-04-24T08:26:10.001133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.017783+0000","last_change":"2024-04-24T08:26:10.013550+0000","last_active":"2024-04-24T08:26:10.017783+0000","last_peered":"2024-04-24T08:26:10.017783+0000","last_clean":"2024-04-24T08:26:10.017783+0000","last_became_active":"2024-04-24T08:26:10.013258+0000","last_became_peered":"2024-04-24T08:26:10.013258+0000","last_unstale":"2024-04-24T08:26:10.017783+0000","last_undegraded":"2024-04-24T08:26:10.017783+0000","last_fullsized":"2024-04-24T08:26:10.017783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:30:20.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.987613+0000","last_change":"2024-04-24T08:26:09.987613+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.987613+0000","last_undegraded":"2024-04-24T08:26:09.987613+0000","last_fullsized":"2024-04-24T08:26:09.987613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.010630+0000","last_change":"2024-04-24T08:26:10.007972+0000","last_active":"2024-04-24T08:26:10.010630+0000","last_peered":"2024-04-24T08:26:10.010630+0000","last_clean":"2024-04-24T08:26:10.010630+0000","last_became_active":"2024-04-24T08:26:10.007685+0000","last_became_peered":"2024-04-24T08:26:10.007685+0000","last_unstale":"2024-04-24T08:26:10.010630+0000","last_undegraded":"2024-04-24T08:26:10.010630+0000","last_fullsized":"2024-04-24T08:26:10.010630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:23:53.043096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996807+0000","last_change":"2024-04-24T08:26:09.996807+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996807+0000","last_undegraded":"2024-04-24T08:26:09.996807+0000","last_fullsized":"2024-04-24T08:26:09.996807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.017970+0000","last_change":"2024-04-24T08:26:10.016657+0000","last_active":"2024-04-24T08:26:10.017970+0000","last_peered":"2024-04-24T08:26:10.017970+0000","last_clean":"2024-04-24T08:26:10.017970+0000","last_became_active":"2024-04-24T08:26:10.016354+0000","last_became_peered":"2024-04-24T08:26:10.016354+0000","last_unstale":"2024-04-24T08:26:10.017970+0000","last_undegraded":"2024-04-24T08:26:10.017970+0000","last_fullsized":"2024-04-24T08:26:10.017970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:04.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992534+0000","last_change":"2024-04-24T08:26:09.992534+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992534+0000","last_undegraded":"2024-04-24T08:26:09.992534+0000","last_fullsized":"2024-04-24T08:26:09.992534+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.006115+0000","last_change":"2024-04-24T08:26:10.002133+0000","last_active":"2024-04-24T08:26:10.006115+0000","last_peered":"2024-04-24T08:26:10.006115+0000","last_clean":"2024-04-24T08:26:10.006115+0000","last_became_active":"2024-04-24T08:26:10.001823+0000","last_became_peered":"2024-04-24T08:26:10.001823+0000","last_unstale":"2024-04-24T08:26:10.006115+0000","last_undegraded":"2024-04-24T08:26:10.006115+0000","last_fullsized":"2024-04-24T08:26:10.006115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:05:49.885137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.999846+0000","last_change":"2024-04-24T08:26:09.999846+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.999846+0000","last_undegraded":"2024-04-24T08:26:09.999846+0000","last_fullsized":"2024-04-24T08:26:09.999846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.013709+0000","last_change":"2024-04-24T08:26:10.009750+0000","last_active":"2024-04-24T08:26:10.013709+0000","last_peered":"2024-04-24T08:26:10.013709+0000","last_clean":"2024-04-24T08:26:10.013709+0000","last_became_active":"2024-04-24T08:26:10.009495+0000","last_became_peered":"2024-04-24T08:26:10.009495+0000","last_unstale":"2024-04-24T08:26:10.013709+0000","last_undegraded":"2024-04-24T08:26:10.013709+0000","last_fullsized":"2024-04-24T08:26:10.013709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:10:46.621628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992115+0000","last_change":"2024-04-24T08:26:09.992115+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992115+0000","last_undegraded":"2024-04-24T08:26:09.992115+0000","last_fullsized":"2024-04-24T08:26:09.992115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015858+0000","last_change":"2024-04-24T08:26:10.012977+0000","last_active":"2024-04-24T08:26:10.015858+0000","last_peered":"2024-04-24T08:26:10.015858+0000","last_clean":"2024-04-24T08:26:10.015858+0000","last_became_active":"2024-04-24T08:26:10.012687+0000","last_became_peered":"2024-04-24T08:26:10.012687+0000","last_unstale":"2024-04-24T08:26:10.015858+0000","last_undegraded":"2024-04-24T08:26:10.015858+0000","last_fullsized":"2024-04-24T08:26:10.015858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:23:23.672009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991117+0000","last_change":"2024-04-24T08:26:09.991117+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991117+0000","last_undegraded":"2024-04-24T08:26:09.991117+0000","last_fullsized":"2024-04-24T08:26:09.991117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.008963+0000","last_change":"2024-04-24T08:26:10.005338+0000","last_active":"2024-04-24T08:26:10.008963+0000","last_peered":"2024-04-24T08:26:10.008963+0000","last_clean":"2024-04-24T08:26:10.008963+0000","last_became_active":"2024-04-24T08:26:10.005060+0000","last_became_peered":"2024-04-24T08:26:10.005060+0000","last_unstale":"2024-04-24T08:26:10.008963+0000","last_undegraded":"2024-04-24T08:26:10.008963+0000","last_fullsized":"2024-04-24T08:26:10.008963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991413+0000","last_change":"2024-04-24T08:26:09.991413+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991413+0000","last_undegraded":"2024-04-24T08:26:09.991413+0000","last_fullsized":"2024-04-24T08:26:09.991413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.012942+0000","last_change":"2024-04-24T08:26:10.010459+0000","last_active":"2024-04-24T08:26:10.012942+0000","last_peered":"2024-04-24T08:26:10.012942+0000","last_clean":"2024-04-24T08:26:10.012942+0000","last_became_active":"2024-04-24T08:26:10.005710+0000","last_became_peered":"2024-04-24T08:26:10.005710+0000","last_unstale":"2024-04-24T08:26:10.012942+0000","last_undegraded":"2024-04-24T08:26:10.012942+0000","last_fullsized":"2024-04-24T08:26:10.012942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991033+0000","last_change":"2024-04-24T08:26:09.991033+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991033+0000","last_undegraded":"2024-04-24T08:26:09.991033+0000","last_fullsized":"2024-04-24T08:26:09.991033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.013572+0000","last_change":"2024-04-24T08:26:10.009111+0000","last_active":"2024-04-24T08:26:10.013572+0000","last_peered":"2024-04-24T08:26:10.013572+0000","last_clean":"2024-04-24T08:26:10.013572+0000","last_became_active":"2024-04-24T08:26:10.008830+0000","last_became_peered":"2024-04-24T08:26:10.008830+0000","last_unstale":"2024-04-24T08:26:10.013572+0000","last_undegraded":"2024-04-24T08:26:10.013572+0000","last_fullsized":"2024-04-24T08:26:10.013572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:59.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.003297+0000","last_change":"2024-04-24T08:26:10.003297+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.003297+0000","last_undegraded":"2024-04-24T08:26:10.003297+0000","last_fullsized":"2024-04-24T08:26:10.003297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015985+0000","last_change":"2024-04-24T08:26:10.011543+0000","last_active":"2024-04-24T08:26:10.015985+0000","last_peered":"2024-04-24T08:26:10.015985+0000","last_clean":"2024-04-24T08:26:10.015985+0000","last_became_active":"2024-04-24T08:26:10.011213+0000","last_became_peered":"2024-04-24T08:26:10.011213+0000","last_unstale":"2024-04-24T08:26:10.015985+0000","last_undegraded":"2024-04-24T08:26:10.015985+0000","last_fullsized":"2024-04-24T08:26:10.015985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:51:57.825752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991598+0000","last_change":"2024-04-24T08:26:09.991598+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991598+0000","last_undegraded":"2024-04-24T08:26:09.991598+0000","last_fullsized":"2024-04-24T08:26:09.991598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015668+0000","last_change":"2024-04-24T08:26:10.009102+0000","last_active":"2024-04-24T08:26:10.015668+0000","last_peered":"2024-04-24T08:26:10.015668+0000","last_clean":"2024-04-24T08:26:10.015668+0000","last_became_active":"2024-04-24T08:26:10.008736+0000","last_became_peered":"2024-04-24T08:26:10.008736+0000","last_unstale":"2024-04-24T08:26:10.015668+0000","last_undegraded":"2024-04-24T08:26:10.015668+0000","last_fullsized":"2024-04-24T08:26:10.015668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.990275+0000","last_change":"2024-04-24T08:26:09.990275+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.990275+0000","last_undegraded":"2024-04-24T08:26:09.990275+0000","last_fullsized":"2024-04-24T08:26:09.990275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.014497+0000","last_change":"2024-04-24T08:26:10.009630+0000","last_active":"2024-04-24T08:26:10.014497+0000","last_peered":"2024-04-24T08:26:10.014497+0000","last_clean":"2024-04-24T08:26:10.014497+0000","last_became_active":"2024-04-24T08:26:10.009059+0000","last_became_peered":"2024-04-24T08:26:10.009059+0000","last_unstale":"2024-04-24T08:26:10.014497+0000","last_undegraded":"2024-04-24T08:26:10.014497+0000","last_fullsized":"2024-04-24T08:26:10.014497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994586+0000","last_change":"2024-04-24T08:26:09.994586+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994586+0000","last_undegraded":"2024-04-24T08:26:09.994586+0000","last_fullsized":"2024-04-24T08:26:09.994586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.009768+0000","last_change":"2024-04-24T08:26:10.005806+0000","last_active":"2024-04-24T08:26:10.009768+0000","last_peered":"2024-04-24T08:26:10.009768+0000","last_clean":"2024-04-24T08:26:10.009768+0000","last_became_active":"2024-04-24T08:26:10.005520+0000","last_became_peered":"2024-04-24T08:26:10.005520+0000","last_unstale":"2024-04-24T08:26:10.009768+0000","last_undegraded":"2024-04-24T08:26:10.009768+0000","last_fullsized":"2024-04-24T08:26:10.009768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.987633+0000","last_change":"2024-04-24T08:26:09.987633+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.987633+0000","last_undegraded":"2024-04-24T08:26:09.987633+0000","last_fullsized":"2024-04-24T08:26:09.987633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.009382+0000","last_change":"2024-04-24T08:26:10.006176+0000","last_active":"2024-04-24T08:26:10.009382+0000","last_peered":"2024-04-24T08:26:10.009382+0000","last_clean":"2024-04-24T08:26:10.009382+0000","last_became_active":"2024-04-24T08:26:10.005931+0000","last_became_peered":"2024-04-24T08:26:10.005931+0000","last_unstale":"2024-04-24T08:26:10.009382+0000","last_undegraded":"2024-04-24T08:26:10.009382+0000","last_fullsized":"2024-04-24T08:26:10.009382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993430+0000","last_change":"2024-04-24T08:26:09.993430+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993430+0000","last_undegraded":"2024-04-24T08:26:09.993430+0000","last_fullsized":"2024-04-24T08:26:09.993430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015554+0000","last_change":"2024-04-24T08:26:10.008690+0000","last_active":"2024-04-24T08:26:10.015554+0000","last_peered":"2024-04-24T08:26:10.015554+0000","last_clean":"2024-04-24T08:26:10.015554+0000","last_became_active":"2024-04-24T08:26:10.008368+0000","last_became_peered":"2024-04-24T08:26:10.008368+0000","last_unstale":"2024-04-24T08:26:10.015554+0000","last_undegraded":"2024-04-24T08:26:10.015554+0000","last_fullsized":"2024-04-24T08:26:10.015554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994343+0000","last_change":"2024-04-24T08:26:09.994343+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994343+0000","last_undegraded":"2024-04-24T08:26:09.994343+0000","last_fullsized":"2024-04-24T08:26:09.994343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.002793+0000","last_change":"2024-04-24T08:26:09.999108+0000","last_active":"2024-04-24T08:26:10.002793+0000","last_peered":"2024-04-24T08:26:10.002793+0000","last_clean":"2024-04-24T08:26:10.002793+0000","last_became_active":"2024-04-24T08:26:09.998732+0000","last_became_peered":"2024-04-24T08:26:09.998732+0000","last_unstale":"2024-04-24T08:26:10.002793+0000","last_undegraded":"2024-04-24T08:26:10.002793+0000","last_fullsized":"2024-04-24T08:26:10.002793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:09:35.770606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996199+0000","last_change":"2024-04-24T08:26:09.996199+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996199+0000","last_undegraded":"2024-04-24T08:26:09.996199+0000","last_fullsized":"2024-04-24T08:26:09.996199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.017806+0000","last_change":"2024-04-24T08:26:10.014147+0000","last_active":"2024-04-24T08:26:10.017806+0000","last_peered":"2024-04-24T08:26:10.017806+0000","last_clean":"2024-04-24T08:26:10.017806+0000","last_became_active":"2024-04-24T08:26:10.013893+0000","last_became_peered":"2024-04-24T08:26:10.013893+0000","last_unstale":"2024-04-24T08:26:10.017806+0000","last_undegraded":"2024-04-24T08:26:10.017806+0000","last_fullsized":"2024-04-24T08:26:10.017806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:51:57.825752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997779+0000","last_change":"2024-04-24T08:26:09.997779+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997779+0000","last_undegraded":"2024-04-24T08:26:09.997779+0000","last_fullsized":"2024-04-24T08:26:09.997779+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.011350+0000","last_change":"2024-04-24T08:26:10.004578+0000","last_active":"2024-04-24T08:26:10.011350+0000","last_peered":"2024-04-24T08:26:10.011350+0000","last_clean":"2024-04-24T08:26:10.011350+0000","last_became_active":"2024-04-24T08:26:10.004401+0000","last_became_peered":"2024-04-24T08:26:10.004401+0000","last_unstale":"2024-04-24T08:26:10.011350+0000","last_undegraded":"2024-04-24T08:26:10.011350+0000","last_fullsized":"2024-04-24T08:26:10.011350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.008124+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:26:10.008124+0000","last_peered":"2024-04-24T08:26:10.008124+0000","last_clean":"2024-04-24T08:26:10.008124+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:26:10.008124+0000","last_undegraded":"2024-04-24T08:26:10.008124+0000","last_fullsized":"2024-04-24T08:26:10.008124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":695038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":689221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:26:15.440 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:26:15.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.609+0000 7fb9d4200640 1 Processor -- start 2024-04-24T08:26:15.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.609+0000 7fb9d4200640 1 -- start start 2024-04-24T08:26:15.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.609+0000 7fb9d4200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9cc0b9d90 0x7fb9cc1450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.609+0000 7fb9d4200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b4970 0x7fb9cc148840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.609+0000 7fb9d4200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9cc145620 con 0x7fb9cc0b44e0 2024-04-24T08:26:15.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.609+0000 7fb9d4200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb9cc145b80 con 0x7fb9cc0b9d90 2024-04-24T08:26:15.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.609+0000 7fb9d4200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb9cc0ba170 con 0x7fb9cc0b4970 2024-04-24T08:26:15.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.609+0000 7fb9d0e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb9cc0b44e0 0x7fb9cc148130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38046/0 (socket says 172.21.15.88:38046) 2024-04-24T08:26:15.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.609+0000 7fb9d1800640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9cc0b9d90 0x7fb9cc1450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.609+0000 7fb9d0e00640 1 -- 172.21.15.88:0/3807138914 learned_addr learned my addr 172.21.15.88:0/3807138914 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:15.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.609+0000 7fb9d2200640 1 --2- 172.21.15.88:0/3807138914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b4970 0x7fb9cc148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.613+0000 7fb9d1800640 1 -- 172.21.15.88:0/3807138914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b4970 msgr2=0x7fb9cc148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:15.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.613+0000 7fb9d1800640 1 --2- 172.21.15.88:0/3807138914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b4970 0x7fb9cc148840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.613+0000 7fb9d1800640 1 -- 172.21.15.88:0/3807138914 >> v1:172.21.15.88:6789/0 conn(0x7fb9cc0b44e0 legacy=0x7fb9cc148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.613+0000 7fb9d1800640 1 -- 172.21.15.88:0/3807138914 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9cc1458a0 con 0x7fb9cc0b9d90 2024-04-24T08:26:15.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.613+0000 7fb9d2200640 1 --2- 172.21.15.88:0/3807138914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b4970 0x7fb9cc148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:15.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.613+0000 7fb9d1800640 1 --2- 172.21.15.88:0/3807138914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc0b9d90 0x7fb9cc1450e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00097f0 tx=0x7fb9c001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105505bc3a832ebf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:15.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.613+0000 7fb9cbe00640 1 -- 172.21.15.88:0/3807138914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c00b0070 con 0x7fb9cc0b9d90 2024-04-24T08:26:15.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.613+0000 7fb9cbe00640 1 -- 172.21.15.88:0/3807138914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c00ab600 con 0x7fb9cc0b9d90 2024-04-24T08:26:15.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.613+0000 7fb9cbe00640 1 -- 172.21.15.88:0/3807138914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c00ab9d0 con 0x7fb9cc0b9d90 2024-04-24T08:26:15.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.613+0000 7fb9d4200640 1 -- 172.21.15.88:0/3807138914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc0b9d90 msgr2=0x7fb9cc1450e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.613+0000 7fb9d4200640 1 --2- 172.21.15.88:0/3807138914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc0b9d90 0x7fb9cc1450e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00097f0 tx=0x7fb9c001c4a0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 -- 172.21.15.88:0/3807138914 shutdown_connections 2024-04-24T08:26:15.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 --2- 172.21.15.88:0/3807138914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b4970 0x7fb9cc148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 --2- 172.21.15.88:0/3807138914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc0b9d90 0x7fb9cc1450e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 -- 172.21.15.88:0/3807138914 >> 172.21.15.88:0/3807138914 conn(0x7fb9cc06c0d0 msgr2=0x7fb9cc0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:15.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 -- 172.21.15.88:0/3807138914 shutdown_connections 2024-04-24T08:26:15.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 -- 172.21.15.88:0/3807138914 wait complete. 2024-04-24T08:26:15.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 Processor -- start 2024-04-24T08:26:15.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 -- start start 2024-04-24T08:26:15.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b44e0 0x7fb9cc072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc0b4970 0x7fb9cc1e1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9cc0b9d90 0x7fb9cc1e1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc148f00 con 0x7fb9cc0b4970 2024-04-24T08:26:15.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc148d80 con 0x7fb9cc0b9d90 2024-04-24T08:26:15.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb9cc151e90 con 0x7fb9cc0b44e0 2024-04-24T08:26:15.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d0e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc0b4970 0x7fb9cc1e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d0e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc0b4970 0x7fb9cc1e1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59820/0 (socket says 172.21.15.88:59820) 2024-04-24T08:26:15.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d0e00640 1 -- 172.21.15.88:0/3194173483 learned_addr learned my addr 172.21.15.88:0/3194173483 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:15.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d0e00640 1 -- 172.21.15.88:0/3194173483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b44e0 msgr2=0x7fb9cc072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d0e00640 1 --2- 172.21.15.88:0/3194173483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b44e0 0x7fb9cc072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d0e00640 1 -- 172.21.15.88:0/3194173483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9cc0b9d90 msgr2=0x7fb9cc1e1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d0e00640 1 --2- 172.21.15.88:0/3194173483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9cc0b9d90 0x7fb9cc1e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d0e00640 1 -- 172.21.15.88:0/3194173483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9cc0b0a70 con 0x7fb9cc0b4970 2024-04-24T08:26:15.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d0e00640 1 --2- 172.21.15.88:0/3194173483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc0b4970 0x7fb9cc1e1400 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c450 tx=0x7fb9b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:15.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9c9600640 1 -- 172.21.15.88:0/3194173483 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8017070 con 0x7fb9cc0b4970 2024-04-24T08:26:15.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9c9600640 1 -- 172.21.15.88:0/3194173483 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b8005cf0 con 0x7fb9cc0b4970 2024-04-24T08:26:15.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9c9600640 1 -- 172.21.15.88:0/3194173483 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8007290 con 0x7fb9cc0b4970 2024-04-24T08:26:15.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 -- 172.21.15.88:0/3194173483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9cc0b18e0 con 0x7fb9cc0b4970 2024-04-24T08:26:15.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.617+0000 7fb9d4200640 1 -- 172.21.15.88:0/3194173483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9cc13d700 con 0x7fb9cc0b4970 2024-04-24T08:26:15.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.621+0000 7fb9d4200640 1 -- 172.21.15.88:0/3194173483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9cc068b90 con 0x7fb9cc0b4970 2024-04-24T08:26:15.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.621+0000 7fb9c9600640 1 -- 172.21.15.88:0/3194173483 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb9b801a070 con 0x7fb9cc0b4970 2024-04-24T08:26:15.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.621+0000 7fb9c9600640 1 --2- 172.21.15.88:0/3194173483 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb9ac068380 0x7fb9ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.621+0000 7fb9c9600640 1 -- 172.21.15.88:0/3194173483 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fb9b8085c90 con 0x7fb9cc0b4970 2024-04-24T08:26:15.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.621+0000 7fb9d1800640 1 --2- 172.21.15.88:0/3194173483 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb9ac068380 0x7fb9ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.621+0000 7fb9d1800640 1 --2- 172.21.15.88:0/3194173483 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb9ac068380 0x7fb9ac06a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00ad000 tx=0x7fb9c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:15.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.625+0000 7fb9c9600640 1 -- 172.21.15.88:0/3194173483 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb9cc145620 con 0x7fb9cc0b4970 2024-04-24T08:26:15.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.781+0000 7fb9d4200640 1 -- 172.21.15.88:0/3194173483 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9cc0b0820 con 0x7fb9ac068380 2024-04-24T08:26:15.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.785+0000 7fb9c9600640 1 -- 172.21.15.88:0/3194173483 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246632 (secure 0 0 0) 0x7fb9cc0b0820 con 0x7fb9ac068380 2024-04-24T08:26:15.791 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:15.792 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:26:15.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.789+0000 7fb9d4200640 1 -- 172.21.15.88:0/3194173483 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb9ac068380 msgr2=0x7fb9ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.789+0000 7fb9d4200640 1 --2- 172.21.15.88:0/3194173483 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb9ac068380 0x7fb9ac06a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00ad000 tx=0x7fb9c0008040 comp rx=0 tx=0).stop 2024-04-24T08:26:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.789+0000 7fb9d4200640 1 -- 172.21.15.88:0/3194173483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc0b4970 msgr2=0x7fb9cc1e1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.789+0000 7fb9d4200640 1 --2- 172.21.15.88:0/3194173483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc0b4970 0x7fb9cc1e1400 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c450 tx=0x7fb9b800c910 comp rx=0 tx=0).stop 2024-04-24T08:26:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.789+0000 7fb9d4200640 1 -- 172.21.15.88:0/3194173483 shutdown_connections 2024-04-24T08:26:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.789+0000 7fb9d4200640 1 --2- 172.21.15.88:0/3194173483 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fb9ac068380 0x7fb9ac06a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.789+0000 7fb9d4200640 1 --2- 172.21.15.88:0/3194173483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9cc0b9d90 0x7fb9cc1e1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.789+0000 7fb9d4200640 1 --2- 172.21.15.88:0/3194173483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9cc0b4970 0x7fb9cc1e1400 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.789+0000 7fb9d4200640 1 --2- 172.21.15.88:0/3194173483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9cc0b44e0 0x7fb9cc072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.789+0000 7fb9d4200640 1 -- 172.21.15.88:0/3194173483 >> 172.21.15.88:0/3194173483 conn(0x7fb9cc06c0d0 msgr2=0x7fb9cc0b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.789+0000 7fb9d4200640 1 -- 172.21.15.88:0/3194173483 shutdown_connections 2024-04-24T08:26:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.789+0000 7fb9d4200640 1 -- 172.21.15.88:0/3194173483 wait complete. 2024-04-24T08:26:15.812 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-24T08:26:14.997702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219552,"kb_used_data":3388,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755168,"statfs":{"total":773094113280,"available":772869292032,"internally_reserved":0,"allocated":3469312,"data_stored":2012279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001963"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.989140+0000","last_change":"2024-04-24T08:26:09.989140+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.989140+0000","last_undegraded":"2024-04-24T08:26:09.989140+0000","last_fullsized":"2024-04-24T08:26:09.989140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001542+0000","last_change":"2024-04-24T08:26:10.001542+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001542+0000","last_undegraded":"2024-04-24T08:26:10.001542+0000","last_fullsized":"2024-04-24T08:26:10.001542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.989547+0000","last_change":"2024-04-24T08:26:09.989547+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.989547+0000","last_undegraded":"2024-04-24T08:26:09.989547+0000","last_fullsized":"2024-04-24T08:26:09.989547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.000316+0000","last_change":"2024-04-24T08:26:10.000316+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.000316+0000","last_undegraded":"2024-04-24T08:26:10.000316+0000","last_fullsized":"2024-04-24T08:26:10.000316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993335+0000","last_change":"2024-04-24T08:26:09.993335+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993335+0000","last_undegraded":"2024-04-24T08:26:09.993335+0000","last_fullsized":"2024-04-24T08:26:09.993335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996148+0000","last_change":"2024-04-24T08:26:09.996148+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996148+0000","last_undegraded":"2024-04-24T08:26:09.996148+0000","last_fullsized":"2024-04-24T08:26:09.996148+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.998223+0000","last_change":"2024-04-24T08:26:09.998223+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.998223+0000","last_undegraded":"2024-04-24T08:26:09.998223+0000","last_fullsized":"2024-04-24T08:26:09.998223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.005694+0000","last_change":"2024-04-24T08:26:10.005694+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.005694+0000","last_undegraded":"2024-04-24T08:26:10.005694+0000","last_fullsized":"2024-04-24T08:26:10.005694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994611+0000","last_change":"2024-04-24T08:26:09.994611+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994611+0000","last_undegraded":"2024-04-24T08:26:09.994611+0000","last_fullsized":"2024-04-24T08:26:09.994611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001178+0000","last_change":"2024-04-24T08:26:10.001178+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001178+0000","last_undegraded":"2024-04-24T08:26:10.001178+0000","last_fullsized":"2024-04-24T08:26:10.001178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.000368+0000","last_change":"2024-04-24T08:26:10.000368+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.000368+0000","last_undegraded":"2024-04-24T08:26:10.000368+0000","last_fullsized":"2024-04-24T08:26:10.000368+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.989129+0000","last_change":"2024-04-24T08:26:09.989129+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.989129+0000","last_undegraded":"2024-04-24T08:26:09.989129+0000","last_fullsized":"2024-04-24T08:26:09.989129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992725+0000","last_change":"2024-04-24T08:26:09.992725+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992725+0000","last_undegraded":"2024-04-24T08:26:09.992725+0000","last_fullsized":"2024-04-24T08:26:09.992725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.995485+0000","last_change":"2024-04-24T08:26:09.995485+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.995485+0000","last_undegraded":"2024-04-24T08:26:09.995485+0000","last_fullsized":"2024-04-24T08:26:09.995485+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988040+0000","last_change":"2024-04-24T08:26:09.988040+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988040+0000","last_undegraded":"2024-04-24T08:26:09.988040+0000","last_fullsized":"2024-04-24T08:26:09.988040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997371+0000","last_change":"2024-04-24T08:26:09.997371+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997371+0000","last_undegraded":"2024-04-24T08:26:09.997371+0000","last_fullsized":"2024-04-24T08:26:09.997371+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.003109+0000","last_change":"2024-04-24T08:26:10.003109+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.003109+0000","last_undegraded":"2024-04-24T08:26:10.003109+0000","last_fullsized":"2024-04-24T08:26:10.003109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001167+0000","last_change":"2024-04-24T08:26:10.001167+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001167+0000","last_undegraded":"2024-04-24T08:26:10.001167+0000","last_fullsized":"2024-04-24T08:26:10.001167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997140+0000","last_change":"2024-04-24T08:26:09.997140+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997140+0000","last_undegraded":"2024-04-24T08:26:09.997140+0000","last_fullsized":"2024-04-24T08:26:09.997140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992158+0000","last_change":"2024-04-24T08:26:09.992158+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992158+0000","last_undegraded":"2024-04-24T08:26:09.992158+0000","last_fullsized":"2024-04-24T08:26:09.992158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997888+0000","last_change":"2024-04-24T08:26:09.997888+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997888+0000","last_undegraded":"2024-04-24T08:26:09.997888+0000","last_fullsized":"2024-04-24T08:26:09.997888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992820+0000","last_change":"2024-04-24T08:26:09.992820+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992820+0000","last_undegraded":"2024-04-24T08:26:09.992820+0000","last_fullsized":"2024-04-24T08:26:09.992820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993036+0000","last_change":"2024-04-24T08:26:09.993036+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993036+0000","last_undegraded":"2024-04-24T08:26:09.993036+0000","last_fullsized":"2024-04-24T08:26:09.993036+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988436+0000","last_change":"2024-04-24T08:26:09.988436+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988436+0000","last_undegraded":"2024-04-24T08:26:09.988436+0000","last_fullsized":"2024-04-24T08:26:09.988436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001660+0000","last_change":"2024-04-24T08:26:10.001660+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001660+0000","last_undegraded":"2024-04-24T08:26:10.001660+0000","last_fullsized":"2024-04-24T08:26:10.001660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.000817+0000","last_change":"2024-04-24T08:26:10.000817+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.000817+0000","last_undegraded":"2024-04-24T08:26:10.000817+0000","last_fullsized":"2024-04-24T08:26:10.000817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.002837+0000","last_change":"2024-04-24T08:26:10.002837+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.002837+0000","last_undegraded":"2024-04-24T08:26:10.002837+0000","last_fullsized":"2024-04-24T08:26:10.002837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988697+0000","last_change":"2024-04-24T08:26:09.988697+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988697+0000","last_undegraded":"2024-04-24T08:26:09.988697+0000","last_fullsized":"2024-04-24T08:26:09.988697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996359+0000","last_change":"2024-04-24T08:26:09.996359+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996359+0000","last_undegraded":"2024-04-24T08:26:09.996359+0000","last_fullsized":"2024-04-24T08:26:09.996359+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.004718+0000","last_change":"2024-04-24T08:26:10.004718+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.004718+0000","last_undegraded":"2024-04-24T08:26:10.004718+0000","last_fullsized":"2024-04-24T08:26:10.004718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988191+0000","last_change":"2024-04-24T08:26:09.988191+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988191+0000","last_undegraded":"2024-04-24T08:26:09.988191+0000","last_fullsized":"2024-04-24T08:26:09.988191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001488+0000","last_change":"2024-04-24T08:26:10.001488+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001488+0000","last_undegraded":"2024-04-24T08:26:10.001488+0000","last_fullsized":"2024-04-24T08:26:10.001488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994075+0000","last_change":"2024-04-24T08:26:09.994075+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994075+0000","last_undegraded":"2024-04-24T08:26:09.994075+0000","last_fullsized":"2024-04-24T08:26:09.994075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.010907+0000","last_change":"2024-04-24T08:26:10.005901+0000","last_active":"2024-04-24T08:26:10.010907+0000","last_peered":"2024-04-24T08:26:10.010907+0000","last_clean":"2024-04-24T08:26:10.010907+0000","last_became_active":"2024-04-24T08:26:10.005611+0000","last_became_peered":"2024-04-24T08:26:10.005611+0000","last_unstale":"2024-04-24T08:26:10.010907+0000","last_undegraded":"2024-04-24T08:26:10.010907+0000","last_fullsized":"2024-04-24T08:26:10.010907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.987621+0000","last_change":"2024-04-24T08:26:09.987621+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.987621+0000","last_undegraded":"2024-04-24T08:26:09.987621+0000","last_fullsized":"2024-04-24T08:26:09.987621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015491+0000","last_change":"2024-04-24T08:26:10.012103+0000","last_active":"2024-04-24T08:26:10.015491+0000","last_peered":"2024-04-24T08:26:10.015491+0000","last_clean":"2024-04-24T08:26:10.015491+0000","last_became_active":"2024-04-24T08:26:10.011846+0000","last_became_peered":"2024-04-24T08:26:10.011846+0000","last_unstale":"2024-04-24T08:26:10.015491+0000","last_undegraded":"2024-04-24T08:26:10.015491+0000","last_fullsized":"2024-04-24T08:26:10.015491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:04.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.995850+0000","last_change":"2024-04-24T08:26:09.995850+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.995850+0000","last_undegraded":"2024-04-24T08:26:09.995850+0000","last_fullsized":"2024-04-24T08:26:09.995850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016320+0000","last_change":"2024-04-24T08:26:10.013217+0000","last_active":"2024-04-24T08:26:10.016320+0000","last_peered":"2024-04-24T08:26:10.016320+0000","last_clean":"2024-04-24T08:26:10.016320+0000","last_became_active":"2024-04-24T08:26:10.012939+0000","last_became_peered":"2024-04-24T08:26:10.012939+0000","last_unstale":"2024-04-24T08:26:10.016320+0000","last_undegraded":"2024-04-24T08:26:10.016320+0000","last_fullsized":"2024-04-24T08:26:10.016320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:01:44.547438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.999811+0000","last_change":"2024-04-24T08:26:09.999811+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.999811+0000","last_undegraded":"2024-04-24T08:26:09.999811+0000","last_fullsized":"2024-04-24T08:26:09.999811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.012245+0000","last_change":"2024-04-24T08:26:10.005714+0000","last_active":"2024-04-24T08:26:10.012245+0000","last_peered":"2024-04-24T08:26:10.012245+0000","last_clean":"2024-04-24T08:26:10.012245+0000","last_became_active":"2024-04-24T08:26:10.005299+0000","last_became_peered":"2024-04-24T08:26:10.005299+0000","last_unstale":"2024-04-24T08:26:10.012245+0000","last_undegraded":"2024-04-24T08:26:10.012245+0000","last_fullsized":"2024-04-24T08:26:10.012245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:09:35.770606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997862+0000","last_change":"2024-04-24T08:26:09.997862+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997862+0000","last_undegraded":"2024-04-24T08:26:09.997862+0000","last_fullsized":"2024-04-24T08:26:09.997862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.013755+0000","last_change":"2024-04-24T08:26:10.010287+0000","last_active":"2024-04-24T08:26:10.013755+0000","last_peered":"2024-04-24T08:26:10.013755+0000","last_clean":"2024-04-24T08:26:10.013755+0000","last_became_active":"2024-04-24T08:26:10.009987+0000","last_became_peered":"2024-04-24T08:26:10.009987+0000","last_unstale":"2024-04-24T08:26:10.013755+0000","last_undegraded":"2024-04-24T08:26:10.013755+0000","last_fullsized":"2024-04-24T08:26:10.013755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:15:15.487296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988157+0000","last_change":"2024-04-24T08:26:09.988157+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988157+0000","last_undegraded":"2024-04-24T08:26:09.988157+0000","last_fullsized":"2024-04-24T08:26:09.988157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.011071+0000","last_change":"2024-04-24T08:26:10.008606+0000","last_active":"2024-04-24T08:26:10.011071+0000","last_peered":"2024-04-24T08:26:10.011071+0000","last_clean":"2024-04-24T08:26:10.011071+0000","last_became_active":"2024-04-24T08:26:10.008258+0000","last_became_peered":"2024-04-24T08:26:10.008258+0000","last_unstale":"2024-04-24T08:26:10.011071+0000","last_undegraded":"2024-04-24T08:26:10.011071+0000","last_fullsized":"2024-04-24T08:26:10.011071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:51.723825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993839+0000","last_change":"2024-04-24T08:26:09.993839+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993839+0000","last_undegraded":"2024-04-24T08:26:09.993839+0000","last_fullsized":"2024-04-24T08:26:09.993839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.010113+0000","last_change":"2024-04-24T08:26:10.002814+0000","last_active":"2024-04-24T08:26:10.010113+0000","last_peered":"2024-04-24T08:26:10.010113+0000","last_clean":"2024-04-24T08:26:10.010113+0000","last_became_active":"2024-04-24T08:26:10.002502+0000","last_became_peered":"2024-04-24T08:26:10.002502+0000","last_unstale":"2024-04-24T08:26:10.010113+0000","last_undegraded":"2024-04-24T08:26:10.010113+0000","last_fullsized":"2024-04-24T08:26:10.010113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:45.812010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.995713+0000","last_change":"2024-04-24T08:26:09.995713+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.995713+0000","last_undegraded":"2024-04-24T08:26:09.995713+0000","last_fullsized":"2024-04-24T08:26:09.995713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.006092+0000","last_change":"2024-04-24T08:26:10.002174+0000","last_active":"2024-04-24T08:26:10.006092+0000","last_peered":"2024-04-24T08:26:10.006092+0000","last_clean":"2024-04-24T08:26:10.006092+0000","last_became_active":"2024-04-24T08:26:10.001830+0000","last_became_peered":"2024-04-24T08:26:10.001830+0000","last_unstale":"2024-04-24T08:26:10.006092+0000","last_undegraded":"2024-04-24T08:26:10.006092+0000","last_fullsized":"2024-04-24T08:26:10.006092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:55:48.686733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988552+0000","last_change":"2024-04-24T08:26:09.988552+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988552+0000","last_undegraded":"2024-04-24T08:26:09.988552+0000","last_fullsized":"2024-04-24T08:26:09.988552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016286+0000","last_change":"2024-04-24T08:26:10.013100+0000","last_active":"2024-04-24T08:26:10.016286+0000","last_peered":"2024-04-24T08:26:10.016286+0000","last_clean":"2024-04-24T08:26:10.016286+0000","last_became_active":"2024-04-24T08:26:10.012809+0000","last_became_peered":"2024-04-24T08:26:10.012809+0000","last_unstale":"2024-04-24T08:26:10.016286+0000","last_undegraded":"2024-04-24T08:26:10.016286+0000","last_fullsized":"2024-04-24T08:26:10.016286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:14:20.203803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997134+0000","last_change":"2024-04-24T08:26:09.997134+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997134+0000","last_undegraded":"2024-04-24T08:26:09.997134+0000","last_fullsized":"2024-04-24T08:26:09.997134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.014517+0000","last_change":"2024-04-24T08:26:10.011789+0000","last_active":"2024-04-24T08:26:10.014517+0000","last_peered":"2024-04-24T08:26:10.014517+0000","last_clean":"2024-04-24T08:26:10.014517+0000","last_became_active":"2024-04-24T08:26:10.011489+0000","last_became_peered":"2024-04-24T08:26:10.011489+0000","last_unstale":"2024-04-24T08:26:10.014517+0000","last_undegraded":"2024-04-24T08:26:10.014517+0000","last_fullsized":"2024-04-24T08:26:10.014517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:16.723467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994423+0000","last_change":"2024-04-24T08:26:09.994423+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994423+0000","last_undegraded":"2024-04-24T08:26:09.994423+0000","last_fullsized":"2024-04-24T08:26:09.994423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015964+0000","last_change":"2024-04-24T08:26:10.011485+0000","last_active":"2024-04-24T08:26:10.015964+0000","last_peered":"2024-04-24T08:26:10.015964+0000","last_clean":"2024-04-24T08:26:10.015964+0000","last_became_active":"2024-04-24T08:26:10.011166+0000","last_became_peered":"2024-04-24T08:26:10.011166+0000","last_unstale":"2024-04-24T08:26:10.015964+0000","last_undegraded":"2024-04-24T08:26:10.015964+0000","last_fullsized":"2024-04-24T08:26:10.015964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:30:20.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.990398+0000","last_change":"2024-04-24T08:26:09.990398+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.990398+0000","last_undegraded":"2024-04-24T08:26:09.990398+0000","last_fullsized":"2024-04-24T08:26:09.990398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016157+0000","last_change":"2024-04-24T08:26:10.011337+0000","last_active":"2024-04-24T08:26:10.016157+0000","last_peered":"2024-04-24T08:26:10.016157+0000","last_clean":"2024-04-24T08:26:10.016157+0000","last_became_active":"2024-04-24T08:26:10.010603+0000","last_became_peered":"2024-04-24T08:26:10.010603+0000","last_unstale":"2024-04-24T08:26:10.016157+0000","last_undegraded":"2024-04-24T08:26:10.016157+0000","last_fullsized":"2024-04-24T08:26:10.016157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:11:48.720898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.999314+0000","last_change":"2024-04-24T08:26:09.999314+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.999314+0000","last_undegraded":"2024-04-24T08:26:09.999314+0000","last_fullsized":"2024-04-24T08:26:09.999314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.005926+0000","last_change":"2024-04-24T08:26:10.001398+0000","last_active":"2024-04-24T08:26:10.005926+0000","last_peered":"2024-04-24T08:26:10.005926+0000","last_clean":"2024-04-24T08:26:10.005926+0000","last_became_active":"2024-04-24T08:26:10.001113+0000","last_became_peered":"2024-04-24T08:26:10.001113+0000","last_unstale":"2024-04-24T08:26:10.005926+0000","last_undegraded":"2024-04-24T08:26:10.005926+0000","last_fullsized":"2024-04-24T08:26:10.005926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:20:07.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994268+0000","last_change":"2024-04-24T08:26:09.994268+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994268+0000","last_undegraded":"2024-04-24T08:26:09.994268+0000","last_fullsized":"2024-04-24T08:26:09.994268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016340+0000","last_change":"2024-04-24T08:26:10.015151+0000","last_active":"2024-04-24T08:26:10.016340+0000","last_peered":"2024-04-24T08:26:10.016340+0000","last_clean":"2024-04-24T08:26:10.016340+0000","last_became_active":"2024-04-24T08:26:10.014720+0000","last_became_peered":"2024-04-24T08:26:10.014720+0000","last_unstale":"2024-04-24T08:26:10.016340+0000","last_undegraded":"2024-04-24T08:26:10.016340+0000","last_fullsized":"2024-04-24T08:26:10.016340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:16.723467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001133+0000","last_change":"2024-04-24T08:26:10.001133+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001133+0000","last_undegraded":"2024-04-24T08:26:10.001133+0000","last_fullsized":"2024-04-24T08:26:10.001133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.017783+0000","last_change":"2024-04-24T08:26:10.013550+0000","last_active":"2024-04-24T08:26:10.017783+0000","last_peered":"2024-04-24T08:26:10.017783+0000","last_clean":"2024-04-24T08:26:10.017783+0000","last_became_active":"2024-04-24T08:26:10.013258+0000","last_became_peered":"2024-04-24T08:26:10.013258+0000","last_unstale":"2024-04-24T08:26:10.017783+0000","last_undegraded":"2024-04-24T08:26:10.017783+0000","last_fullsized":"2024-04-24T08:26:10.017783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:30:20.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.987613+0000","last_change":"2024-04-24T08:26:09.987613+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.987613+0000","last_undegraded":"2024-04-24T08:26:09.987613+0000","last_fullsized":"2024-04-24T08:26:09.987613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.010630+0000","last_change":"2024-04-24T08:26:10.007972+0000","last_active":"2024-04-24T08:26:10.010630+0000","last_peered":"2024-04-24T08:26:10.010630+0000","last_clean":"2024-04-24T08:26:10.010630+0000","last_became_active":"2024-04-24T08:26:10.007685+0000","last_became_peered":"2024-04-24T08:26:10.007685+0000","last_unstale":"2024-04-24T08:26:10.010630+0000","last_undegraded":"2024-04-24T08:26:10.010630+0000","last_fullsized":"2024-04-24T08:26:10.010630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:23:53.043096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996807+0000","last_change":"2024-04-24T08:26:09.996807+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996807+0000","last_undegraded":"2024-04-24T08:26:09.996807+0000","last_fullsized":"2024-04-24T08:26:09.996807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.017970+0000","last_change":"2024-04-24T08:26:10.016657+0000","last_active":"2024-04-24T08:26:10.017970+0000","last_peered":"2024-04-24T08:26:10.017970+0000","last_clean":"2024-04-24T08:26:10.017970+0000","last_became_active":"2024-04-24T08:26:10.016354+0000","last_became_peered":"2024-04-24T08:26:10.016354+0000","last_unstale":"2024-04-24T08:26:10.017970+0000","last_undegraded":"2024-04-24T08:26:10.017970+0000","last_fullsized":"2024-04-24T08:26:10.017970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:04.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992534+0000","last_change":"2024-04-24T08:26:09.992534+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992534+0000","last_undegraded":"2024-04-24T08:26:09.992534+0000","last_fullsized":"2024-04-24T08:26:09.992534+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.006115+0000","last_change":"2024-04-24T08:26:10.002133+0000","last_active":"2024-04-24T08:26:10.006115+0000","last_peered":"2024-04-24T08:26:10.006115+0000","last_clean":"2024-04-24T08:26:10.006115+0000","last_became_active":"2024-04-24T08:26:10.001823+0000","last_became_peered":"2024-04-24T08:26:10.001823+0000","last_unstale":"2024-04-24T08:26:10.006115+0000","last_undegraded":"2024-04-24T08:26:10.006115+0000","last_fullsized":"2024-04-24T08:26:10.006115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:05:49.885137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.999846+0000","last_change":"2024-04-24T08:26:09.999846+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.999846+0000","last_undegraded":"2024-04-24T08:26:09.999846+0000","last_fullsized":"2024-04-24T08:26:09.999846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.013709+0000","last_change":"2024-04-24T08:26:10.009750+0000","last_active":"2024-04-24T08:26:10.013709+0000","last_peered":"2024-04-24T08:26:10.013709+0000","last_clean":"2024-04-24T08:26:10.013709+0000","last_became_active":"2024-04-24T08:26:10.009495+0000","last_became_peered":"2024-04-24T08:26:10.009495+0000","last_unstale":"2024-04-24T08:26:10.013709+0000","last_undegraded":"2024-04-24T08:26:10.013709+0000","last_fullsized":"2024-04-24T08:26:10.013709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:10:46.621628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992115+0000","last_change":"2024-04-24T08:26:09.992115+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992115+0000","last_undegraded":"2024-04-24T08:26:09.992115+0000","last_fullsized":"2024-04-24T08:26:09.992115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015858+0000","last_change":"2024-04-24T08:26:10.012977+0000","last_active":"2024-04-24T08:26:10.015858+0000","last_peered":"2024-04-24T08:26:10.015858+0000","last_clean":"2024-04-24T08:26:10.015858+0000","last_became_active":"2024-04-24T08:26:10.012687+0000","last_became_peered":"2024-04-24T08:26:10.012687+0000","last_unstale":"2024-04-24T08:26:10.015858+0000","last_undegraded":"2024-04-24T08:26:10.015858+0000","last_fullsized":"2024-04-24T08:26:10.015858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:23:23.672009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991117+0000","last_change":"2024-04-24T08:26:09.991117+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991117+0000","last_undegraded":"2024-04-24T08:26:09.991117+0000","last_fullsized":"2024-04-24T08:26:09.991117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.008963+0000","last_change":"2024-04-24T08:26:10.005338+0000","last_active":"2024-04-24T08:26:10.008963+0000","last_peered":"2024-04-24T08:26:10.008963+0000","last_clean":"2024-04-24T08:26:10.008963+0000","last_became_active":"2024-04-24T08:26:10.005060+0000","last_became_peered":"2024-04-24T08:26:10.005060+0000","last_unstale":"2024-04-24T08:26:10.008963+0000","last_undegraded":"2024-04-24T08:26:10.008963+0000","last_fullsized":"2024-04-24T08:26:10.008963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991413+0000","last_change":"2024-04-24T08:26:09.991413+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991413+0000","last_undegraded":"2024-04-24T08:26:09.991413+0000","last_fullsized":"2024-04-24T08:26:09.991413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.012942+0000","last_change":"2024-04-24T08:26:10.010459+0000","last_active":"2024-04-24T08:26:10.012942+0000","last_peered":"2024-04-24T08:26:10.012942+0000","last_clean":"2024-04-24T08:26:10.012942+0000","last_became_active":"2024-04-24T08:26:10.005710+0000","last_became_peered":"2024-04-24T08:26:10.005710+0000","last_unstale":"2024-04-24T08:26:10.012942+0000","last_undegraded":"2024-04-24T08:26:10.012942+0000","last_fullsized":"2024-04-24T08:26:10.012942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991033+0000","last_change":"2024-04-24T08:26:09.991033+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991033+0000","last_undegraded":"2024-04-24T08:26:09.991033+0000","last_fullsized":"2024-04-24T08:26:09.991033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.013572+0000","last_change":"2024-04-24T08:26:10.009111+0000","last_active":"2024-04-24T08:26:10.013572+0000","last_peered":"2024-04-24T08:26:10.013572+0000","last_clean":"2024-04-24T08:26:10.013572+0000","last_became_active":"2024-04-24T08:26:10.008830+0000","last_became_peered":"2024-04-24T08:26:10.008830+0000","last_unstale":"2024-04-24T08:26:10.013572+0000","last_undegraded":"2024-04-24T08:26:10.013572+0000","last_fullsized":"2024-04-24T08:26:10.013572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:59.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.003297+0000","last_change":"2024-04-24T08:26:10.003297+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.003297+0000","last_undegraded":"2024-04-24T08:26:10.003297+0000","last_fullsized":"2024-04-24T08:26:10.003297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015985+0000","last_change":"2024-04-24T08:26:10.011543+0000","last_active":"2024-04-24T08:26:10.015985+0000","last_peered":"2024-04-24T08:26:10.015985+0000","last_clean":"2024-04-24T08:26:10.015985+0000","last_became_active":"2024-04-24T08:26:10.011213+0000","last_became_peered":"2024-04-24T08:26:10.011213+0000","last_unstale":"2024-04-24T08:26:10.015985+0000","last_undegraded":"2024-04-24T08:26:10.015985+0000","last_fullsized":"2024-04-24T08:26:10.015985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:51:57.825752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991598+0000","last_change":"2024-04-24T08:26:09.991598+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991598+0000","last_undegraded":"2024-04-24T08:26:09.991598+0000","last_fullsized":"2024-04-24T08:26:09.991598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015668+0000","last_change":"2024-04-24T08:26:10.009102+0000","last_active":"2024-04-24T08:26:10.015668+0000","last_peered":"2024-04-24T08:26:10.015668+0000","last_clean":"2024-04-24T08:26:10.015668+0000","last_became_active":"2024-04-24T08:26:10.008736+0000","last_became_peered":"2024-04-24T08:26:10.008736+0000","last_unstale":"2024-04-24T08:26:10.015668+0000","last_undegraded":"2024-04-24T08:26:10.015668+0000","last_fullsized":"2024-04-24T08:26:10.015668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.990275+0000","last_change":"2024-04-24T08:26:09.990275+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.990275+0000","last_undegraded":"2024-04-24T08:26:09.990275+0000","last_fullsized":"2024-04-24T08:26:09.990275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.014497+0000","last_change":"2024-04-24T08:26:10.009630+0000","last_active":"2024-04-24T08:26:10.014497+0000","last_peered":"2024-04-24T08:26:10.014497+0000","last_clean":"2024-04-24T08:26:10.014497+0000","last_became_active":"2024-04-24T08:26:10.009059+0000","last_became_peered":"2024-04-24T08:26:10.009059+0000","last_unstale":"2024-04-24T08:26:10.014497+0000","last_undegraded":"2024-04-24T08:26:10.014497+0000","last_fullsized":"2024-04-24T08:26:10.014497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994586+0000","last_change":"2024-04-24T08:26:09.994586+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994586+0000","last_undegraded":"2024-04-24T08:26:09.994586+0000","last_fullsized":"2024-04-24T08:26:09.994586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.009768+0000","last_change":"2024-04-24T08:26:10.005806+0000","last_active":"2024-04-24T08:26:10.009768+0000","last_peered":"2024-04-24T08:26:10.009768+0000","last_clean":"2024-04-24T08:26:10.009768+0000","last_became_active":"2024-04-24T08:26:10.005520+0000","last_became_peered":"2024-04-24T08:26:10.005520+0000","last_unstale":"2024-04-24T08:26:10.009768+0000","last_undegraded":"2024-04-24T08:26:10.009768+0000","last_fullsized":"2024-04-24T08:26:10.009768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.987633+0000","last_change":"2024-04-24T08:26:09.987633+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.987633+0000","last_undegraded":"2024-04-24T08:26:09.987633+0000","last_fullsized":"2024-04-24T08:26:09.987633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.009382+0000","last_change":"2024-04-24T08:26:10.006176+0000","last_active":"2024-04-24T08:26:10.009382+0000","last_peered":"2024-04-24T08:26:10.009382+0000","last_clean":"2024-04-24T08:26:10.009382+0000","last_became_active":"2024-04-24T08:26:10.005931+0000","last_became_peered":"2024-04-24T08:26:10.005931+0000","last_unstale":"2024-04-24T08:26:10.009382+0000","last_undegraded":"2024-04-24T08:26:10.009382+0000","last_fullsized":"2024-04-24T08:26:10.009382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993430+0000","last_change":"2024-04-24T08:26:09.993430+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993430+0000","last_undegraded":"2024-04-24T08:26:09.993430+0000","last_fullsized":"2024-04-24T08:26:09.993430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015554+0000","last_change":"2024-04-24T08:26:10.008690+0000","last_active":"2024-04-24T08:26:10.015554+0000","last_peered":"2024-04-24T08:26:10.015554+0000","last_clean":"2024-04-24T08:26:10.015554+0000","last_became_active":"2024-04-24T08:26:10.008368+0000","last_became_peered":"2024-04-24T08:26:10.008368+0000","last_unstale":"2024-04-24T08:26:10.015554+0000","last_undegraded":"2024-04-24T08:26:10.015554+0000","last_fullsized":"2024-04-24T08:26:10.015554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994343+0000","last_change":"2024-04-24T08:26:09.994343+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994343+0000","last_undegraded":"2024-04-24T08:26:09.994343+0000","last_fullsized":"2024-04-24T08:26:09.994343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.002793+0000","last_change":"2024-04-24T08:26:09.999108+0000","last_active":"2024-04-24T08:26:10.002793+0000","last_peered":"2024-04-24T08:26:10.002793+0000","last_clean":"2024-04-24T08:26:10.002793+0000","last_became_active":"2024-04-24T08:26:09.998732+0000","last_became_peered":"2024-04-24T08:26:09.998732+0000","last_unstale":"2024-04-24T08:26:10.002793+0000","last_undegraded":"2024-04-24T08:26:10.002793+0000","last_fullsized":"2024-04-24T08:26:10.002793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:09:35.770606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996199+0000","last_change":"2024-04-24T08:26:09.996199+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996199+0000","last_undegraded":"2024-04-24T08:26:09.996199+0000","last_fullsized":"2024-04-24T08:26:09.996199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.017806+0000","last_change":"2024-04-24T08:26:10.014147+0000","last_active":"2024-04-24T08:26:10.017806+0000","last_peered":"2024-04-24T08:26:10.017806+0000","last_clean":"2024-04-24T08:26:10.017806+0000","last_became_active":"2024-04-24T08:26:10.013893+0000","last_became_peered":"2024-04-24T08:26:10.013893+0000","last_unstale":"2024-04-24T08:26:10.017806+0000","last_undegraded":"2024-04-24T08:26:10.017806+0000","last_fullsized":"2024-04-24T08:26:10.017806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:51:57.825752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997779+0000","last_change":"2024-04-24T08:26:09.997779+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997779+0000","last_undegraded":"2024-04-24T08:26:09.997779+0000","last_fullsized":"2024-04-24T08:26:09.997779+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.011350+0000","last_change":"2024-04-24T08:26:10.004578+0000","last_active":"2024-04-24T08:26:10.011350+0000","last_peered":"2024-04-24T08:26:10.011350+0000","last_clean":"2024-04-24T08:26:10.011350+0000","last_became_active":"2024-04-24T08:26:10.004401+0000","last_became_peered":"2024-04-24T08:26:10.004401+0000","last_unstale":"2024-04-24T08:26:10.011350+0000","last_undegraded":"2024-04-24T08:26:10.011350+0000","last_fullsized":"2024-04-24T08:26:10.011350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.008124+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:26:10.008124+0000","last_peered":"2024-04-24T08:26:10.008124+0000","last_clean":"2024-04-24T08:26:10.008124+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:26:10.008124+0000","last_undegraded":"2024-04-24T08:26:10.008124+0000","last_fullsized":"2024-04-24T08:26:10.008124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":695038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":689221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:26:15.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-04-24T08:26:15.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.989140+0000', 'last_change': '2024-04-24T08:26:09.989140+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.989140+0000', 'last_undegraded': '2024-04-24T08:26:09.989140+0000', 'last_fullsized': '2024-04-24T08:26:09.989140+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-24T08:26:15.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-04-24T08:26:15.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.001542+0000', 'last_change': '2024-04-24T08:26:10.001542+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.001542+0000', 'last_undegraded': '2024-04-24T08:26:10.001542+0000', 'last_fullsized': '2024-04-24T08:26:10.001542+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-24T08:26:15.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-04-24T08:26:15.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.989547+0000', 'last_change': '2024-04-24T08:26:09.989547+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.989547+0000', 'last_undegraded': '2024-04-24T08:26:09.989547+0000', 'last_fullsized': '2024-04-24T08:26:09.989547+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-24T08:26:15.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-04-24T08:26:15.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.000316+0000', 'last_change': '2024-04-24T08:26:10.000316+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.000316+0000', 'last_undegraded': '2024-04-24T08:26:10.000316+0000', 'last_fullsized': '2024-04-24T08:26:10.000316+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-24T08:26:15.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-04-24T08:26:15.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.993335+0000', 'last_change': '2024-04-24T08:26:09.993335+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.993335+0000', 'last_undegraded': '2024-04-24T08:26:09.993335+0000', 'last_fullsized': '2024-04-24T08:26:09.993335+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-24T08:26:15.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-04-24T08:26:15.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.996148+0000', 'last_change': '2024-04-24T08:26:09.996148+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.996148+0000', 'last_undegraded': '2024-04-24T08:26:09.996148+0000', 'last_fullsized': '2024-04-24T08:26:09.996148+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-24T08:26:15.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-04-24T08:26:15.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.998223+0000', 'last_change': '2024-04-24T08:26:09.998223+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.998223+0000', 'last_undegraded': '2024-04-24T08:26:09.998223+0000', 'last_fullsized': '2024-04-24T08:26:09.998223+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-24T08:26:15.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-04-24T08:26:15.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.005694+0000', 'last_change': '2024-04-24T08:26:10.005694+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.005694+0000', 'last_undegraded': '2024-04-24T08:26:10.005694+0000', 'last_fullsized': '2024-04-24T08:26:10.005694+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-24T08:26:15.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-04-24T08:26:15.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.994611+0000', 'last_change': '2024-04-24T08:26:09.994611+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.994611+0000', 'last_undegraded': '2024-04-24T08:26:09.994611+0000', 'last_fullsized': '2024-04-24T08:26:09.994611+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-24T08:26:15.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-04-24T08:26:15.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.001178+0000', 'last_change': '2024-04-24T08:26:10.001178+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.001178+0000', 'last_undegraded': '2024-04-24T08:26:10.001178+0000', 'last_fullsized': '2024-04-24T08:26:10.001178+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-24T08:26:15.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-04-24T08:26:15.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.000368+0000', 'last_change': '2024-04-24T08:26:10.000368+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.000368+0000', 'last_undegraded': '2024-04-24T08:26:10.000368+0000', 'last_fullsized': '2024-04-24T08:26:10.000368+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-24T08:26:15.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-04-24T08:26:15.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.989129+0000', 'last_change': '2024-04-24T08:26:09.989129+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.989129+0000', 'last_undegraded': '2024-04-24T08:26:09.989129+0000', 'last_fullsized': '2024-04-24T08:26:09.989129+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-24T08:26:15.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-04-24T08:26:15.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.992725+0000', 'last_change': '2024-04-24T08:26:09.992725+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.992725+0000', 'last_undegraded': '2024-04-24T08:26:09.992725+0000', 'last_fullsized': '2024-04-24T08:26:09.992725+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-24T08:26:15.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-04-24T08:26:15.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.995485+0000', 'last_change': '2024-04-24T08:26:09.995485+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.995485+0000', 'last_undegraded': '2024-04-24T08:26:09.995485+0000', 'last_fullsized': '2024-04-24T08:26:09.995485+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-24T08:26:15.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-04-24T08:26:15.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.988040+0000', 'last_change': '2024-04-24T08:26:09.988040+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.988040+0000', 'last_undegraded': '2024-04-24T08:26:09.988040+0000', 'last_fullsized': '2024-04-24T08:26:09.988040+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-24T08:26:15.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-04-24T08:26:15.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.997371+0000', 'last_change': '2024-04-24T08:26:09.997371+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.997371+0000', 'last_undegraded': '2024-04-24T08:26:09.997371+0000', 'last_fullsized': '2024-04-24T08:26:09.997371+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-24T08:26:15.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-04-24T08:26:15.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.003109+0000', 'last_change': '2024-04-24T08:26:10.003109+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.003109+0000', 'last_undegraded': '2024-04-24T08:26:10.003109+0000', 'last_fullsized': '2024-04-24T08:26:10.003109+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-24T08:26:15.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-04-24T08:26:15.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.001167+0000', 'last_change': '2024-04-24T08:26:10.001167+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.001167+0000', 'last_undegraded': '2024-04-24T08:26:10.001167+0000', 'last_fullsized': '2024-04-24T08:26:10.001167+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-24T08:26:15.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-04-24T08:26:15.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.997140+0000', 'last_change': '2024-04-24T08:26:09.997140+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.997140+0000', 'last_undegraded': '2024-04-24T08:26:09.997140+0000', 'last_fullsized': '2024-04-24T08:26:09.997140+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-24T08:26:15.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-04-24T08:26:15.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.992158+0000', 'last_change': '2024-04-24T08:26:09.992158+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.992158+0000', 'last_undegraded': '2024-04-24T08:26:09.992158+0000', 'last_fullsized': '2024-04-24T08:26:09.992158+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-24T08:26:15.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-04-24T08:26:15.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.997888+0000', 'last_change': '2024-04-24T08:26:09.997888+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.997888+0000', 'last_undegraded': '2024-04-24T08:26:09.997888+0000', 'last_fullsized': '2024-04-24T08:26:09.997888+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-24T08:26:15.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-04-24T08:26:15.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.992820+0000', 'last_change': '2024-04-24T08:26:09.992820+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.992820+0000', 'last_undegraded': '2024-04-24T08:26:09.992820+0000', 'last_fullsized': '2024-04-24T08:26:09.992820+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-24T08:26:15.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-04-24T08:26:15.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.993036+0000', 'last_change': '2024-04-24T08:26:09.993036+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.993036+0000', 'last_undegraded': '2024-04-24T08:26:09.993036+0000', 'last_fullsized': '2024-04-24T08:26:09.993036+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-24T08:26:15.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-04-24T08:26:15.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.988436+0000', 'last_change': '2024-04-24T08:26:09.988436+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.988436+0000', 'last_undegraded': '2024-04-24T08:26:09.988436+0000', 'last_fullsized': '2024-04-24T08:26:09.988436+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-24T08:26:15.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-04-24T08:26:15.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.001660+0000', 'last_change': '2024-04-24T08:26:10.001660+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.001660+0000', 'last_undegraded': '2024-04-24T08:26:10.001660+0000', 'last_fullsized': '2024-04-24T08:26:10.001660+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-24T08:26:15.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-04-24T08:26:15.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.000817+0000', 'last_change': '2024-04-24T08:26:10.000817+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.000817+0000', 'last_undegraded': '2024-04-24T08:26:10.000817+0000', 'last_fullsized': '2024-04-24T08:26:10.000817+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-24T08:26:15.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-04-24T08:26:15.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.002837+0000', 'last_change': '2024-04-24T08:26:10.002837+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.002837+0000', 'last_undegraded': '2024-04-24T08:26:10.002837+0000', 'last_fullsized': '2024-04-24T08:26:10.002837+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-24T08:26:15.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-04-24T08:26:15.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.988697+0000', 'last_change': '2024-04-24T08:26:09.988697+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.988697+0000', 'last_undegraded': '2024-04-24T08:26:09.988697+0000', 'last_fullsized': '2024-04-24T08:26:09.988697+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-24T08:26:15.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-04-24T08:26:15.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.996359+0000', 'last_change': '2024-04-24T08:26:09.996359+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.996359+0000', 'last_undegraded': '2024-04-24T08:26:09.996359+0000', 'last_fullsized': '2024-04-24T08:26:09.996359+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-24T08:26:15.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-04-24T08:26:15.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.004718+0000', 'last_change': '2024-04-24T08:26:10.004718+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.004718+0000', 'last_undegraded': '2024-04-24T08:26:10.004718+0000', 'last_fullsized': '2024-04-24T08:26:10.004718+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-24T08:26:15.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-04-24T08:26:15.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.988191+0000', 'last_change': '2024-04-24T08:26:09.988191+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.988191+0000', 'last_undegraded': '2024-04-24T08:26:09.988191+0000', 'last_fullsized': '2024-04-24T08:26:09.988191+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-24T08:26:15.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-04-24T08:26:15.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.001488+0000', 'last_change': '2024-04-24T08:26:10.001488+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.001488+0000', 'last_undegraded': '2024-04-24T08:26:10.001488+0000', 'last_fullsized': '2024-04-24T08:26:10.001488+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-24T08:26:15.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-24T08:26:15.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.994075+0000', 'last_change': '2024-04-24T08:26:09.994075+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.994075+0000', 'last_undegraded': '2024-04-24T08:26:09.994075+0000', 'last_fullsized': '2024-04-24T08:26:09.994075+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-24T08:26:15.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-24T08:26:15.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.987621+0000', 'last_change': '2024-04-24T08:26:09.987621+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.987621+0000', 'last_undegraded': '2024-04-24T08:26:09.987621+0000', 'last_fullsized': '2024-04-24T08:26:09.987621+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-24T08:26:15.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-24T08:26:15.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.995850+0000', 'last_change': '2024-04-24T08:26:09.995850+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.995850+0000', 'last_undegraded': '2024-04-24T08:26:09.995850+0000', 'last_fullsized': '2024-04-24T08:26:09.995850+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-24T08:26:15.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-04-24T08:26:15.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.999811+0000', 'last_change': '2024-04-24T08:26:09.999811+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.999811+0000', 'last_undegraded': '2024-04-24T08:26:09.999811+0000', 'last_fullsized': '2024-04-24T08:26:09.999811+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-24T08:26:15.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-24T08:26:15.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.997862+0000', 'last_change': '2024-04-24T08:26:09.997862+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.997862+0000', 'last_undegraded': '2024-04-24T08:26:09.997862+0000', 'last_fullsized': '2024-04-24T08:26:09.997862+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-24T08:26:15.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-24T08:26:15.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.988157+0000', 'last_change': '2024-04-24T08:26:09.988157+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.988157+0000', 'last_undegraded': '2024-04-24T08:26:09.988157+0000', 'last_fullsized': '2024-04-24T08:26:09.988157+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-24T08:26:15.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-24T08:26:15.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.993839+0000', 'last_change': '2024-04-24T08:26:09.993839+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.993839+0000', 'last_undegraded': '2024-04-24T08:26:09.993839+0000', 'last_fullsized': '2024-04-24T08:26:09.993839+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-24T08:26:15.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-04-24T08:26:15.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.995713+0000', 'last_change': '2024-04-24T08:26:09.995713+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.995713+0000', 'last_undegraded': '2024-04-24T08:26:09.995713+0000', 'last_fullsized': '2024-04-24T08:26:09.995713+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-24T08:26:15.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-24T08:26:15.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.988552+0000', 'last_change': '2024-04-24T08:26:09.988552+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.988552+0000', 'last_undegraded': '2024-04-24T08:26:09.988552+0000', 'last_fullsized': '2024-04-24T08:26:09.988552+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-24T08:26:15.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-24T08:26:15.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.997134+0000', 'last_change': '2024-04-24T08:26:09.997134+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.997134+0000', 'last_undegraded': '2024-04-24T08:26:09.997134+0000', 'last_fullsized': '2024-04-24T08:26:09.997134+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-24T08:26:15.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-24T08:26:15.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.994423+0000', 'last_change': '2024-04-24T08:26:09.994423+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.994423+0000', 'last_undegraded': '2024-04-24T08:26:09.994423+0000', 'last_fullsized': '2024-04-24T08:26:09.994423+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-24T08:26:15.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-24T08:26:15.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.990398+0000', 'last_change': '2024-04-24T08:26:09.990398+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.990398+0000', 'last_undegraded': '2024-04-24T08:26:09.990398+0000', 'last_fullsized': '2024-04-24T08:26:09.990398+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-24T08:26:15.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-04-24T08:26:15.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.999314+0000', 'last_change': '2024-04-24T08:26:09.999314+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.999314+0000', 'last_undegraded': '2024-04-24T08:26:09.999314+0000', 'last_fullsized': '2024-04-24T08:26:09.999314+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-24T08:26:15.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-24T08:26:15.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.994268+0000', 'last_change': '2024-04-24T08:26:09.994268+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.994268+0000', 'last_undegraded': '2024-04-24T08:26:09.994268+0000', 'last_fullsized': '2024-04-24T08:26:09.994268+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-24T08:26:15.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-24T08:26:15.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.001133+0000', 'last_change': '2024-04-24T08:26:10.001133+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.001133+0000', 'last_undegraded': '2024-04-24T08:26:10.001133+0000', 'last_fullsized': '2024-04-24T08:26:10.001133+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-24T08:26:15.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-24T08:26:15.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.987613+0000', 'last_change': '2024-04-24T08:26:09.987613+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.987613+0000', 'last_undegraded': '2024-04-24T08:26:09.987613+0000', 'last_fullsized': '2024-04-24T08:26:09.987613+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-24T08:26:15.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-24T08:26:15.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.996807+0000', 'last_change': '2024-04-24T08:26:09.996807+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.996807+0000', 'last_undegraded': '2024-04-24T08:26:09.996807+0000', 'last_fullsized': '2024-04-24T08:26:09.996807+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-24T08:26:15.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-24T08:26:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.992534+0000', 'last_change': '2024-04-24T08:26:09.992534+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.992534+0000', 'last_undegraded': '2024-04-24T08:26:09.992534+0000', 'last_fullsized': '2024-04-24T08:26:09.992534+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-24T08:26:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-04-24T08:26:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.999846+0000', 'last_change': '2024-04-24T08:26:09.999846+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.999846+0000', 'last_undegraded': '2024-04-24T08:26:09.999846+0000', 'last_fullsized': '2024-04-24T08:26:09.999846+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-24T08:26:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-24T08:26:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.992115+0000', 'last_change': '2024-04-24T08:26:09.992115+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.992115+0000', 'last_undegraded': '2024-04-24T08:26:09.992115+0000', 'last_fullsized': '2024-04-24T08:26:09.992115+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-24T08:26:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-24T08:26:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.991117+0000', 'last_change': '2024-04-24T08:26:09.991117+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.991117+0000', 'last_undegraded': '2024-04-24T08:26:09.991117+0000', 'last_fullsized': '2024-04-24T08:26:09.991117+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-24T08:26:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-24T08:26:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.991413+0000', 'last_change': '2024-04-24T08:26:09.991413+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.991413+0000', 'last_undegraded': '2024-04-24T08:26:09.991413+0000', 'last_fullsized': '2024-04-24T08:26:09.991413+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-24T08:26:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-24T08:26:15.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.991033+0000', 'last_change': '2024-04-24T08:26:09.991033+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.991033+0000', 'last_undegraded': '2024-04-24T08:26:09.991033+0000', 'last_fullsized': '2024-04-24T08:26:09.991033+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-24T08:26:15.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-24T08:26:15.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:10.003297+0000', 'last_change': '2024-04-24T08:26:10.003297+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:10.003297+0000', 'last_undegraded': '2024-04-24T08:26:10.003297+0000', 'last_fullsized': '2024-04-24T08:26:10.003297+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-24T08:26:15.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-24T08:26:15.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.991598+0000', 'last_change': '2024-04-24T08:26:09.991598+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.991598+0000', 'last_undegraded': '2024-04-24T08:26:09.991598+0000', 'last_fullsized': '2024-04-24T08:26:09.991598+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-24T08:26:15.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-24T08:26:15.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.990275+0000', 'last_change': '2024-04-24T08:26:09.990275+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.990275+0000', 'last_undegraded': '2024-04-24T08:26:09.990275+0000', 'last_fullsized': '2024-04-24T08:26:09.990275+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-24T08:26:15.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-24T08:26:15.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.994586+0000', 'last_change': '2024-04-24T08:26:09.994586+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.994586+0000', 'last_undegraded': '2024-04-24T08:26:09.994586+0000', 'last_fullsized': '2024-04-24T08:26:09.994586+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-24T08:26:15.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-24T08:26:15.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.987633+0000', 'last_change': '2024-04-24T08:26:09.987633+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.987633+0000', 'last_undegraded': '2024-04-24T08:26:09.987633+0000', 'last_fullsized': '2024-04-24T08:26:09.987633+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-24T08:26:15.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-24T08:26:15.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.993430+0000', 'last_change': '2024-04-24T08:26:09.993430+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.993430+0000', 'last_undegraded': '2024-04-24T08:26:09.993430+0000', 'last_fullsized': '2024-04-24T08:26:09.993430+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-24T08:26:15.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-24T08:26:15.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.994343+0000', 'last_change': '2024-04-24T08:26:09.994343+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.994343+0000', 'last_undegraded': '2024-04-24T08:26:09.994343+0000', 'last_fullsized': '2024-04-24T08:26:09.994343+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-24T08:26:15.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-24T08:26:15.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.996199+0000', 'last_change': '2024-04-24T08:26:09.996199+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.996199+0000', 'last_undegraded': '2024-04-24T08:26:09.996199+0000', 'last_fullsized': '2024-04-24T08:26:09.996199+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-24T08:26:15.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-24T08:26:15.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-04-24T08:26:09.997779+0000', 'last_change': '2024-04-24T08:26:09.997779+0000', 'last_active': '2024-04-24T08:26:09.977032+0000', 'last_peered': '2024-04-24T08:26:09.977032+0000', 'last_clean': '2024-04-24T08:26:09.977032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-24T08:26:09.997779+0000', 'last_undegraded': '2024-04-24T08:26:09.997779+0000', 'last_fullsized': '2024-04-24T08:26:09.997779+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'last_clean_scrub_stamp': '2024-04-24T08:26:09.977032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-24T08:26:15.828 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-24T08:26:15.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d7e00640 1 Processor -- start 2024-04-24T08:26:15.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d7e00640 1 -- start start 2024-04-24T08:26:15.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d7e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f06d80bbe40 0x7f06d8141a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d7e00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d80bc220 con 0x7f06d80b7940 2024-04-24T08:26:15.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d7e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d806e440 con 0x7f06d8141f50 2024-04-24T08:26:15.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d7e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f06d806ec40 con 0x7f06d80bbe40 2024-04-24T08:26:15.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06ce000640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f06d80b7940 0x7f06d814b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38058/0 (socket says 172.21.15.88:38058) 2024-04-24T08:26:15.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06ce000640 1 -- 172.21.15.88:0/162623535 learned_addr learned my addr 172.21.15.88:0/162623535 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:15.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d6a00640 1 --2- 172.21.15.88:0/162623535 >> v2:172.21.15.142:3300/0 conn(0x7f06d80bbe40 0x7f06d8141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d6000640 1 -- 172.21.15.88:0/162623535 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 167709769 0 0) 0x7f06d80bc220 con 0x7f06d80b7940 2024-04-24T08:26:15.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d6000640 1 -- 172.21.15.88:0/162623535 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06bc003530 con 0x7f06d80b7940 2024-04-24T08:26:15.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d6000640 1 -- 172.21.15.88:0/162623535 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8377461 0 0) 0x7f06d806e440 con 0x7f06d8141f50 2024-04-24T08:26:15.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d6000640 1 -- 172.21.15.88:0/162623535 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06d80bc220 con 0x7f06d8141f50 2024-04-24T08:26:15.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d6a00640 1 -- 172.21.15.88:0/162623535 >> v1:172.21.15.142:6789/0 conn(0x7f06d8141f50 legacy=0x7f06d8152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d6a00640 1 -- 172.21.15.88:0/162623535 >> v1:172.21.15.88:6789/0 conn(0x7f06d80b7940 legacy=0x7f06d814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.985+0000 7f06d6a00640 1 -- 172.21.15.88:0/162623535 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d806dac0 con 0x7f06d80bbe40 2024-04-24T08:26:15.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.989+0000 7f06d6a00640 1 --2- 172.21.15.88:0/162623535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06d80bbe40 0x7f06d8141a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06c80097c0 tx=0x7f06c801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb284641159b5523 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:15.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.989+0000 7f06d6000640 1 -- 172.21.15.88:0/162623535 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c80b0070 con 0x7f06d80bbe40 2024-04-24T08:26:15.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.989+0000 7f06d6000640 1 -- 172.21.15.88:0/162623535 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c80ab600 con 0x7f06d80bbe40 2024-04-24T08:26:15.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.989+0000 7f06d6000640 1 -- 172.21.15.88:0/162623535 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c80ab9d0 con 0x7f06d80bbe40 2024-04-24T08:26:15.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.989+0000 7f06d7e00640 1 -- 172.21.15.88:0/162623535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06d80bbe40 msgr2=0x7f06d8141a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.989+0000 7f06d7e00640 1 --2- 172.21.15.88:0/162623535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06d80bbe40 0x7f06d8141a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06c80097c0 tx=0x7f06c801c410 comp rx=0 tx=0).stop 2024-04-24T08:26:15.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.989+0000 7f06d7e00640 1 -- 172.21.15.88:0/162623535 shutdown_connections 2024-04-24T08:26:15.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.989+0000 7f06d7e00640 1 --2- 172.21.15.88:0/162623535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06d80bbe40 0x7f06d8141a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.989+0000 7f06d7e00640 1 -- 172.21.15.88:0/162623535 >> 172.21.15.88:0/162623535 conn(0x7f06d8067e10 msgr2=0x7f06d80bb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:15.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.989+0000 7f06d7e00640 1 -- 172.21.15.88:0/162623535 shutdown_connections 2024-04-24T08:26:15.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.989+0000 7f06d7e00640 1 -- 172.21.15.88:0/162623535 wait complete. 2024-04-24T08:26:15.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7e00640 1 Processor -- start 2024-04-24T08:26:15.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7e00640 1 -- start start 2024-04-24T08:26:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06d80bbe40 0x7f06d81371a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06d8141f50 0x7f06d80ba670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06d80babb0 0x7f06d8130c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f06d8156770 con 0x7f06d8141f50 2024-04-24T08:26:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81568f0 con 0x7f06d80bbe40 2024-04-24T08:26:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f06d8156a70 con 0x7f06d80babb0 2024-04-24T08:26:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06ce000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06d8141f50 0x7f06d80ba670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06ce000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06d8141f50 0x7f06d80ba670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59834/0 (socket says 172.21.15.88:59834) 2024-04-24T08:26:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06ce000640 1 -- 172.21.15.88:0/8841288 learned_addr learned my addr 172.21.15.88:0/8841288 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06ce000640 1 -- 172.21.15.88:0/8841288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06d80babb0 msgr2=0x7f06d8130c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d6a00640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06d80bbe40 0x7f06d81371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7400640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06d80babb0 0x7f06d8130c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06ce000640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06d80babb0 0x7f06d8130c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06ce000640 1 -- 172.21.15.88:0/8841288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06d80bbe40 msgr2=0x7f06d81371a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06ce000640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06d80bbe40 0x7f06d81371a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06ce000640 1 -- 172.21.15.88:0/8841288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d8148c10 con 0x7f06d8141f50 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d6a00640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06d80bbe40 0x7f06d81371a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7400640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06d80babb0 0x7f06d8130c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06ce000640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06d8141f50 0x7f06d80ba670 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f06c000c520 tx=0x7f06c000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06cfe00640 1 -- 172.21.15.88:0/8841288 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c0017070 con 0x7f06d8141f50 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06cfe00640 1 -- 172.21.15.88:0/8841288 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c0005cf0 con 0x7f06d8141f50 2024-04-24T08:26:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06cfe00640 1 -- 172.21.15.88:0/8841288 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c0007270 con 0x7f06d8141f50 2024-04-24T08:26:15.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7e00640 1 -- 172.21.15.88:0/8841288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d80b3ed0 con 0x7f06d8141f50 2024-04-24T08:26:15.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7e00640 1 -- 172.21.15.88:0/8841288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d80b2bc0 con 0x7f06d8141f50 2024-04-24T08:26:15.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.993+0000 7f06d7e00640 1 -- 172.21.15.88:0/8841288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d8068b20 con 0x7f06d8141f50 2024-04-24T08:26:15.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.997+0000 7f06cfe00640 1 -- 172.21.15.88:0/8841288 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f06c001a070 con 0x7f06d8141f50 2024-04-24T08:26:15.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.997+0000 7f06cfe00640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f06b4068380 0x7f06b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:15.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.997+0000 7f06cfe00640 1 -- 172.21.15.88:0/8841288 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f06c0085c90 con 0x7f06d8141f50 2024-04-24T08:26:15.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.997+0000 7f06d6a00640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f06b4068380 0x7f06b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:16.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:15.997+0000 7f06d6a00640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f06b4068380 0x7f06b406a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06c80ad000 tx=0x7f06c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:16.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.001+0000 7f06cfe00640 1 -- 172.21.15.88:0/8841288 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06c0055bf0 con 0x7f06d8141f50 2024-04-24T08:26:16.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.213+0000 7f06d7e00640 1 -- 172.21.15.88:0/8841288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f06d80b1910 con 0x7f06d8141f50 2024-04-24T08:26:16.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.213+0000 7f06cfe00640 1 -- 172.21.15.88:0/8841288 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2388 (secure 0 0 0) 0x7f06c0059ef0 con 0x7f06d8141f50 2024-04-24T08:26:16.217 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:16.217 INFO:teuthology.orchestra.run.smithi088.stdout:{"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":74,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":29,"num_osds":8,"num_up_osds":8,"osd_up_since":1713947114,"num_in_osds":8,"osd_in_since":1713947104,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224821248,"bytes_avail":772869292032,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4962}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-04-24T08:26:08.995781+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-24T08:26:16.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.217+0000 7f06d7e00640 1 -- 172.21.15.88:0/8841288 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f06b4068380 msgr2=0x7f06b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:16.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.217+0000 7f06d7e00640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f06b4068380 0x7f06b406a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06c80ad000 tx=0x7f06c8008040 comp rx=0 tx=0).stop 2024-04-24T08:26:16.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.217+0000 7f06d7e00640 1 -- 172.21.15.88:0/8841288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06d8141f50 msgr2=0x7f06d80ba670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:16.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.217+0000 7f06d7e00640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06d8141f50 0x7f06d80ba670 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f06c000c520 tx=0x7f06c000c9e0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.217+0000 7f06d7e00640 1 -- 172.21.15.88:0/8841288 shutdown_connections 2024-04-24T08:26:16.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.217+0000 7f06d7e00640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f06b4068380 0x7f06b406a840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.217+0000 7f06d7e00640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06d80babb0 0x7f06d8130c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.217+0000 7f06d7e00640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06d8141f50 0x7f06d80ba670 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.217+0000 7f06d7e00640 1 --2- 172.21.15.88:0/8841288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06d80bbe40 0x7f06d81371a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.217+0000 7f06d7e00640 1 -- 172.21.15.88:0/8841288 >> 172.21.15.88:0/8841288 conn(0x7f06d8067e10 msgr2=0x7f06d8074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:16.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.217+0000 7f06d7e00640 1 -- 172.21.15.88:0/8841288 shutdown_connections 2024-04-24T08:26:16.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.217+0000 7f06d7e00640 1 -- 172.21.15.88:0/8841288 wait complete. 2024-04-24T08:26:16.239 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-24T08:26:16.239 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:26:16.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.369+0000 7f4673000640 1 Processor -- start 2024-04-24T08:26:16.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4673000640 1 -- start start 2024-04-24T08:26:16.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4673000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f466c0bbe40 0x7f466c0b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:16.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4673000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f466c148ee0 0x7f466c0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:16.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4673000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466c0bc220 con 0x7f466c13f630 2024-04-24T08:26:16.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4673000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f466c0b3c20 con 0x7f466c148ee0 2024-04-24T08:26:16.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4673000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f466c0b46d0 con 0x7f466c0bbe40 2024-04-24T08:26:16.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4671200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f466c148ee0 0x7f466c0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:16.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4671200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f466c148ee0 0x7f466c0b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59836/0 (socket says 172.21.15.88:59836) 2024-04-24T08:26:16.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4671200640 1 -- 172.21.15.88:0/2781787628 learned_addr learned my addr 172.21.15.88:0/2781787628 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:16.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4671c00640 1 --2- 172.21.15.88:0/2781787628 >> v2:172.21.15.142:3300/0 conn(0x7f466c0bbe40 0x7f466c0b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:16.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4671200640 1 -- 172.21.15.88:0/2781787628 >> v2:172.21.15.142:3300/0 conn(0x7f466c0bbe40 msgr2=0x7f466c0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:16.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4671200640 1 --2- 172.21.15.88:0/2781787628 >> v2:172.21.15.142:3300/0 conn(0x7f466c0bbe40 0x7f466c0b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4671200640 1 -- 172.21.15.88:0/2781787628 >> v1:172.21.15.142:6789/0 conn(0x7f466c13f630 legacy=0x7f466c0725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:16.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.373+0000 7f4671200640 1 -- 172.21.15.88:0/2781787628 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c0b4f00 con 0x7f466c148ee0 2024-04-24T08:26:16.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4671200640 1 --2- 172.21.15.88:0/2781787628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f466c148ee0 0x7f466c0b5420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f466c0b3da0 tx=0x7f465801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe954fa1feecc21a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:16.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f466be00640 1 -- 172.21.15.88:0/2781787628 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580b0070 con 0x7f466c148ee0 2024-04-24T08:26:16.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f466be00640 1 -- 172.21.15.88:0/2781787628 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46580ab600 con 0x7f466c148ee0 2024-04-24T08:26:16.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f466be00640 1 -- 172.21.15.88:0/2781787628 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580ab9d0 con 0x7f466c148ee0 2024-04-24T08:26:16.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 -- 172.21.15.88:0/2781787628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f466c148ee0 msgr2=0x7f466c0b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:16.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 --2- 172.21.15.88:0/2781787628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f466c148ee0 0x7f466c0b5420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f466c0b3da0 tx=0x7f465801c450 comp rx=0 tx=0).stop 2024-04-24T08:26:16.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 -- 172.21.15.88:0/2781787628 shutdown_connections 2024-04-24T08:26:16.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 --2- 172.21.15.88:0/2781787628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f466c148ee0 0x7f466c0b5420 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 --2- 172.21.15.88:0/2781787628 >> v2:172.21.15.142:3300/0 conn(0x7f466c0bbe40 0x7f466c0b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 -- 172.21.15.88:0/2781787628 >> 172.21.15.88:0/2781787628 conn(0x7f466c067e10 msgr2=0x7f466c0bb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:16.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 -- 172.21.15.88:0/2781787628 shutdown_connections 2024-04-24T08:26:16.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 -- 172.21.15.88:0/2781787628 wait complete. 2024-04-24T08:26:16.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 Processor -- start 2024-04-24T08:26:16.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 -- start start 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f466c0bbe40 0x7f466c1505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f466c13f630 0x7f466c1e3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f466c148ee0 0x7f466c1e06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0b7d40 con 0x7f466c13f630 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0b7bc0 con 0x7f466c148ee0 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.377+0000 7f4673000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f466c153290 con 0x7f466c0bbe40 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4671200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f466c13f630 0x7f466c1e3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4671200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f466c13f630 0x7f466c1e3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59852/0 (socket says 172.21.15.88:59852) 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4671200640 1 -- 172.21.15.88:0/809695853 learned_addr learned my addr 172.21.15.88:0/809695853 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4671c00640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f466c0bbe40 0x7f466c1505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4672600640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f466c148ee0 0x7f466c1e06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4671200640 1 -- 172.21.15.88:0/809695853 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f466c0bbe40 msgr2=0x7f466c1505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4671200640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f466c0bbe40 0x7f466c1505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4671200640 1 -- 172.21.15.88:0/809695853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f466c148ee0 msgr2=0x7f466c1e06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:16.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4671200640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f466c148ee0 0x7f466c1e06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4671200640 1 -- 172.21.15.88:0/809695853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c1510a0 con 0x7f466c13f630 2024-04-24T08:26:16.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4671200640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f466c13f630 0x7f466c1e3c50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f465801ab00 tx=0x7f46580191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:16.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4669600640 1 -- 172.21.15.88:0/809695853 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580b0040 con 0x7f466c13f630 2024-04-24T08:26:16.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4669600640 1 -- 172.21.15.88:0/809695853 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46580b9070 con 0x7f466c13f630 2024-04-24T08:26:16.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4673000640 1 -- 172.21.15.88:0/809695853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466c1e45c0 con 0x7f466c13f630 2024-04-24T08:26:16.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4669600640 1 -- 172.21.15.88:0/809695853 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580b4680 con 0x7f466c13f630 2024-04-24T08:26:16.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4673000640 1 -- 172.21.15.88:0/809695853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466c06eaa0 con 0x7f466c13f630 2024-04-24T08:26:16.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4673000640 1 -- 172.21.15.88:0/809695853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466c06e3f0 con 0x7f466c13f630 2024-04-24T08:26:16.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.381+0000 7f4669600640 1 -- 172.21.15.88:0/809695853 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f46580b4820 con 0x7f466c13f630 2024-04-24T08:26:16.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.385+0000 7f4669600640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f464c068380 0x7f464c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:16.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.385+0000 7f4669600640 1 -- 172.21.15.88:0/809695853 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f46581204d0 con 0x7f466c13f630 2024-04-24T08:26:16.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.385+0000 7f4671c00640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f464c068380 0x7f464c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:16.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.385+0000 7f4671c00640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f464c068380 0x7f464c06a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f466c14e5d0 tx=0x7f4660008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:16.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.389+0000 7f4669600640 1 -- 172.21.15.88:0/809695853 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f466c1510a0 con 0x7f466c13f630 2024-04-24T08:26:16.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.549+0000 7f4673000640 1 -- 172.21.15.88:0/809695853 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f466c138410 con 0x7f464c068380 2024-04-24T08:26:16.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.553+0000 7f4669600640 1 -- 172.21.15.88:0/809695853 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246632 (secure 0 0 0) 0x7f466c138410 con 0x7f464c068380 2024-04-24T08:26:16.559 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:16.561 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:26:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.557+0000 7f4673000640 1 -- 172.21.15.88:0/809695853 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f464c068380 msgr2=0x7f464c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.557+0000 7f4673000640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f464c068380 0x7f464c06a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f466c14e5d0 tx=0x7f4660008040 comp rx=0 tx=0).stop 2024-04-24T08:26:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.557+0000 7f4673000640 1 -- 172.21.15.88:0/809695853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f466c13f630 msgr2=0x7f466c1e3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.557+0000 7f4673000640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f466c13f630 0x7f466c1e3c50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f465801ab00 tx=0x7f46580191f0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.557+0000 7f4673000640 1 -- 172.21.15.88:0/809695853 shutdown_connections 2024-04-24T08:26:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.557+0000 7f4673000640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f464c068380 0x7f464c06a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.557+0000 7f4673000640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f466c148ee0 0x7f466c1e06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.557+0000 7f4673000640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f466c13f630 0x7f466c1e3c50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.557+0000 7f4673000640 1 --2- 172.21.15.88:0/809695853 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f466c0bbe40 0x7f466c1505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.557+0000 7f4673000640 1 -- 172.21.15.88:0/809695853 >> 172.21.15.88:0/809695853 conn(0x7f466c067e10 msgr2=0x7f466c0b96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.557+0000 7f4673000640 1 -- 172.21.15.88:0/809695853 shutdown_connections 2024-04-24T08:26:16.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:16.557+0000 7f4673000640 1 -- 172.21.15.88:0/809695853 wait complete. 2024-04-24T08:26:16.579 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-24T08:26:14.997702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219552,"kb_used_data":3388,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755168,"statfs":{"total":773094113280,"available":772869292032,"internally_reserved":0,"allocated":3469312,"data_stored":2012279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001963"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.989140+0000","last_change":"2024-04-24T08:26:09.989140+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.989140+0000","last_undegraded":"2024-04-24T08:26:09.989140+0000","last_fullsized":"2024-04-24T08:26:09.989140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001542+0000","last_change":"2024-04-24T08:26:10.001542+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001542+0000","last_undegraded":"2024-04-24T08:26:10.001542+0000","last_fullsized":"2024-04-24T08:26:10.001542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.989547+0000","last_change":"2024-04-24T08:26:09.989547+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.989547+0000","last_undegraded":"2024-04-24T08:26:09.989547+0000","last_fullsized":"2024-04-24T08:26:09.989547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.000316+0000","last_change":"2024-04-24T08:26:10.000316+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.000316+0000","last_undegraded":"2024-04-24T08:26:10.000316+0000","last_fullsized":"2024-04-24T08:26:10.000316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993335+0000","last_change":"2024-04-24T08:26:09.993335+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993335+0000","last_undegraded":"2024-04-24T08:26:09.993335+0000","last_fullsized":"2024-04-24T08:26:09.993335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996148+0000","last_change":"2024-04-24T08:26:09.996148+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996148+0000","last_undegraded":"2024-04-24T08:26:09.996148+0000","last_fullsized":"2024-04-24T08:26:09.996148+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.998223+0000","last_change":"2024-04-24T08:26:09.998223+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.998223+0000","last_undegraded":"2024-04-24T08:26:09.998223+0000","last_fullsized":"2024-04-24T08:26:09.998223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.005694+0000","last_change":"2024-04-24T08:26:10.005694+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.005694+0000","last_undegraded":"2024-04-24T08:26:10.005694+0000","last_fullsized":"2024-04-24T08:26:10.005694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994611+0000","last_change":"2024-04-24T08:26:09.994611+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994611+0000","last_undegraded":"2024-04-24T08:26:09.994611+0000","last_fullsized":"2024-04-24T08:26:09.994611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001178+0000","last_change":"2024-04-24T08:26:10.001178+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001178+0000","last_undegraded":"2024-04-24T08:26:10.001178+0000","last_fullsized":"2024-04-24T08:26:10.001178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.000368+0000","last_change":"2024-04-24T08:26:10.000368+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.000368+0000","last_undegraded":"2024-04-24T08:26:10.000368+0000","last_fullsized":"2024-04-24T08:26:10.000368+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.989129+0000","last_change":"2024-04-24T08:26:09.989129+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.989129+0000","last_undegraded":"2024-04-24T08:26:09.989129+0000","last_fullsized":"2024-04-24T08:26:09.989129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992725+0000","last_change":"2024-04-24T08:26:09.992725+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992725+0000","last_undegraded":"2024-04-24T08:26:09.992725+0000","last_fullsized":"2024-04-24T08:26:09.992725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.995485+0000","last_change":"2024-04-24T08:26:09.995485+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.995485+0000","last_undegraded":"2024-04-24T08:26:09.995485+0000","last_fullsized":"2024-04-24T08:26:09.995485+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988040+0000","last_change":"2024-04-24T08:26:09.988040+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988040+0000","last_undegraded":"2024-04-24T08:26:09.988040+0000","last_fullsized":"2024-04-24T08:26:09.988040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997371+0000","last_change":"2024-04-24T08:26:09.997371+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997371+0000","last_undegraded":"2024-04-24T08:26:09.997371+0000","last_fullsized":"2024-04-24T08:26:09.997371+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.003109+0000","last_change":"2024-04-24T08:26:10.003109+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.003109+0000","last_undegraded":"2024-04-24T08:26:10.003109+0000","last_fullsized":"2024-04-24T08:26:10.003109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001167+0000","last_change":"2024-04-24T08:26:10.001167+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001167+0000","last_undegraded":"2024-04-24T08:26:10.001167+0000","last_fullsized":"2024-04-24T08:26:10.001167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997140+0000","last_change":"2024-04-24T08:26:09.997140+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997140+0000","last_undegraded":"2024-04-24T08:26:09.997140+0000","last_fullsized":"2024-04-24T08:26:09.997140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992158+0000","last_change":"2024-04-24T08:26:09.992158+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992158+0000","last_undegraded":"2024-04-24T08:26:09.992158+0000","last_fullsized":"2024-04-24T08:26:09.992158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997888+0000","last_change":"2024-04-24T08:26:09.997888+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997888+0000","last_undegraded":"2024-04-24T08:26:09.997888+0000","last_fullsized":"2024-04-24T08:26:09.997888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992820+0000","last_change":"2024-04-24T08:26:09.992820+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992820+0000","last_undegraded":"2024-04-24T08:26:09.992820+0000","last_fullsized":"2024-04-24T08:26:09.992820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993036+0000","last_change":"2024-04-24T08:26:09.993036+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993036+0000","last_undegraded":"2024-04-24T08:26:09.993036+0000","last_fullsized":"2024-04-24T08:26:09.993036+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988436+0000","last_change":"2024-04-24T08:26:09.988436+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988436+0000","last_undegraded":"2024-04-24T08:26:09.988436+0000","last_fullsized":"2024-04-24T08:26:09.988436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001660+0000","last_change":"2024-04-24T08:26:10.001660+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001660+0000","last_undegraded":"2024-04-24T08:26:10.001660+0000","last_fullsized":"2024-04-24T08:26:10.001660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.000817+0000","last_change":"2024-04-24T08:26:10.000817+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.000817+0000","last_undegraded":"2024-04-24T08:26:10.000817+0000","last_fullsized":"2024-04-24T08:26:10.000817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.002837+0000","last_change":"2024-04-24T08:26:10.002837+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.002837+0000","last_undegraded":"2024-04-24T08:26:10.002837+0000","last_fullsized":"2024-04-24T08:26:10.002837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988697+0000","last_change":"2024-04-24T08:26:09.988697+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988697+0000","last_undegraded":"2024-04-24T08:26:09.988697+0000","last_fullsized":"2024-04-24T08:26:09.988697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996359+0000","last_change":"2024-04-24T08:26:09.996359+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996359+0000","last_undegraded":"2024-04-24T08:26:09.996359+0000","last_fullsized":"2024-04-24T08:26:09.996359+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.004718+0000","last_change":"2024-04-24T08:26:10.004718+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.004718+0000","last_undegraded":"2024-04-24T08:26:10.004718+0000","last_fullsized":"2024-04-24T08:26:10.004718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988191+0000","last_change":"2024-04-24T08:26:09.988191+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988191+0000","last_undegraded":"2024-04-24T08:26:09.988191+0000","last_fullsized":"2024-04-24T08:26:09.988191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001488+0000","last_change":"2024-04-24T08:26:10.001488+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001488+0000","last_undegraded":"2024-04-24T08:26:10.001488+0000","last_fullsized":"2024-04-24T08:26:10.001488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994075+0000","last_change":"2024-04-24T08:26:09.994075+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994075+0000","last_undegraded":"2024-04-24T08:26:09.994075+0000","last_fullsized":"2024-04-24T08:26:09.994075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.010907+0000","last_change":"2024-04-24T08:26:10.005901+0000","last_active":"2024-04-24T08:26:10.010907+0000","last_peered":"2024-04-24T08:26:10.010907+0000","last_clean":"2024-04-24T08:26:10.010907+0000","last_became_active":"2024-04-24T08:26:10.005611+0000","last_became_peered":"2024-04-24T08:26:10.005611+0000","last_unstale":"2024-04-24T08:26:10.010907+0000","last_undegraded":"2024-04-24T08:26:10.010907+0000","last_fullsized":"2024-04-24T08:26:10.010907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.987621+0000","last_change":"2024-04-24T08:26:09.987621+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.987621+0000","last_undegraded":"2024-04-24T08:26:09.987621+0000","last_fullsized":"2024-04-24T08:26:09.987621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015491+0000","last_change":"2024-04-24T08:26:10.012103+0000","last_active":"2024-04-24T08:26:10.015491+0000","last_peered":"2024-04-24T08:26:10.015491+0000","last_clean":"2024-04-24T08:26:10.015491+0000","last_became_active":"2024-04-24T08:26:10.011846+0000","last_became_peered":"2024-04-24T08:26:10.011846+0000","last_unstale":"2024-04-24T08:26:10.015491+0000","last_undegraded":"2024-04-24T08:26:10.015491+0000","last_fullsized":"2024-04-24T08:26:10.015491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:04.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.995850+0000","last_change":"2024-04-24T08:26:09.995850+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.995850+0000","last_undegraded":"2024-04-24T08:26:09.995850+0000","last_fullsized":"2024-04-24T08:26:09.995850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016320+0000","last_change":"2024-04-24T08:26:10.013217+0000","last_active":"2024-04-24T08:26:10.016320+0000","last_peered":"2024-04-24T08:26:10.016320+0000","last_clean":"2024-04-24T08:26:10.016320+0000","last_became_active":"2024-04-24T08:26:10.012939+0000","last_became_peered":"2024-04-24T08:26:10.012939+0000","last_unstale":"2024-04-24T08:26:10.016320+0000","last_undegraded":"2024-04-24T08:26:10.016320+0000","last_fullsized":"2024-04-24T08:26:10.016320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:01:44.547438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.999811+0000","last_change":"2024-04-24T08:26:09.999811+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.999811+0000","last_undegraded":"2024-04-24T08:26:09.999811+0000","last_fullsized":"2024-04-24T08:26:09.999811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.012245+0000","last_change":"2024-04-24T08:26:10.005714+0000","last_active":"2024-04-24T08:26:10.012245+0000","last_peered":"2024-04-24T08:26:10.012245+0000","last_clean":"2024-04-24T08:26:10.012245+0000","last_became_active":"2024-04-24T08:26:10.005299+0000","last_became_peered":"2024-04-24T08:26:10.005299+0000","last_unstale":"2024-04-24T08:26:10.012245+0000","last_undegraded":"2024-04-24T08:26:10.012245+0000","last_fullsized":"2024-04-24T08:26:10.012245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:09:35.770606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997862+0000","last_change":"2024-04-24T08:26:09.997862+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997862+0000","last_undegraded":"2024-04-24T08:26:09.997862+0000","last_fullsized":"2024-04-24T08:26:09.997862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.013755+0000","last_change":"2024-04-24T08:26:10.010287+0000","last_active":"2024-04-24T08:26:10.013755+0000","last_peered":"2024-04-24T08:26:10.013755+0000","last_clean":"2024-04-24T08:26:10.013755+0000","last_became_active":"2024-04-24T08:26:10.009987+0000","last_became_peered":"2024-04-24T08:26:10.009987+0000","last_unstale":"2024-04-24T08:26:10.013755+0000","last_undegraded":"2024-04-24T08:26:10.013755+0000","last_fullsized":"2024-04-24T08:26:10.013755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:15:15.487296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988157+0000","last_change":"2024-04-24T08:26:09.988157+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988157+0000","last_undegraded":"2024-04-24T08:26:09.988157+0000","last_fullsized":"2024-04-24T08:26:09.988157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.011071+0000","last_change":"2024-04-24T08:26:10.008606+0000","last_active":"2024-04-24T08:26:10.011071+0000","last_peered":"2024-04-24T08:26:10.011071+0000","last_clean":"2024-04-24T08:26:10.011071+0000","last_became_active":"2024-04-24T08:26:10.008258+0000","last_became_peered":"2024-04-24T08:26:10.008258+0000","last_unstale":"2024-04-24T08:26:10.011071+0000","last_undegraded":"2024-04-24T08:26:10.011071+0000","last_fullsized":"2024-04-24T08:26:10.011071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:51.723825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993839+0000","last_change":"2024-04-24T08:26:09.993839+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993839+0000","last_undegraded":"2024-04-24T08:26:09.993839+0000","last_fullsized":"2024-04-24T08:26:09.993839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.010113+0000","last_change":"2024-04-24T08:26:10.002814+0000","last_active":"2024-04-24T08:26:10.010113+0000","last_peered":"2024-04-24T08:26:10.010113+0000","last_clean":"2024-04-24T08:26:10.010113+0000","last_became_active":"2024-04-24T08:26:10.002502+0000","last_became_peered":"2024-04-24T08:26:10.002502+0000","last_unstale":"2024-04-24T08:26:10.010113+0000","last_undegraded":"2024-04-24T08:26:10.010113+0000","last_fullsized":"2024-04-24T08:26:10.010113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:45.812010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.995713+0000","last_change":"2024-04-24T08:26:09.995713+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.995713+0000","last_undegraded":"2024-04-24T08:26:09.995713+0000","last_fullsized":"2024-04-24T08:26:09.995713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.006092+0000","last_change":"2024-04-24T08:26:10.002174+0000","last_active":"2024-04-24T08:26:10.006092+0000","last_peered":"2024-04-24T08:26:10.006092+0000","last_clean":"2024-04-24T08:26:10.006092+0000","last_became_active":"2024-04-24T08:26:10.001830+0000","last_became_peered":"2024-04-24T08:26:10.001830+0000","last_unstale":"2024-04-24T08:26:10.006092+0000","last_undegraded":"2024-04-24T08:26:10.006092+0000","last_fullsized":"2024-04-24T08:26:10.006092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:55:48.686733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.988552+0000","last_change":"2024-04-24T08:26:09.988552+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.988552+0000","last_undegraded":"2024-04-24T08:26:09.988552+0000","last_fullsized":"2024-04-24T08:26:09.988552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016286+0000","last_change":"2024-04-24T08:26:10.013100+0000","last_active":"2024-04-24T08:26:10.016286+0000","last_peered":"2024-04-24T08:26:10.016286+0000","last_clean":"2024-04-24T08:26:10.016286+0000","last_became_active":"2024-04-24T08:26:10.012809+0000","last_became_peered":"2024-04-24T08:26:10.012809+0000","last_unstale":"2024-04-24T08:26:10.016286+0000","last_undegraded":"2024-04-24T08:26:10.016286+0000","last_fullsized":"2024-04-24T08:26:10.016286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:14:20.203803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997134+0000","last_change":"2024-04-24T08:26:09.997134+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997134+0000","last_undegraded":"2024-04-24T08:26:09.997134+0000","last_fullsized":"2024-04-24T08:26:09.997134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.014517+0000","last_change":"2024-04-24T08:26:10.011789+0000","last_active":"2024-04-24T08:26:10.014517+0000","last_peered":"2024-04-24T08:26:10.014517+0000","last_clean":"2024-04-24T08:26:10.014517+0000","last_became_active":"2024-04-24T08:26:10.011489+0000","last_became_peered":"2024-04-24T08:26:10.011489+0000","last_unstale":"2024-04-24T08:26:10.014517+0000","last_undegraded":"2024-04-24T08:26:10.014517+0000","last_fullsized":"2024-04-24T08:26:10.014517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:16.723467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994423+0000","last_change":"2024-04-24T08:26:09.994423+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994423+0000","last_undegraded":"2024-04-24T08:26:09.994423+0000","last_fullsized":"2024-04-24T08:26:09.994423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015964+0000","last_change":"2024-04-24T08:26:10.011485+0000","last_active":"2024-04-24T08:26:10.015964+0000","last_peered":"2024-04-24T08:26:10.015964+0000","last_clean":"2024-04-24T08:26:10.015964+0000","last_became_active":"2024-04-24T08:26:10.011166+0000","last_became_peered":"2024-04-24T08:26:10.011166+0000","last_unstale":"2024-04-24T08:26:10.015964+0000","last_undegraded":"2024-04-24T08:26:10.015964+0000","last_fullsized":"2024-04-24T08:26:10.015964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:30:20.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.990398+0000","last_change":"2024-04-24T08:26:09.990398+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.990398+0000","last_undegraded":"2024-04-24T08:26:09.990398+0000","last_fullsized":"2024-04-24T08:26:09.990398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016157+0000","last_change":"2024-04-24T08:26:10.011337+0000","last_active":"2024-04-24T08:26:10.016157+0000","last_peered":"2024-04-24T08:26:10.016157+0000","last_clean":"2024-04-24T08:26:10.016157+0000","last_became_active":"2024-04-24T08:26:10.010603+0000","last_became_peered":"2024-04-24T08:26:10.010603+0000","last_unstale":"2024-04-24T08:26:10.016157+0000","last_undegraded":"2024-04-24T08:26:10.016157+0000","last_fullsized":"2024-04-24T08:26:10.016157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:11:48.720898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.999314+0000","last_change":"2024-04-24T08:26:09.999314+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.999314+0000","last_undegraded":"2024-04-24T08:26:09.999314+0000","last_fullsized":"2024-04-24T08:26:09.999314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.005926+0000","last_change":"2024-04-24T08:26:10.001398+0000","last_active":"2024-04-24T08:26:10.005926+0000","last_peered":"2024-04-24T08:26:10.005926+0000","last_clean":"2024-04-24T08:26:10.005926+0000","last_became_active":"2024-04-24T08:26:10.001113+0000","last_became_peered":"2024-04-24T08:26:10.001113+0000","last_unstale":"2024-04-24T08:26:10.005926+0000","last_undegraded":"2024-04-24T08:26:10.005926+0000","last_fullsized":"2024-04-24T08:26:10.005926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:20:07.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994268+0000","last_change":"2024-04-24T08:26:09.994268+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994268+0000","last_undegraded":"2024-04-24T08:26:09.994268+0000","last_fullsized":"2024-04-24T08:26:09.994268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.016340+0000","last_change":"2024-04-24T08:26:10.015151+0000","last_active":"2024-04-24T08:26:10.016340+0000","last_peered":"2024-04-24T08:26:10.016340+0000","last_clean":"2024-04-24T08:26:10.016340+0000","last_became_active":"2024-04-24T08:26:10.014720+0000","last_became_peered":"2024-04-24T08:26:10.014720+0000","last_unstale":"2024-04-24T08:26:10.016340+0000","last_undegraded":"2024-04-24T08:26:10.016340+0000","last_fullsized":"2024-04-24T08:26:10.016340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:16.723467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.001133+0000","last_change":"2024-04-24T08:26:10.001133+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.001133+0000","last_undegraded":"2024-04-24T08:26:10.001133+0000","last_fullsized":"2024-04-24T08:26:10.001133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.017783+0000","last_change":"2024-04-24T08:26:10.013550+0000","last_active":"2024-04-24T08:26:10.017783+0000","last_peered":"2024-04-24T08:26:10.017783+0000","last_clean":"2024-04-24T08:26:10.017783+0000","last_became_active":"2024-04-24T08:26:10.013258+0000","last_became_peered":"2024-04-24T08:26:10.013258+0000","last_unstale":"2024-04-24T08:26:10.017783+0000","last_undegraded":"2024-04-24T08:26:10.017783+0000","last_fullsized":"2024-04-24T08:26:10.017783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:30:20.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.987613+0000","last_change":"2024-04-24T08:26:09.987613+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.987613+0000","last_undegraded":"2024-04-24T08:26:09.987613+0000","last_fullsized":"2024-04-24T08:26:09.987613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.010630+0000","last_change":"2024-04-24T08:26:10.007972+0000","last_active":"2024-04-24T08:26:10.010630+0000","last_peered":"2024-04-24T08:26:10.010630+0000","last_clean":"2024-04-24T08:26:10.010630+0000","last_became_active":"2024-04-24T08:26:10.007685+0000","last_became_peered":"2024-04-24T08:26:10.007685+0000","last_unstale":"2024-04-24T08:26:10.010630+0000","last_undegraded":"2024-04-24T08:26:10.010630+0000","last_fullsized":"2024-04-24T08:26:10.010630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:23:53.043096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996807+0000","last_change":"2024-04-24T08:26:09.996807+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996807+0000","last_undegraded":"2024-04-24T08:26:09.996807+0000","last_fullsized":"2024-04-24T08:26:09.996807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.017970+0000","last_change":"2024-04-24T08:26:10.016657+0000","last_active":"2024-04-24T08:26:10.017970+0000","last_peered":"2024-04-24T08:26:10.017970+0000","last_clean":"2024-04-24T08:26:10.017970+0000","last_became_active":"2024-04-24T08:26:10.016354+0000","last_became_peered":"2024-04-24T08:26:10.016354+0000","last_unstale":"2024-04-24T08:26:10.017970+0000","last_undegraded":"2024-04-24T08:26:10.017970+0000","last_fullsized":"2024-04-24T08:26:10.017970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:04.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992534+0000","last_change":"2024-04-24T08:26:09.992534+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992534+0000","last_undegraded":"2024-04-24T08:26:09.992534+0000","last_fullsized":"2024-04-24T08:26:09.992534+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.006115+0000","last_change":"2024-04-24T08:26:10.002133+0000","last_active":"2024-04-24T08:26:10.006115+0000","last_peered":"2024-04-24T08:26:10.006115+0000","last_clean":"2024-04-24T08:26:10.006115+0000","last_became_active":"2024-04-24T08:26:10.001823+0000","last_became_peered":"2024-04-24T08:26:10.001823+0000","last_unstale":"2024-04-24T08:26:10.006115+0000","last_undegraded":"2024-04-24T08:26:10.006115+0000","last_fullsized":"2024-04-24T08:26:10.006115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:05:49.885137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.999846+0000","last_change":"2024-04-24T08:26:09.999846+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.999846+0000","last_undegraded":"2024-04-24T08:26:09.999846+0000","last_fullsized":"2024-04-24T08:26:09.999846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.013709+0000","last_change":"2024-04-24T08:26:10.009750+0000","last_active":"2024-04-24T08:26:10.013709+0000","last_peered":"2024-04-24T08:26:10.013709+0000","last_clean":"2024-04-24T08:26:10.013709+0000","last_became_active":"2024-04-24T08:26:10.009495+0000","last_became_peered":"2024-04-24T08:26:10.009495+0000","last_unstale":"2024-04-24T08:26:10.013709+0000","last_undegraded":"2024-04-24T08:26:10.013709+0000","last_fullsized":"2024-04-24T08:26:10.013709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:10:46.621628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.992115+0000","last_change":"2024-04-24T08:26:09.992115+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.992115+0000","last_undegraded":"2024-04-24T08:26:09.992115+0000","last_fullsized":"2024-04-24T08:26:09.992115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015858+0000","last_change":"2024-04-24T08:26:10.012977+0000","last_active":"2024-04-24T08:26:10.015858+0000","last_peered":"2024-04-24T08:26:10.015858+0000","last_clean":"2024-04-24T08:26:10.015858+0000","last_became_active":"2024-04-24T08:26:10.012687+0000","last_became_peered":"2024-04-24T08:26:10.012687+0000","last_unstale":"2024-04-24T08:26:10.015858+0000","last_undegraded":"2024-04-24T08:26:10.015858+0000","last_fullsized":"2024-04-24T08:26:10.015858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:23:23.672009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991117+0000","last_change":"2024-04-24T08:26:09.991117+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991117+0000","last_undegraded":"2024-04-24T08:26:09.991117+0000","last_fullsized":"2024-04-24T08:26:09.991117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.008963+0000","last_change":"2024-04-24T08:26:10.005338+0000","last_active":"2024-04-24T08:26:10.008963+0000","last_peered":"2024-04-24T08:26:10.008963+0000","last_clean":"2024-04-24T08:26:10.008963+0000","last_became_active":"2024-04-24T08:26:10.005060+0000","last_became_peered":"2024-04-24T08:26:10.005060+0000","last_unstale":"2024-04-24T08:26:10.008963+0000","last_undegraded":"2024-04-24T08:26:10.008963+0000","last_fullsized":"2024-04-24T08:26:10.008963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991413+0000","last_change":"2024-04-24T08:26:09.991413+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991413+0000","last_undegraded":"2024-04-24T08:26:09.991413+0000","last_fullsized":"2024-04-24T08:26:09.991413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.012942+0000","last_change":"2024-04-24T08:26:10.010459+0000","last_active":"2024-04-24T08:26:10.012942+0000","last_peered":"2024-04-24T08:26:10.012942+0000","last_clean":"2024-04-24T08:26:10.012942+0000","last_became_active":"2024-04-24T08:26:10.005710+0000","last_became_peered":"2024-04-24T08:26:10.005710+0000","last_unstale":"2024-04-24T08:26:10.012942+0000","last_undegraded":"2024-04-24T08:26:10.012942+0000","last_fullsized":"2024-04-24T08:26:10.012942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991033+0000","last_change":"2024-04-24T08:26:09.991033+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991033+0000","last_undegraded":"2024-04-24T08:26:09.991033+0000","last_fullsized":"2024-04-24T08:26:09.991033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.013572+0000","last_change":"2024-04-24T08:26:10.009111+0000","last_active":"2024-04-24T08:26:10.013572+0000","last_peered":"2024-04-24T08:26:10.013572+0000","last_clean":"2024-04-24T08:26:10.013572+0000","last_became_active":"2024-04-24T08:26:10.008830+0000","last_became_peered":"2024-04-24T08:26:10.008830+0000","last_unstale":"2024-04-24T08:26:10.013572+0000","last_undegraded":"2024-04-24T08:26:10.013572+0000","last_fullsized":"2024-04-24T08:26:10.013572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:59.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:10.003297+0000","last_change":"2024-04-24T08:26:10.003297+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:10.003297+0000","last_undegraded":"2024-04-24T08:26:10.003297+0000","last_fullsized":"2024-04-24T08:26:10.003297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015985+0000","last_change":"2024-04-24T08:26:10.011543+0000","last_active":"2024-04-24T08:26:10.015985+0000","last_peered":"2024-04-24T08:26:10.015985+0000","last_clean":"2024-04-24T08:26:10.015985+0000","last_became_active":"2024-04-24T08:26:10.011213+0000","last_became_peered":"2024-04-24T08:26:10.011213+0000","last_unstale":"2024-04-24T08:26:10.015985+0000","last_undegraded":"2024-04-24T08:26:10.015985+0000","last_fullsized":"2024-04-24T08:26:10.015985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:51:57.825752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.991598+0000","last_change":"2024-04-24T08:26:09.991598+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.991598+0000","last_undegraded":"2024-04-24T08:26:09.991598+0000","last_fullsized":"2024-04-24T08:26:09.991598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015668+0000","last_change":"2024-04-24T08:26:10.009102+0000","last_active":"2024-04-24T08:26:10.015668+0000","last_peered":"2024-04-24T08:26:10.015668+0000","last_clean":"2024-04-24T08:26:10.015668+0000","last_became_active":"2024-04-24T08:26:10.008736+0000","last_became_peered":"2024-04-24T08:26:10.008736+0000","last_unstale":"2024-04-24T08:26:10.015668+0000","last_undegraded":"2024-04-24T08:26:10.015668+0000","last_fullsized":"2024-04-24T08:26:10.015668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.990275+0000","last_change":"2024-04-24T08:26:09.990275+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.990275+0000","last_undegraded":"2024-04-24T08:26:09.990275+0000","last_fullsized":"2024-04-24T08:26:09.990275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.014497+0000","last_change":"2024-04-24T08:26:10.009630+0000","last_active":"2024-04-24T08:26:10.014497+0000","last_peered":"2024-04-24T08:26:10.014497+0000","last_clean":"2024-04-24T08:26:10.014497+0000","last_became_active":"2024-04-24T08:26:10.009059+0000","last_became_peered":"2024-04-24T08:26:10.009059+0000","last_unstale":"2024-04-24T08:26:10.014497+0000","last_undegraded":"2024-04-24T08:26:10.014497+0000","last_fullsized":"2024-04-24T08:26:10.014497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994586+0000","last_change":"2024-04-24T08:26:09.994586+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994586+0000","last_undegraded":"2024-04-24T08:26:09.994586+0000","last_fullsized":"2024-04-24T08:26:09.994586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.009768+0000","last_change":"2024-04-24T08:26:10.005806+0000","last_active":"2024-04-24T08:26:10.009768+0000","last_peered":"2024-04-24T08:26:10.009768+0000","last_clean":"2024-04-24T08:26:10.009768+0000","last_became_active":"2024-04-24T08:26:10.005520+0000","last_became_peered":"2024-04-24T08:26:10.005520+0000","last_unstale":"2024-04-24T08:26:10.009768+0000","last_undegraded":"2024-04-24T08:26:10.009768+0000","last_fullsized":"2024-04-24T08:26:10.009768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.987633+0000","last_change":"2024-04-24T08:26:09.987633+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.987633+0000","last_undegraded":"2024-04-24T08:26:09.987633+0000","last_fullsized":"2024-04-24T08:26:09.987633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.009382+0000","last_change":"2024-04-24T08:26:10.006176+0000","last_active":"2024-04-24T08:26:10.009382+0000","last_peered":"2024-04-24T08:26:10.009382+0000","last_clean":"2024-04-24T08:26:10.009382+0000","last_became_active":"2024-04-24T08:26:10.005931+0000","last_became_peered":"2024-04-24T08:26:10.005931+0000","last_unstale":"2024-04-24T08:26:10.009382+0000","last_undegraded":"2024-04-24T08:26:10.009382+0000","last_fullsized":"2024-04-24T08:26:10.009382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.993430+0000","last_change":"2024-04-24T08:26:09.993430+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.993430+0000","last_undegraded":"2024-04-24T08:26:09.993430+0000","last_fullsized":"2024-04-24T08:26:09.993430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.015554+0000","last_change":"2024-04-24T08:26:10.008690+0000","last_active":"2024-04-24T08:26:10.015554+0000","last_peered":"2024-04-24T08:26:10.015554+0000","last_clean":"2024-04-24T08:26:10.015554+0000","last_became_active":"2024-04-24T08:26:10.008368+0000","last_became_peered":"2024-04-24T08:26:10.008368+0000","last_unstale":"2024-04-24T08:26:10.015554+0000","last_undegraded":"2024-04-24T08:26:10.015554+0000","last_fullsized":"2024-04-24T08:26:10.015554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.994343+0000","last_change":"2024-04-24T08:26:09.994343+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.994343+0000","last_undegraded":"2024-04-24T08:26:09.994343+0000","last_fullsized":"2024-04-24T08:26:09.994343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.002793+0000","last_change":"2024-04-24T08:26:09.999108+0000","last_active":"2024-04-24T08:26:10.002793+0000","last_peered":"2024-04-24T08:26:10.002793+0000","last_clean":"2024-04-24T08:26:10.002793+0000","last_became_active":"2024-04-24T08:26:09.998732+0000","last_became_peered":"2024-04-24T08:26:09.998732+0000","last_unstale":"2024-04-24T08:26:10.002793+0000","last_undegraded":"2024-04-24T08:26:10.002793+0000","last_fullsized":"2024-04-24T08:26:10.002793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:09:35.770606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.996199+0000","last_change":"2024-04-24T08:26:09.996199+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.996199+0000","last_undegraded":"2024-04-24T08:26:09.996199+0000","last_fullsized":"2024-04-24T08:26:09.996199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.017806+0000","last_change":"2024-04-24T08:26:10.014147+0000","last_active":"2024-04-24T08:26:10.017806+0000","last_peered":"2024-04-24T08:26:10.017806+0000","last_clean":"2024-04-24T08:26:10.017806+0000","last_became_active":"2024-04-24T08:26:10.013893+0000","last_became_peered":"2024-04-24T08:26:10.013893+0000","last_unstale":"2024-04-24T08:26:10.017806+0000","last_undegraded":"2024-04-24T08:26:10.017806+0000","last_fullsized":"2024-04-24T08:26:10.017806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:51:57.825752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-04-24T08:26:09.997779+0000","last_change":"2024-04-24T08:26:09.997779+0000","last_active":"2024-04-24T08:26:09.977032+0000","last_peered":"2024-04-24T08:26:09.977032+0000","last_clean":"2024-04-24T08:26:09.977032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T08:26:09.997779+0000","last_undegraded":"2024-04-24T08:26:09.997779+0000","last_fullsized":"2024-04-24T08:26:09.997779+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.011350+0000","last_change":"2024-04-24T08:26:10.004578+0000","last_active":"2024-04-24T08:26:10.011350+0000","last_peered":"2024-04-24T08:26:10.011350+0000","last_clean":"2024-04-24T08:26:10.011350+0000","last_became_active":"2024-04-24T08:26:10.004401+0000","last_became_peered":"2024-04-24T08:26:10.004401+0000","last_unstale":"2024-04-24T08:26:10.011350+0000","last_undegraded":"2024-04-24T08:26:10.011350+0000","last_fullsized":"2024-04-24T08:26:10.011350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T08:26:10.008124+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:26:10.008124+0000","last_peered":"2024-04-24T08:26:10.008124+0000","last_clean":"2024-04-24T08:26:10.008124+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:26:10.008124+0000","last_undegraded":"2024-04-24T08:26:10.008124+0000","last_fullsized":"2024-04-24T08:26:10.008124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":695038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":689221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:26:19.585 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:26:19.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.724+0000 7f797d400640 1 Processor -- start 2024-04-24T08:26:19.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.724+0000 7f797d400640 1 -- start start 2024-04-24T08:26:19.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f797d400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79780b9d90 0x7f79781450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:19.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f797d400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f79780b44e0 0x7f79780b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:19.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f797d400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7978145620 con 0x7f7978148130 2024-04-24T08:26:19.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f797d400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7978145b80 con 0x7f79780b44e0 2024-04-24T08:26:19.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f797d400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f79780ba170 con 0x7f79780b9d90 2024-04-24T08:26:19.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7977200640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7978148130 0x7f79781485c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51064/0 (socket says 172.21.15.88:51064) 2024-04-24T08:26:19.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7977200640 1 -- 172.21.15.88:0/405012953 learned_addr learned my addr 172.21.15.88:0/405012953 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:19.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7976800640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79780b9d90 0x7f79781450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:19.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975e00640 1 --2- 172.21.15.88:0/405012953 >> v2:172.21.15.142:3300/0 conn(0x7f79780b44e0 0x7f79780b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:19.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550586686 0 0) 0x7f7970001120 con 0x7f7978148130 2024-04-24T08:26:19.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f795c003530 con 0x7f7978148130 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1599590643 0 0) 0x7f795c003530 con 0x7f7978148130 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79780b9d90 msgr2=0x7f79781450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79780b9d90 0x7f79781450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 >> v2:172.21.15.142:3300/0 conn(0x7f79780b44e0 msgr2=0x7f79780b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 --2- 172.21.15.88:0/405012953 >> v2:172.21.15.142:3300/0 conn(0x7f79780b44e0 0x7f79780b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79781458a0 con 0x7f7978148130 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f7970001850 con 0x7f7978148130 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 >> v1:172.21.15.88:6789/0 conn(0x7f7978148130 legacy=0x7f79781485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f795c0039c0 0x7f795c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f795c004810 0x7f795c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79780b9d90 0x7f795c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7978145b80 con 0x7f795c004810 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f79780ba170 con 0x7f795c0039c0 2024-04-24T08:26:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f795c00b9d0 con 0x7f79780b9d90 2024-04-24T08:26:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975e00640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f795c004810 0x7f795c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7976800640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f795c0039c0 0x7f795c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7977200640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79780b9d90 0x7f795c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975e00640 1 -- 172.21.15.88:0/405012953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79780b9d90 msgr2=0x7f795c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975e00640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79780b9d90 0x7f795c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975e00640 1 -- 172.21.15.88:0/405012953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f795c0039c0 msgr2=0x7f795c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975e00640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f795c0039c0 0x7f795c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7975e00640 1 -- 172.21.15.88:0/405012953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795c003530 con 0x7f795c004810 2024-04-24T08:26:19.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.728+0000 7f7976800640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f795c0039c0 0x7f795c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:19.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f7975e00640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f795c004810 0x7f795c004c90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7964009ae0 tx=0x7f796401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede228ac7e33cd82 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:19.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79640b2070 con 0x7f795c004810 2024-04-24T08:26:19.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79640a55c0 con 0x7f795c004810 2024-04-24T08:26:19.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f7975400640 1 -- 172.21.15.88:0/405012953 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79640096b0 con 0x7f795c004810 2024-04-24T08:26:19.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f797d400640 1 -- 172.21.15.88:0/405012953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f795c004810 msgr2=0x7f795c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:19.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f797d400640 1 --2- 172.21.15.88:0/405012953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f795c004810 0x7f795c004c90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7964009ae0 tx=0x7f796401cab0 comp rx=0 tx=0).stop 2024-04-24T08:26:19.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f7977200640 1 -- 172.21.15.88:0/405012953 reap_dead start 2024-04-24T08:26:19.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f797d400640 1 -- 172.21.15.88:0/405012953 shutdown_connections 2024-04-24T08:26:19.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f797d400640 1 -- 172.21.15.88:0/405012953 >> 172.21.15.88:0/405012953 conn(0x7f797806c0d0 msgr2=0x7f79780b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:19.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f797d400640 1 -- 172.21.15.88:0/405012953 shutdown_connections 2024-04-24T08:26:19.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f797d400640 1 -- 172.21.15.88:0/405012953 wait complete. 2024-04-24T08:26:19.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f797d400640 1 Processor -- start 2024-04-24T08:26:19.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.732+0000 7f797d400640 1 -- start start 2024-04-24T08:26:19.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f797d400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f795c004810 0x7f79781492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:19.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f797d400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79781ddba0 0x7f79781de020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:19.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f797d400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79781e0e80 0x7f79781e1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:19.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f797d400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f79780b5ca0 con 0x7f795c004810 2024-04-24T08:26:19.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f797d400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f79780b5b20 con 0x7f79781ddba0 2024-04-24T08:26:19.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f797d400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f797809e3d0 con 0x7f79781e0e80 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f7976800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f795c004810 0x7f79781492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f7976800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f795c004810 0x7f79781492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33396/0 (socket says 172.21.15.88:33396) 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f7976800640 1 -- 172.21.15.88:0/2863704254 learned_addr learned my addr 172.21.15.88:0/2863704254 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f7975e00640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79781ddba0 0x7f79781de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f7977200640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79781e0e80 0x7f79781e1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f7976800640 1 -- 172.21.15.88:0/2863704254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79781e0e80 msgr2=0x7f79781e1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f7976800640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79781e0e80 0x7f79781e1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f7976800640 1 -- 172.21.15.88:0/2863704254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79781ddba0 msgr2=0x7f79781de020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f7976800640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79781ddba0 0x7f79781de020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f7976800640 1 -- 172.21.15.88:0/2863704254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79781de560 con 0x7f795c004810 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f7976800640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f795c004810 0x7f79781492a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f79680101c0 tx=0x7f7968010680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f796ea00640 1 -- 172.21.15.88:0/2863704254 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796801a030 con 0x7f795c004810 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f796ea00640 1 -- 172.21.15.88:0/2863704254 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79680039a0 con 0x7f795c004810 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f796ea00640 1 -- 172.21.15.88:0/2863704254 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968003d70 con 0x7f795c004810 2024-04-24T08:26:19.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f797d400640 1 -- 172.21.15.88:0/2863704254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797814bed0 con 0x7f795c004810 2024-04-24T08:26:19.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f797d400640 1 -- 172.21.15.88:0/2863704254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797814a9f0 con 0x7f795c004810 2024-04-24T08:26:19.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f797d400640 1 -- 172.21.15.88:0/2863704254 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f797814add0 con 0x7f795c004810 2024-04-24T08:26:19.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.736+0000 7f796ea00640 1 -- 172.21.15.88:0/2863704254 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f796801d070 con 0x7f795c004810 2024-04-24T08:26:19.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.740+0000 7f796ea00640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f79580683b0 0x7f795806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:19.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.740+0000 7f796ea00640 1 -- 172.21.15.88:0/2863704254 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f79680876f0 con 0x7f795c004810 2024-04-24T08:26:19.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.740+0000 7f7975e00640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f79580683b0 0x7f795806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:19.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.740+0000 7f7975e00640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f79580683b0 0x7f795806a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f79640af000 tx=0x7f79640046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:19.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.744+0000 7f796ea00640 1 -- 172.21.15.88:0/2863704254 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f797814add0 con 0x7f795c004810 2024-04-24T08:26:19.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.896+0000 7f797d400640 1 -- 172.21.15.88:0/2863704254 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f797814b9a0 con 0x7f79580683b0 2024-04-24T08:26:19.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.904+0000 7f796ea00640 1 -- 172.21.15.88:0/2863704254 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251951 (secure 0 0 0) 0x7f79640fa840 con 0x7f79580683b0 2024-04-24T08:26:19.908 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:19.909 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:26:19.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.904+0000 7f797d400640 1 -- 172.21.15.88:0/2863704254 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f79580683b0 msgr2=0x7f795806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:19.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.904+0000 7f797d400640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f79580683b0 0x7f795806a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f79640af000 tx=0x7f79640046d0 comp rx=0 tx=0).stop 2024-04-24T08:26:19.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.904+0000 7f797d400640 1 -- 172.21.15.88:0/2863704254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f795c004810 msgr2=0x7f79781492a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:19.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.904+0000 7f797d400640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f795c004810 0x7f79781492a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f79680101c0 tx=0x7f7968010680 comp rx=0 tx=0).stop 2024-04-24T08:26:19.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.904+0000 7f797d400640 1 -- 172.21.15.88:0/2863704254 shutdown_connections 2024-04-24T08:26:19.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.904+0000 7f797d400640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f79580683b0 0x7f795806a870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:19.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.908+0000 7f797d400640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79781e0e80 0x7f79781e1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:19.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.908+0000 7f797d400640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79781ddba0 0x7f79781de020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:19.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.908+0000 7f797d400640 1 --2- 172.21.15.88:0/2863704254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f795c004810 0x7f79781492a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:19.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.908+0000 7f797d400640 1 -- 172.21.15.88:0/2863704254 >> 172.21.15.88:0/2863704254 conn(0x7f797806c0d0 msgr2=0x7f79780b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:19.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.908+0000 7f797d400640 1 -- 172.21.15.88:0/2863704254 shutdown_connections 2024-04-24T08:26:19.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:19.908+0000 7f797d400640 1 -- 172.21.15.88:0/2863704254 wait complete. 2024-04-24T08:26:19.928 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-04-24T08:26:18.998623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219952,"kb_used_data":3752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754768,"statfs":{"total":773094113280,"available":772868882432,"internally_reserved":0,"allocated":3842048,"data_stored":2177652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.010720"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.747716+0000","last_change":"2024-04-24T08:26:11.010684+0000","last_active":"2024-04-24T08:26:12.747716+0000","last_peered":"2024-04-24T08:26:12.747716+0000","last_clean":"2024-04-24T08:26:12.747716+0000","last_became_active":"2024-04-24T08:26:11.010409+0000","last_became_peered":"2024-04-24T08:26:11.010409+0000","last_unstale":"2024-04-24T08:26:12.747716+0000","last_undegraded":"2024-04-24T08:26:12.747716+0000","last_fullsized":"2024-04-24T08:26:12.747716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:10:09.108177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748563+0000","last_change":"2024-04-24T08:26:11.031872+0000","last_active":"2024-04-24T08:26:12.748563+0000","last_peered":"2024-04-24T08:26:12.748563+0000","last_clean":"2024-04-24T08:26:12.748563+0000","last_became_active":"2024-04-24T08:26:11.031143+0000","last_became_peered":"2024-04-24T08:26:11.031143+0000","last_unstale":"2024-04-24T08:26:12.748563+0000","last_undegraded":"2024-04-24T08:26:12.748563+0000","last_fullsized":"2024-04-24T08:26:12.748563+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:10:29.210446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001643+0000","last_change":"2024-04-24T08:26:11.014943+0000","last_active":"2024-04-24T08:26:12.001643+0000","last_peered":"2024-04-24T08:26:12.001643+0000","last_clean":"2024-04-24T08:26:12.001643+0000","last_became_active":"2024-04-24T08:26:11.014340+0000","last_became_peered":"2024-04-24T08:26:11.014340+0000","last_unstale":"2024-04-24T08:26:12.001643+0000","last_undegraded":"2024-04-24T08:26:12.001643+0000","last_fullsized":"2024-04-24T08:26:12.001643+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:29.476175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252449+0000","last_change":"2024-04-24T08:26:11.013668+0000","last_active":"2024-04-24T08:26:12.252449+0000","last_peered":"2024-04-24T08:26:12.252449+0000","last_clean":"2024-04-24T08:26:12.252449+0000","last_became_active":"2024-04-24T08:26:11.013347+0000","last_became_peered":"2024-04-24T08:26:11.013347+0000","last_unstale":"2024-04-24T08:26:12.252449+0000","last_undegraded":"2024-04-24T08:26:12.252449+0000","last_fullsized":"2024-04-24T08:26:12.252449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:13:05.787850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.000176+0000","last_change":"2024-04-24T08:26:11.026976+0000","last_active":"2024-04-24T08:26:12.000176+0000","last_peered":"2024-04-24T08:26:12.000176+0000","last_clean":"2024-04-24T08:26:12.000176+0000","last_became_active":"2024-04-24T08:26:11.026468+0000","last_became_peered":"2024-04-24T08:26:11.026468+0000","last_unstale":"2024-04-24T08:26:12.000176+0000","last_undegraded":"2024-04-24T08:26:12.000176+0000","last_fullsized":"2024-04-24T08:26:12.000176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:24:19.796945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748162+0000","last_change":"2024-04-24T08:26:11.026009+0000","last_active":"2024-04-24T08:26:12.748162+0000","last_peered":"2024-04-24T08:26:12.748162+0000","last_clean":"2024-04-24T08:26:12.748162+0000","last_became_active":"2024-04-24T08:26:11.025161+0000","last_became_peered":"2024-04-24T08:26:11.025161+0000","last_unstale":"2024-04-24T08:26:12.748162+0000","last_undegraded":"2024-04-24T08:26:12.748162+0000","last_fullsized":"2024-04-24T08:26:12.748162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:29.476175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.696684+0000","last_change":"2024-04-24T08:26:11.021155+0000","last_active":"2024-04-24T08:26:12.696684+0000","last_peered":"2024-04-24T08:26:12.696684+0000","last_clean":"2024-04-24T08:26:12.696684+0000","last_became_active":"2024-04-24T08:26:11.020516+0000","last_became_peered":"2024-04-24T08:26:11.020516+0000","last_unstale":"2024-04-24T08:26:12.696684+0000","last_undegraded":"2024-04-24T08:26:12.696684+0000","last_fullsized":"2024-04-24T08:26:12.696684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:33:25.487109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.696082+0000","last_change":"2024-04-24T08:26:11.021486+0000","last_active":"2024-04-24T08:26:12.696082+0000","last_peered":"2024-04-24T08:26:12.696082+0000","last_clean":"2024-04-24T08:26:12.696082+0000","last_became_active":"2024-04-24T08:26:11.021158+0000","last_became_peered":"2024-04-24T08:26:11.021158+0000","last_unstale":"2024-04-24T08:26:12.696082+0000","last_undegraded":"2024-04-24T08:26:12.696082+0000","last_fullsized":"2024-04-24T08:26:12.696082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:57:43.443614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.002381+0000","last_change":"2024-04-24T08:26:11.017734+0000","last_active":"2024-04-24T08:26:12.002381+0000","last_peered":"2024-04-24T08:26:12.002381+0000","last_clean":"2024-04-24T08:26:12.002381+0000","last_became_active":"2024-04-24T08:26:11.017432+0000","last_became_peered":"2024-04-24T08:26:11.017432+0000","last_unstale":"2024-04-24T08:26:12.002381+0000","last_undegraded":"2024-04-24T08:26:12.002381+0000","last_fullsized":"2024-04-24T08:26:12.002381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:02:13.490122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252743+0000","last_change":"2024-04-24T08:26:11.034124+0000","last_active":"2024-04-24T08:26:12.252743+0000","last_peered":"2024-04-24T08:26:12.252743+0000","last_clean":"2024-04-24T08:26:12.252743+0000","last_became_active":"2024-04-24T08:26:11.033818+0000","last_became_peered":"2024-04-24T08:26:11.033818+0000","last_unstale":"2024-04-24T08:26:12.252743+0000","last_undegraded":"2024-04-24T08:26:12.252743+0000","last_fullsized":"2024-04-24T08:26:12.252743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:16:04.457834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.696406+0000","last_change":"2024-04-24T08:26:11.017462+0000","last_active":"2024-04-24T08:26:12.696406+0000","last_peered":"2024-04-24T08:26:12.696406+0000","last_clean":"2024-04-24T08:26:12.696406+0000","last_became_active":"2024-04-24T08:26:11.016583+0000","last_became_peered":"2024-04-24T08:26:11.016583+0000","last_unstale":"2024-04-24T08:26:12.696406+0000","last_undegraded":"2024-04-24T08:26:12.696406+0000","last_fullsized":"2024-04-24T08:26:12.696406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:24.876134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001433+0000","last_change":"2024-04-24T08:26:11.026773+0000","last_active":"2024-04-24T08:26:12.001433+0000","last_peered":"2024-04-24T08:26:12.001433+0000","last_clean":"2024-04-24T08:26:12.001433+0000","last_became_active":"2024-04-24T08:26:11.026482+0000","last_became_peered":"2024-04-24T08:26:11.026482+0000","last_unstale":"2024-04-24T08:26:12.001433+0000","last_undegraded":"2024-04-24T08:26:12.001433+0000","last_fullsized":"2024-04-24T08:26:12.001433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:24.876134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.000216+0000","last_change":"2024-04-24T08:26:11.008762+0000","last_active":"2024-04-24T08:26:12.000216+0000","last_peered":"2024-04-24T08:26:12.000216+0000","last_clean":"2024-04-24T08:26:12.000216+0000","last_became_active":"2024-04-24T08:26:11.008130+0000","last_became_peered":"2024-04-24T08:26:11.008130+0000","last_unstale":"2024-04-24T08:26:12.000216+0000","last_undegraded":"2024-04-24T08:26:12.000216+0000","last_fullsized":"2024-04-24T08:26:12.000216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:14.010541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748188+0000","last_change":"2024-04-24T08:26:11.021882+0000","last_active":"2024-04-24T08:26:12.748188+0000","last_peered":"2024-04-24T08:26:12.748188+0000","last_clean":"2024-04-24T08:26:12.748188+0000","last_became_active":"2024-04-24T08:26:11.021446+0000","last_became_peered":"2024-04-24T08:26:11.021446+0000","last_unstale":"2024-04-24T08:26:12.748188+0000","last_undegraded":"2024-04-24T08:26:12.748188+0000","last_fullsized":"2024-04-24T08:26:12.748188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:33:25.487109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001185+0000","last_change":"2024-04-24T08:26:11.011873+0000","last_active":"2024-04-24T08:26:12.001185+0000","last_peered":"2024-04-24T08:26:12.001185+0000","last_clean":"2024-04-24T08:26:12.001185+0000","last_became_active":"2024-04-24T08:26:11.011488+0000","last_became_peered":"2024-04-24T08:26:11.011488+0000","last_unstale":"2024-04-24T08:26:12.001185+0000","last_undegraded":"2024-04-24T08:26:12.001185+0000","last_fullsized":"2024-04-24T08:26:12.001185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:19.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.696677+0000","last_change":"2024-04-24T08:26:11.032714+0000","last_active":"2024-04-24T08:26:12.696677+0000","last_peered":"2024-04-24T08:26:12.696677+0000","last_clean":"2024-04-24T08:26:12.696677+0000","last_became_active":"2024-04-24T08:26:11.032432+0000","last_became_peered":"2024-04-24T08:26:11.032432+0000","last_unstale":"2024-04-24T08:26:12.696677+0000","last_undegraded":"2024-04-24T08:26:12.696677+0000","last_fullsized":"2024-04-24T08:26:12.696677+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:29.476175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.696474+0000","last_change":"2024-04-24T08:26:11.017975+0000","last_active":"2024-04-24T08:26:12.696474+0000","last_peered":"2024-04-24T08:26:12.696474+0000","last_clean":"2024-04-24T08:26:12.696474+0000","last_became_active":"2024-04-24T08:26:11.016480+0000","last_became_peered":"2024-04-24T08:26:11.016480+0000","last_unstale":"2024-04-24T08:26:12.696474+0000","last_undegraded":"2024-04-24T08:26:12.696474+0000","last_fullsized":"2024-04-24T08:26:12.696474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:50:33.342064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748670+0000","last_change":"2024-04-24T08:26:11.031637+0000","last_active":"2024-04-24T08:26:12.748670+0000","last_peered":"2024-04-24T08:26:12.748670+0000","last_clean":"2024-04-24T08:26:12.748670+0000","last_became_active":"2024-04-24T08:26:11.030548+0000","last_became_peered":"2024-04-24T08:26:11.030548+0000","last_unstale":"2024-04-24T08:26:12.748670+0000","last_undegraded":"2024-04-24T08:26:12.748670+0000","last_fullsized":"2024-04-24T08:26:12.748670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:46:04.792018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748420+0000","last_change":"2024-04-24T08:26:11.026046+0000","last_active":"2024-04-24T08:26:12.748420+0000","last_peered":"2024-04-24T08:26:12.748420+0000","last_clean":"2024-04-24T08:26:12.748420+0000","last_became_active":"2024-04-24T08:26:11.023222+0000","last_became_peered":"2024-04-24T08:26:11.023222+0000","last_unstale":"2024-04-24T08:26:12.748420+0000","last_undegraded":"2024-04-24T08:26:12.748420+0000","last_fullsized":"2024-04-24T08:26:12.748420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:32:25.042617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.000500+0000","last_change":"2024-04-24T08:26:11.007652+0000","last_active":"2024-04-24T08:26:12.000500+0000","last_peered":"2024-04-24T08:26:12.000500+0000","last_clean":"2024-04-24T08:26:12.000500+0000","last_became_active":"2024-04-24T08:26:11.007334+0000","last_became_peered":"2024-04-24T08:26:11.007334+0000","last_unstale":"2024-04-24T08:26:12.000500+0000","last_undegraded":"2024-04-24T08:26:12.000500+0000","last_fullsized":"2024-04-24T08:26:12.000500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:05:00.768114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.002143+0000","last_change":"2024-04-24T08:26:11.000467+0000","last_active":"2024-04-24T08:26:12.002143+0000","last_peered":"2024-04-24T08:26:12.002143+0000","last_clean":"2024-04-24T08:26:12.002143+0000","last_became_active":"2024-04-24T08:26:11.000206+0000","last_became_peered":"2024-04-24T08:26:11.000206+0000","last_unstale":"2024-04-24T08:26:12.002143+0000","last_undegraded":"2024-04-24T08:26:12.002143+0000","last_fullsized":"2024-04-24T08:26:12.002143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:22:32.570850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001687+0000","last_change":"2024-04-24T08:26:11.008902+0000","last_active":"2024-04-24T08:26:12.001687+0000","last_peered":"2024-04-24T08:26:12.001687+0000","last_clean":"2024-04-24T08:26:12.001687+0000","last_became_active":"2024-04-24T08:26:11.008586+0000","last_became_peered":"2024-04-24T08:26:11.008586+0000","last_unstale":"2024-04-24T08:26:12.001687+0000","last_undegraded":"2024-04-24T08:26:12.001687+0000","last_fullsized":"2024-04-24T08:26:12.001687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:59.262201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.010493+0000","last_change":"2024-04-24T08:26:11.007752+0000","last_active":"2024-04-24T08:26:12.010493+0000","last_peered":"2024-04-24T08:26:12.010493+0000","last_clean":"2024-04-24T08:26:12.010493+0000","last_became_active":"2024-04-24T08:26:11.007474+0000","last_became_peered":"2024-04-24T08:26:11.007474+0000","last_unstale":"2024-04-24T08:26:12.010493+0000","last_undegraded":"2024-04-24T08:26:12.010493+0000","last_fullsized":"2024-04-24T08:26:12.010493+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:59.262201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001010+0000","last_change":"2024-04-24T08:26:11.000050+0000","last_active":"2024-04-24T08:26:12.001010+0000","last_peered":"2024-04-24T08:26:12.001010+0000","last_clean":"2024-04-24T08:26:12.001010+0000","last_became_active":"2024-04-24T08:26:10.999773+0000","last_became_peered":"2024-04-24T08:26:10.999773+0000","last_unstale":"2024-04-24T08:26:12.001010+0000","last_undegraded":"2024-04-24T08:26:12.001010+0000","last_fullsized":"2024-04-24T08:26:12.001010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:56.576839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252846+0000","last_change":"2024-04-24T08:26:11.022630+0000","last_active":"2024-04-24T08:26:12.252846+0000","last_peered":"2024-04-24T08:26:12.252846+0000","last_clean":"2024-04-24T08:26:12.252846+0000","last_became_active":"2024-04-24T08:26:11.020671+0000","last_became_peered":"2024-04-24T08:26:11.020671+0000","last_unstale":"2024-04-24T08:26:12.252846+0000","last_undegraded":"2024-04-24T08:26:12.252846+0000","last_fullsized":"2024-04-24T08:26:12.252846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:19.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748676+0000","last_change":"2024-04-24T08:26:11.031442+0000","last_active":"2024-04-24T08:26:12.748676+0000","last_peered":"2024-04-24T08:26:12.748676+0000","last_clean":"2024-04-24T08:26:12.748676+0000","last_became_active":"2024-04-24T08:26:11.030087+0000","last_became_peered":"2024-04-24T08:26:11.030087+0000","last_unstale":"2024-04-24T08:26:12.748676+0000","last_undegraded":"2024-04-24T08:26:12.748676+0000","last_fullsized":"2024-04-24T08:26:12.748676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:58:13.571233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252820+0000","last_change":"2024-04-24T08:26:11.016975+0000","last_active":"2024-04-24T08:26:12.252820+0000","last_peered":"2024-04-24T08:26:12.252820+0000","last_clean":"2024-04-24T08:26:12.252820+0000","last_became_active":"2024-04-24T08:26:11.016316+0000","last_became_peered":"2024-04-24T08:26:11.016316+0000","last_unstale":"2024-04-24T08:26:12.252820+0000","last_undegraded":"2024-04-24T08:26:12.252820+0000","last_fullsized":"2024-04-24T08:26:12.252820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:57:43.443614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001611+0000","last_change":"2024-04-24T08:26:11.005154+0000","last_active":"2024-04-24T08:26:12.001611+0000","last_peered":"2024-04-24T08:26:12.001611+0000","last_clean":"2024-04-24T08:26:12.001611+0000","last_became_active":"2024-04-24T08:26:11.004861+0000","last_became_peered":"2024-04-24T08:26:11.004861+0000","last_unstale":"2024-04-24T08:26:12.001611+0000","last_undegraded":"2024-04-24T08:26:12.001611+0000","last_fullsized":"2024-04-24T08:26:12.001611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:44:14.651201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.002362+0000","last_change":"2024-04-24T08:26:11.029860+0000","last_active":"2024-04-24T08:26:12.002362+0000","last_peered":"2024-04-24T08:26:12.002362+0000","last_clean":"2024-04-24T08:26:12.002362+0000","last_became_active":"2024-04-24T08:26:11.029494+0000","last_became_peered":"2024-04-24T08:26:11.029494+0000","last_unstale":"2024-04-24T08:26:12.002362+0000","last_undegraded":"2024-04-24T08:26:12.002362+0000","last_fullsized":"2024-04-24T08:26:12.002362+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:07.297428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.696240+0000","last_change":"2024-04-24T08:26:11.010304+0000","last_active":"2024-04-24T08:26:12.696240+0000","last_peered":"2024-04-24T08:26:12.696240+0000","last_clean":"2024-04-24T08:26:12.696240+0000","last_became_active":"2024-04-24T08:26:11.009731+0000","last_became_peered":"2024-04-24T08:26:11.009731+0000","last_unstale":"2024-04-24T08:26:12.696240+0000","last_undegraded":"2024-04-24T08:26:12.696240+0000","last_fullsized":"2024-04-24T08:26:12.696240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:19.163998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.747515+0000","last_change":"2024-04-24T08:26:11.011204+0000","last_active":"2024-04-24T08:26:12.747515+0000","last_peered":"2024-04-24T08:26:12.747515+0000","last_clean":"2024-04-24T08:26:12.747515+0000","last_became_active":"2024-04-24T08:26:11.010756+0000","last_became_peered":"2024-04-24T08:26:11.010756+0000","last_unstale":"2024-04-24T08:26:12.747515+0000","last_undegraded":"2024-04-24T08:26:12.747515+0000","last_fullsized":"2024-04-24T08:26:12.747515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:28:20.630490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.696085+0000","last_change":"2024-04-24T08:26:11.005309+0000","last_active":"2024-04-24T08:26:12.696085+0000","last_peered":"2024-04-24T08:26:12.696085+0000","last_clean":"2024-04-24T08:26:12.696085+0000","last_became_active":"2024-04-24T08:26:11.004094+0000","last_became_peered":"2024-04-24T08:26:11.004094+0000","last_unstale":"2024-04-24T08:26:12.696085+0000","last_undegraded":"2024-04-24T08:26:12.696085+0000","last_fullsized":"2024-04-24T08:26:12.696085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:16:04.457834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.010859+0000","last_change":"2024-04-24T08:26:11.006772+0000","last_active":"2024-04-24T08:26:12.010859+0000","last_peered":"2024-04-24T08:26:12.010859+0000","last_clean":"2024-04-24T08:26:12.010859+0000","last_became_active":"2024-04-24T08:26:11.006521+0000","last_became_peered":"2024-04-24T08:26:11.006521+0000","last_unstale":"2024-04-24T08:26:12.010859+0000","last_undegraded":"2024-04-24T08:26:12.010859+0000","last_fullsized":"2024-04-24T08:26:12.010859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:43:26.066962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'4","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.747788+0000","last_change":"2024-04-24T08:26:10.005901+0000","last_active":"2024-04-24T08:26:12.747788+0000","last_peered":"2024-04-24T08:26:12.747788+0000","last_clean":"2024-04-24T08:26:12.747788+0000","last_became_active":"2024-04-24T08:26:10.005611+0000","last_became_peered":"2024-04-24T08:26:10.005611+0000","last_unstale":"2024-04-24T08:26:12.747788+0000","last_undegraded":"2024-04-24T08:26:12.747788+0000","last_fullsized":"2024-04-24T08:26:12.747788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:16.723467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.747755+0000","last_change":"2024-04-24T08:26:11.005947+0000","last_active":"2024-04-24T08:26:12.747755+0000","last_peered":"2024-04-24T08:26:12.747755+0000","last_clean":"2024-04-24T08:26:12.747755+0000","last_became_active":"2024-04-24T08:26:11.005196+0000","last_became_peered":"2024-04-24T08:26:11.005196+0000","last_unstale":"2024-04-24T08:26:12.747755+0000","last_undegraded":"2024-04-24T08:26:12.747755+0000","last_fullsized":"2024-04-24T08:26:12.747755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:22:32.570850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.010860+0000","last_change":"2024-04-24T08:26:10.012103+0000","last_active":"2024-04-24T08:26:12.010860+0000","last_peered":"2024-04-24T08:26:12.010860+0000","last_clean":"2024-04-24T08:26:12.010860+0000","last_became_active":"2024-04-24T08:26:10.011846+0000","last_became_peered":"2024-04-24T08:26:10.011846+0000","last_unstale":"2024-04-24T08:26:12.010860+0000","last_undegraded":"2024-04-24T08:26:12.010860+0000","last_fullsized":"2024-04-24T08:26:12.010860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:11:48.720898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.002027+0000","last_change":"2024-04-24T08:26:11.025810+0000","last_active":"2024-04-24T08:26:12.002027+0000","last_peered":"2024-04-24T08:26:12.002027+0000","last_clean":"2024-04-24T08:26:12.002027+0000","last_became_active":"2024-04-24T08:26:11.025499+0000","last_became_peered":"2024-04-24T08:26:11.025499+0000","last_unstale":"2024-04-24T08:26:12.002027+0000","last_undegraded":"2024-04-24T08:26:12.002027+0000","last_fullsized":"2024-04-24T08:26:12.002027+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:43:26.066962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748442+0000","last_change":"2024-04-24T08:26:10.013217+0000","last_active":"2024-04-24T08:26:12.748442+0000","last_peered":"2024-04-24T08:26:12.748442+0000","last_clean":"2024-04-24T08:26:12.748442+0000","last_became_active":"2024-04-24T08:26:10.012939+0000","last_became_peered":"2024-04-24T08:26:10.012939+0000","last_unstale":"2024-04-24T08:26:12.748442+0000","last_undegraded":"2024-04-24T08:26:12.748442+0000","last_fullsized":"2024-04-24T08:26:12.748442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:17.357317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252850+0000","last_change":"2024-04-24T08:26:11.009214+0000","last_active":"2024-04-24T08:26:12.252850+0000","last_peered":"2024-04-24T08:26:12.252850+0000","last_clean":"2024-04-24T08:26:12.252850+0000","last_became_active":"2024-04-24T08:26:11.008926+0000","last_became_peered":"2024-04-24T08:26:11.008926+0000","last_unstale":"2024-04-24T08:26:12.252850+0000","last_undegraded":"2024-04-24T08:26:12.252850+0000","last_fullsized":"2024-04-24T08:26:12.252850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:56.576839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.000455+0000","last_change":"2024-04-24T08:26:10.005714+0000","last_active":"2024-04-24T08:26:12.000455+0000","last_peered":"2024-04-24T08:26:12.000455+0000","last_clean":"2024-04-24T08:26:12.000455+0000","last_became_active":"2024-04-24T08:26:10.005299+0000","last_became_peered":"2024-04-24T08:26:10.005299+0000","last_unstale":"2024-04-24T08:26:12.000455+0000","last_undegraded":"2024-04-24T08:26:12.000455+0000","last_fullsized":"2024-04-24T08:26:12.000455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:20:07.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.696226+0000","last_change":"2024-04-24T08:26:11.010032+0000","last_active":"2024-04-24T08:26:12.696226+0000","last_peered":"2024-04-24T08:26:12.696226+0000","last_clean":"2024-04-24T08:26:12.696226+0000","last_became_active":"2024-04-24T08:26:11.009415+0000","last_became_peered":"2024-04-24T08:26:11.009415+0000","last_unstale":"2024-04-24T08:26:12.696226+0000","last_undegraded":"2024-04-24T08:26:12.696226+0000","last_fullsized":"2024-04-24T08:26:12.696226+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:56.576839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.002449+0000","last_change":"2024-04-24T08:26:10.010287+0000","last_active":"2024-04-24T08:26:12.002449+0000","last_peered":"2024-04-24T08:26:12.002449+0000","last_clean":"2024-04-24T08:26:12.002449+0000","last_became_active":"2024-04-24T08:26:10.009987+0000","last_became_peered":"2024-04-24T08:26:10.009987+0000","last_unstale":"2024-04-24T08:26:12.002449+0000","last_undegraded":"2024-04-24T08:26:12.002449+0000","last_fullsized":"2024-04-24T08:26:12.002449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:59.756927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001321+0000","last_change":"2024-04-24T08:26:11.002071+0000","last_active":"2024-04-24T08:26:12.001321+0000","last_peered":"2024-04-24T08:26:12.001321+0000","last_clean":"2024-04-24T08:26:12.001321+0000","last_became_active":"2024-04-24T08:26:11.001775+0000","last_became_peered":"2024-04-24T08:26:11.001775+0000","last_unstale":"2024-04-24T08:26:12.001321+0000","last_undegraded":"2024-04-24T08:26:12.001321+0000","last_fullsized":"2024-04-24T08:26:12.001321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:12:45.133195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001885+0000","last_change":"2024-04-24T08:26:10.008606+0000","last_active":"2024-04-24T08:26:12.001885+0000","last_peered":"2024-04-24T08:26:12.001885+0000","last_clean":"2024-04-24T08:26:12.001885+0000","last_became_active":"2024-04-24T08:26:10.008258+0000","last_became_peered":"2024-04-24T08:26:10.008258+0000","last_unstale":"2024-04-24T08:26:12.001885+0000","last_undegraded":"2024-04-24T08:26:12.001885+0000","last_fullsized":"2024-04-24T08:26:12.001885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:24:50.398365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001464+0000","last_change":"2024-04-24T08:26:11.011314+0000","last_active":"2024-04-24T08:26:12.001464+0000","last_peered":"2024-04-24T08:26:12.001464+0000","last_clean":"2024-04-24T08:26:12.001464+0000","last_became_active":"2024-04-24T08:26:11.009371+0000","last_became_peered":"2024-04-24T08:26:11.009371+0000","last_unstale":"2024-04-24T08:26:12.001464+0000","last_undegraded":"2024-04-24T08:26:12.001464+0000","last_fullsized":"2024-04-24T08:26:12.001464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:18.368505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.747939+0000","last_change":"2024-04-24T08:26:10.002814+0000","last_active":"2024-04-24T08:26:12.747939+0000","last_peered":"2024-04-24T08:26:12.747939+0000","last_clean":"2024-04-24T08:26:12.747939+0000","last_became_active":"2024-04-24T08:26:10.002502+0000","last_became_peered":"2024-04-24T08:26:10.002502+0000","last_unstale":"2024-04-24T08:26:12.747939+0000","last_undegraded":"2024-04-24T08:26:12.747939+0000","last_fullsized":"2024-04-24T08:26:12.747939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:58.251013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252343+0000","last_change":"2024-04-24T08:26:11.008620+0000","last_active":"2024-04-24T08:26:12.252343+0000","last_peered":"2024-04-24T08:26:12.252343+0000","last_clean":"2024-04-24T08:26:12.252343+0000","last_became_active":"2024-04-24T08:26:11.007320+0000","last_became_peered":"2024-04-24T08:26:11.007320+0000","last_unstale":"2024-04-24T08:26:12.252343+0000","last_undegraded":"2024-04-24T08:26:12.252343+0000","last_fullsized":"2024-04-24T08:26:12.252343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:07.297428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001130+0000","last_change":"2024-04-24T08:26:10.002174+0000","last_active":"2024-04-24T08:26:12.001130+0000","last_peered":"2024-04-24T08:26:12.001130+0000","last_clean":"2024-04-24T08:26:12.001130+0000","last_became_active":"2024-04-24T08:26:10.001830+0000","last_became_peered":"2024-04-24T08:26:10.001830+0000","last_unstale":"2024-04-24T08:26:12.001130+0000","last_undegraded":"2024-04-24T08:26:12.001130+0000","last_fullsized":"2024-04-24T08:26:12.001130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:04.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001881+0000","last_change":"2024-04-24T08:26:11.032378+0000","last_active":"2024-04-24T08:26:12.001881+0000","last_peered":"2024-04-24T08:26:12.001881+0000","last_clean":"2024-04-24T08:26:12.001881+0000","last_became_active":"2024-04-24T08:26:11.032142+0000","last_became_peered":"2024-04-24T08:26:11.032142+0000","last_unstale":"2024-04-24T08:26:12.001881+0000","last_undegraded":"2024-04-24T08:26:12.001881+0000","last_fullsized":"2024-04-24T08:26:12.001881+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:33:25.487109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748572+0000","last_change":"2024-04-24T08:26:10.013100+0000","last_active":"2024-04-24T08:26:12.748572+0000","last_peered":"2024-04-24T08:26:12.748572+0000","last_clean":"2024-04-24T08:26:12.748572+0000","last_became_active":"2024-04-24T08:26:10.012809+0000","last_became_peered":"2024-04-24T08:26:10.012809+0000","last_unstale":"2024-04-24T08:26:12.748572+0000","last_undegraded":"2024-04-24T08:26:12.748572+0000","last_fullsized":"2024-04-24T08:26:12.748572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:06.286240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748577+0000","last_change":"2024-04-24T08:26:11.029962+0000","last_active":"2024-04-24T08:26:12.748577+0000","last_peered":"2024-04-24T08:26:12.748577+0000","last_clean":"2024-04-24T08:26:12.748577+0000","last_became_active":"2024-04-24T08:26:11.029652+0000","last_became_peered":"2024-04-24T08:26:11.029652+0000","last_unstale":"2024-04-24T08:26:12.748577+0000","last_undegraded":"2024-04-24T08:26:12.748577+0000","last_fullsized":"2024-04-24T08:26:12.748577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:04.797650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.010956+0000","last_change":"2024-04-24T08:26:10.011789+0000","last_active":"2024-04-24T08:26:12.010956+0000","last_peered":"2024-04-24T08:26:12.010956+0000","last_clean":"2024-04-24T08:26:12.010956+0000","last_became_active":"2024-04-24T08:26:10.011489+0000","last_became_peered":"2024-04-24T08:26:10.011489+0000","last_unstale":"2024-04-24T08:26:12.010956+0000","last_undegraded":"2024-04-24T08:26:12.010956+0000","last_fullsized":"2024-04-24T08:26:12.010956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:01:44.547438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748508+0000","last_change":"2024-04-24T08:26:11.029708+0000","last_active":"2024-04-24T08:26:12.748508+0000","last_peered":"2024-04-24T08:26:12.748508+0000","last_clean":"2024-04-24T08:26:12.748508+0000","last_became_active":"2024-04-24T08:26:11.029378+0000","last_became_peered":"2024-04-24T08:26:11.029378+0000","last_unstale":"2024-04-24T08:26:12.748508+0000","last_undegraded":"2024-04-24T08:26:12.748508+0000","last_fullsized":"2024-04-24T08:26:12.748508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:10:02.333275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001716+0000","last_change":"2024-04-24T08:26:10.011485+0000","last_active":"2024-04-24T08:26:12.001716+0000","last_peered":"2024-04-24T08:26:12.001716+0000","last_clean":"2024-04-24T08:26:12.001716+0000","last_became_active":"2024-04-24T08:26:10.011166+0000","last_became_peered":"2024-04-24T08:26:10.011166+0000","last_unstale":"2024-04-24T08:26:12.001716+0000","last_undegraded":"2024-04-24T08:26:12.001716+0000","last_fullsized":"2024-04-24T08:26:12.001716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:17.357317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001439+0000","last_change":"2024-04-24T08:26:11.015150+0000","last_active":"2024-04-24T08:26:12.001439+0000","last_peered":"2024-04-24T08:26:12.001439+0000","last_clean":"2024-04-24T08:26:12.001439+0000","last_became_active":"2024-04-24T08:26:11.014694+0000","last_became_peered":"2024-04-24T08:26:11.014694+0000","last_unstale":"2024-04-24T08:26:12.001439+0000","last_undegraded":"2024-04-24T08:26:12.001439+0000","last_fullsized":"2024-04-24T08:26:12.001439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:50:33.342064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748648+0000","last_change":"2024-04-24T08:26:10.011337+0000","last_active":"2024-04-24T08:26:12.748648+0000","last_peered":"2024-04-24T08:26:12.748648+0000","last_clean":"2024-04-24T08:26:12.748648+0000","last_became_active":"2024-04-24T08:26:10.010603+0000","last_became_peered":"2024-04-24T08:26:10.010603+0000","last_unstale":"2024-04-24T08:26:12.748648+0000","last_undegraded":"2024-04-24T08:26:12.748648+0000","last_fullsized":"2024-04-24T08:26:12.748648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:28:19.619302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252377+0000","last_change":"2024-04-24T08:26:11.019554+0000","last_active":"2024-04-24T08:26:12.252377+0000","last_peered":"2024-04-24T08:26:12.252377+0000","last_clean":"2024-04-24T08:26:12.252377+0000","last_became_active":"2024-04-24T08:26:11.019016+0000","last_became_peered":"2024-04-24T08:26:11.019016+0000","last_unstale":"2024-04-24T08:26:12.252377+0000","last_undegraded":"2024-04-24T08:26:12.252377+0000","last_fullsized":"2024-04-24T08:26:12.252377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:02:13.490122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.002504+0000","last_change":"2024-04-24T08:26:10.001398+0000","last_active":"2024-04-24T08:26:12.002504+0000","last_peered":"2024-04-24T08:26:12.002504+0000","last_clean":"2024-04-24T08:26:12.002504+0000","last_became_active":"2024-04-24T08:26:10.001113+0000","last_became_peered":"2024-04-24T08:26:10.001113+0000","last_unstale":"2024-04-24T08:26:12.002504+0000","last_undegraded":"2024-04-24T08:26:12.002504+0000","last_fullsized":"2024-04-24T08:26:12.002504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:16.723467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748328+0000","last_change":"2024-04-24T08:26:11.025738+0000","last_active":"2024-04-24T08:26:12.748328+0000","last_peered":"2024-04-24T08:26:12.748328+0000","last_clean":"2024-04-24T08:26:12.748328+0000","last_became_active":"2024-04-24T08:26:11.023379+0000","last_became_peered":"2024-04-24T08:26:11.023379+0000","last_unstale":"2024-04-24T08:26:12.748328+0000","last_undegraded":"2024-04-24T08:26:12.748328+0000","last_fullsized":"2024-04-24T08:26:12.748328+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:12:45.133195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252387+0000","last_change":"2024-04-24T08:26:10.015151+0000","last_active":"2024-04-24T08:26:12.252387+0000","last_peered":"2024-04-24T08:26:12.252387+0000","last_clean":"2024-04-24T08:26:12.252387+0000","last_became_active":"2024-04-24T08:26:10.014720+0000","last_became_peered":"2024-04-24T08:26:10.014720+0000","last_unstale":"2024-04-24T08:26:12.252387+0000","last_undegraded":"2024-04-24T08:26:12.252387+0000","last_fullsized":"2024-04-24T08:26:12.252387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:23:53.043096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.696292+0000","last_change":"2024-04-24T08:26:11.006397+0000","last_active":"2024-04-24T08:26:12.696292+0000","last_peered":"2024-04-24T08:26:12.696292+0000","last_clean":"2024-04-24T08:26:12.696292+0000","last_became_active":"2024-04-24T08:26:11.006133+0000","last_became_peered":"2024-04-24T08:26:11.006133+0000","last_unstale":"2024-04-24T08:26:12.696292+0000","last_undegraded":"2024-04-24T08:26:12.696292+0000","last_fullsized":"2024-04-24T08:26:12.696292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:44:14.651201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748017+0000","last_change":"2024-04-24T08:26:10.013550+0000","last_active":"2024-04-24T08:26:12.748017+0000","last_peered":"2024-04-24T08:26:12.748017+0000","last_clean":"2024-04-24T08:26:12.748017+0000","last_became_active":"2024-04-24T08:26:10.013258+0000","last_became_peered":"2024-04-24T08:26:10.013258+0000","last_unstale":"2024-04-24T08:26:12.748017+0000","last_undegraded":"2024-04-24T08:26:12.748017+0000","last_fullsized":"2024-04-24T08:26:12.748017+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:10:08.096990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.747626+0000","last_change":"2024-04-24T08:26:11.013649+0000","last_active":"2024-04-24T08:26:12.747626+0000","last_peered":"2024-04-24T08:26:12.747626+0000","last_clean":"2024-04-24T08:26:12.747626+0000","last_became_active":"2024-04-24T08:26:11.010611+0000","last_became_peered":"2024-04-24T08:26:11.010611+0000","last_unstale":"2024-04-24T08:26:12.747626+0000","last_undegraded":"2024-04-24T08:26:12.747626+0000","last_fullsized":"2024-04-24T08:26:12.747626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:59.262201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"28'8","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.747894+0000","last_change":"2024-04-24T08:26:10.007972+0000","last_active":"2024-04-24T08:26:12.747894+0000","last_peered":"2024-04-24T08:26:12.747894+0000","last_clean":"2024-04-24T08:26:12.747894+0000","last_became_active":"2024-04-24T08:26:10.007685+0000","last_became_peered":"2024-04-24T08:26:10.007685+0000","last_unstale":"2024-04-24T08:26:12.747894+0000","last_undegraded":"2024-04-24T08:26:12.747894+0000","last_fullsized":"2024-04-24T08:26:12.747894+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:22:31.559663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.002086+0000","last_change":"2024-04-24T08:26:10.998459+0000","last_active":"2024-04-24T08:26:12.002086+0000","last_peered":"2024-04-24T08:26:12.002086+0000","last_clean":"2024-04-24T08:26:12.002086+0000","last_became_active":"2024-04-24T08:26:10.998151+0000","last_became_peered":"2024-04-24T08:26:10.998151+0000","last_unstale":"2024-04-24T08:26:12.002086+0000","last_undegraded":"2024-04-24T08:26:12.002086+0000","last_fullsized":"2024-04-24T08:26:12.002086+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:10:09.108177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252860+0000","last_change":"2024-04-24T08:26:10.016657+0000","last_active":"2024-04-24T08:26:12.252860+0000","last_peered":"2024-04-24T08:26:12.252860+0000","last_clean":"2024-04-24T08:26:12.252860+0000","last_became_active":"2024-04-24T08:26:10.016354+0000","last_became_peered":"2024-04-24T08:26:10.016354+0000","last_unstale":"2024-04-24T08:26:12.252860+0000","last_undegraded":"2024-04-24T08:26:12.252860+0000","last_fullsized":"2024-04-24T08:26:12.252860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:58:18.070188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001630+0000","last_change":"2024-04-24T08:26:11.003743+0000","last_active":"2024-04-24T08:26:12.001630+0000","last_peered":"2024-04-24T08:26:12.001630+0000","last_clean":"2024-04-24T08:26:12.001630+0000","last_became_active":"2024-04-24T08:26:11.003058+0000","last_became_peered":"2024-04-24T08:26:11.003058+0000","last_unstale":"2024-04-24T08:26:12.001630+0000","last_undegraded":"2024-04-24T08:26:12.001630+0000","last_fullsized":"2024-04-24T08:26:12.001630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:37.375573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.002121+0000","last_change":"2024-04-24T08:26:10.002133+0000","last_active":"2024-04-24T08:26:12.002121+0000","last_peered":"2024-04-24T08:26:12.002121+0000","last_clean":"2024-04-24T08:26:12.002121+0000","last_became_active":"2024-04-24T08:26:10.001823+0000","last_became_peered":"2024-04-24T08:26:10.001823+0000","last_unstale":"2024-04-24T08:26:12.002121+0000","last_undegraded":"2024-04-24T08:26:12.002121+0000","last_fullsized":"2024-04-24T08:26:12.002121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:04.453047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252492+0000","last_change":"2024-04-24T08:26:11.013509+0000","last_active":"2024-04-24T08:26:12.252492+0000","last_peered":"2024-04-24T08:26:12.252492+0000","last_clean":"2024-04-24T08:26:12.252492+0000","last_became_active":"2024-04-24T08:26:11.013046+0000","last_became_peered":"2024-04-24T08:26:11.013046+0000","last_unstale":"2024-04-24T08:26:12.252492+0000","last_undegraded":"2024-04-24T08:26:12.252492+0000","last_fullsized":"2024-04-24T08:26:12.252492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:50:50.055408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.002308+0000","last_change":"2024-04-24T08:26:10.009750+0000","last_active":"2024-04-24T08:26:12.002308+0000","last_peered":"2024-04-24T08:26:12.002308+0000","last_clean":"2024-04-24T08:26:12.002308+0000","last_became_active":"2024-04-24T08:26:10.009495+0000","last_became_peered":"2024-04-24T08:26:10.009495+0000","last_unstale":"2024-04-24T08:26:12.002308+0000","last_undegraded":"2024-04-24T08:26:12.002308+0000","last_fullsized":"2024-04-24T08:26:12.002308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:45:12.999354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.000609+0000","last_change":"2024-04-24T08:26:11.015504+0000","last_active":"2024-04-24T08:26:12.000609+0000","last_peered":"2024-04-24T08:26:12.000609+0000","last_clean":"2024-04-24T08:26:12.000609+0000","last_became_active":"2024-04-24T08:26:11.015215+0000","last_became_peered":"2024-04-24T08:26:11.015215+0000","last_unstale":"2024-04-24T08:26:12.000609+0000","last_undegraded":"2024-04-24T08:26:12.000609+0000","last_fullsized":"2024-04-24T08:26:12.000609+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:17.734654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001995+0000","last_change":"2024-04-24T08:26:10.012977+0000","last_active":"2024-04-24T08:26:12.001995+0000","last_peered":"2024-04-24T08:26:12.001995+0000","last_clean":"2024-04-24T08:26:12.001995+0000","last_became_active":"2024-04-24T08:26:10.012687+0000","last_became_peered":"2024-04-24T08:26:10.012687+0000","last_unstale":"2024-04-24T08:26:12.001995+0000","last_undegraded":"2024-04-24T08:26:12.001995+0000","last_fullsized":"2024-04-24T08:26:12.001995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:23.790819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.000154+0000","last_change":"2024-04-24T08:26:11.006104+0000","last_active":"2024-04-24T08:26:12.000154+0000","last_peered":"2024-04-24T08:26:12.000154+0000","last_clean":"2024-04-24T08:26:12.000154+0000","last_became_active":"2024-04-24T08:26:11.005815+0000","last_became_peered":"2024-04-24T08:26:11.005815+0000","last_unstale":"2024-04-24T08:26:12.000154+0000","last_undegraded":"2024-04-24T08:26:12.000154+0000","last_fullsized":"2024-04-24T08:26:12.000154+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:05.464235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.010644+0000","last_change":"2024-04-24T08:26:10.005338+0000","last_active":"2024-04-24T08:26:12.010644+0000","last_peered":"2024-04-24T08:26:12.010644+0000","last_clean":"2024-04-24T08:26:12.010644+0000","last_became_active":"2024-04-24T08:26:10.005060+0000","last_became_peered":"2024-04-24T08:26:10.005060+0000","last_unstale":"2024-04-24T08:26:12.010644+0000","last_undegraded":"2024-04-24T08:26:12.010644+0000","last_fullsized":"2024-04-24T08:26:12.010644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:23:53.043096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.000393+0000","last_change":"2024-04-24T08:26:11.011850+0000","last_active":"2024-04-24T08:26:12.000393+0000","last_peered":"2024-04-24T08:26:12.000393+0000","last_clean":"2024-04-24T08:26:12.000393+0000","last_became_active":"2024-04-24T08:26:11.011014+0000","last_became_peered":"2024-04-24T08:26:11.011014+0000","last_unstale":"2024-04-24T08:26:12.000393+0000","last_undegraded":"2024-04-24T08:26:12.000393+0000","last_fullsized":"2024-04-24T08:26:12.000393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:24.802007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.747419+0000","last_change":"2024-04-24T08:26:10.010459+0000","last_active":"2024-04-24T08:26:12.747419+0000","last_peered":"2024-04-24T08:26:12.747419+0000","last_clean":"2024-04-24T08:26:12.747419+0000","last_became_active":"2024-04-24T08:26:10.005710+0000","last_became_peered":"2024-04-24T08:26:10.005710+0000","last_unstale":"2024-04-24T08:26:12.747419+0000","last_undegraded":"2024-04-24T08:26:12.747419+0000","last_fullsized":"2024-04-24T08:26:12.747419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:45.812010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.000061+0000","last_change":"2024-04-24T08:26:11.015906+0000","last_active":"2024-04-24T08:26:12.000061+0000","last_peered":"2024-04-24T08:26:12.000061+0000","last_clean":"2024-04-24T08:26:12.000061+0000","last_became_active":"2024-04-24T08:26:11.012321+0000","last_became_peered":"2024-04-24T08:26:11.012321+0000","last_unstale":"2024-04-24T08:26:12.000061+0000","last_undegraded":"2024-04-24T08:26:12.000061+0000","last_fullsized":"2024-04-24T08:26:12.000061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:36:46.742257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001608+0000","last_change":"2024-04-24T08:26:10.009111+0000","last_active":"2024-04-24T08:26:12.001608+0000","last_peered":"2024-04-24T08:26:12.001608+0000","last_clean":"2024-04-24T08:26:12.001608+0000","last_became_active":"2024-04-24T08:26:10.008830+0000","last_became_peered":"2024-04-24T08:26:10.008830+0000","last_unstale":"2024-04-24T08:26:12.001608+0000","last_undegraded":"2024-04-24T08:26:12.001608+0000","last_fullsized":"2024-04-24T08:26:12.001608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:36:45.731070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.696563+0000","last_change":"2024-04-24T08:26:11.020487+0000","last_active":"2024-04-24T08:26:12.696563+0000","last_peered":"2024-04-24T08:26:12.696563+0000","last_clean":"2024-04-24T08:26:12.696563+0000","last_became_active":"2024-04-24T08:26:11.016511+0000","last_became_peered":"2024-04-24T08:26:11.016511+0000","last_unstale":"2024-04-24T08:26:12.696563+0000","last_undegraded":"2024-04-24T08:26:12.696563+0000","last_fullsized":"2024-04-24T08:26:12.696563+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:54:34.696027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001136+0000","last_change":"2024-04-24T08:26:10.011543+0000","last_active":"2024-04-24T08:26:12.001136+0000","last_peered":"2024-04-24T08:26:12.001136+0000","last_clean":"2024-04-24T08:26:12.001136+0000","last_became_active":"2024-04-24T08:26:10.011213+0000","last_became_peered":"2024-04-24T08:26:10.011213+0000","last_unstale":"2024-04-24T08:26:12.001136+0000","last_undegraded":"2024-04-24T08:26:12.001136+0000","last_fullsized":"2024-04-24T08:26:12.001136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:28:19.619302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.000654+0000","last_change":"2024-04-24T08:26:11.002439+0000","last_active":"2024-04-24T08:26:12.000654+0000","last_peered":"2024-04-24T08:26:12.000654+0000","last_clean":"2024-04-24T08:26:12.000654+0000","last_became_active":"2024-04-24T08:26:11.002176+0000","last_became_peered":"2024-04-24T08:26:11.002176+0000","last_unstale":"2024-04-24T08:26:12.000654+0000","last_undegraded":"2024-04-24T08:26:12.000654+0000","last_fullsized":"2024-04-24T08:26:12.000654+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:05.543495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252917+0000","last_change":"2024-04-24T08:26:10.009102+0000","last_active":"2024-04-24T08:26:12.252917+0000","last_peered":"2024-04-24T08:26:12.252917+0000","last_clean":"2024-04-24T08:26:12.252917+0000","last_became_active":"2024-04-24T08:26:10.008736+0000","last_became_peered":"2024-04-24T08:26:10.008736+0000","last_unstale":"2024-04-24T08:26:12.252917+0000","last_undegraded":"2024-04-24T08:26:12.252917+0000","last_fullsized":"2024-04-24T08:26:12.252917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:17.357317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001630+0000","last_change":"2024-04-24T08:26:11.019515+0000","last_active":"2024-04-24T08:26:12.001630+0000","last_peered":"2024-04-24T08:26:12.001630+0000","last_clean":"2024-04-24T08:26:12.001630+0000","last_became_active":"2024-04-24T08:26:11.019067+0000","last_became_peered":"2024-04-24T08:26:11.019067+0000","last_unstale":"2024-04-24T08:26:12.001630+0000","last_undegraded":"2024-04-24T08:26:12.001630+0000","last_fullsized":"2024-04-24T08:26:12.001630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:54:34.696027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.010956+0000","last_change":"2024-04-24T08:26:10.009630+0000","last_active":"2024-04-24T08:26:12.010956+0000","last_peered":"2024-04-24T08:26:12.010956+0000","last_clean":"2024-04-24T08:26:12.010956+0000","last_became_active":"2024-04-24T08:26:10.009059+0000","last_became_peered":"2024-04-24T08:26:10.009059+0000","last_unstale":"2024-04-24T08:26:12.010956+0000","last_undegraded":"2024-04-24T08:26:12.010956+0000","last_fullsized":"2024-04-24T08:26:12.010956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:14:20.203803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.010650+0000","last_change":"2024-04-24T08:26:11.013537+0000","last_active":"2024-04-24T08:26:12.010650+0000","last_peered":"2024-04-24T08:26:12.010650+0000","last_clean":"2024-04-24T08:26:12.010650+0000","last_became_active":"2024-04-24T08:26:11.013241+0000","last_became_peered":"2024-04-24T08:26:11.013241+0000","last_unstale":"2024-04-24T08:26:12.010650+0000","last_undegraded":"2024-04-24T08:26:12.010650+0000","last_fullsized":"2024-04-24T08:26:12.010650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:10:09.108177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252629+0000","last_change":"2024-04-24T08:26:10.005806+0000","last_active":"2024-04-24T08:26:12.252629+0000","last_peered":"2024-04-24T08:26:12.252629+0000","last_clean":"2024-04-24T08:26:12.252629+0000","last_became_active":"2024-04-24T08:26:10.005520+0000","last_became_peered":"2024-04-24T08:26:10.005520+0000","last_unstale":"2024-04-24T08:26:12.252629+0000","last_undegraded":"2024-04-24T08:26:12.252629+0000","last_fullsized":"2024-04-24T08:26:12.252629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:45.812010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.747507+0000","last_change":"2024-04-24T08:26:11.012389+0000","last_active":"2024-04-24T08:26:12.747507+0000","last_peered":"2024-04-24T08:26:12.747507+0000","last_clean":"2024-04-24T08:26:12.747507+0000","last_became_active":"2024-04-24T08:26:11.012018+0000","last_became_peered":"2024-04-24T08:26:11.012018+0000","last_unstale":"2024-04-24T08:26:12.747507+0000","last_undegraded":"2024-04-24T08:26:12.747507+0000","last_fullsized":"2024-04-24T08:26:12.747507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:18.368505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.010746+0000","last_change":"2024-04-24T08:26:10.006176+0000","last_active":"2024-04-24T08:26:12.010746+0000","last_peered":"2024-04-24T08:26:12.010746+0000","last_clean":"2024-04-24T08:26:12.010746+0000","last_became_active":"2024-04-24T08:26:10.005931+0000","last_became_peered":"2024-04-24T08:26:10.005931+0000","last_unstale":"2024-04-24T08:26:12.010746+0000","last_undegraded":"2024-04-24T08:26:12.010746+0000","last_fullsized":"2024-04-24T08:26:12.010746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:02:45.812010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.010655+0000","last_change":"2024-04-24T08:26:11.016771+0000","last_active":"2024-04-24T08:26:12.010655+0000","last_peered":"2024-04-24T08:26:12.010655+0000","last_clean":"2024-04-24T08:26:12.010655+0000","last_became_active":"2024-04-24T08:26:11.016502+0000","last_became_peered":"2024-04-24T08:26:11.016502+0000","last_unstale":"2024-04-24T08:26:12.010655+0000","last_undegraded":"2024-04-24T08:26:12.010655+0000","last_fullsized":"2024-04-24T08:26:12.010655+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:22:32.570850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.252502+0000","last_change":"2024-04-24T08:26:10.008690+0000","last_active":"2024-04-24T08:26:12.252502+0000","last_peered":"2024-04-24T08:26:12.252502+0000","last_clean":"2024-04-24T08:26:12.252502+0000","last_became_active":"2024-04-24T08:26:10.008368+0000","last_became_peered":"2024-04-24T08:26:10.008368+0000","last_unstale":"2024-04-24T08:26:12.252502+0000","last_undegraded":"2024-04-24T08:26:12.252502+0000","last_fullsized":"2024-04-24T08:26:12.252502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:11:48.720898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.747913+0000","last_change":"2024-04-24T08:26:11.033379+0000","last_active":"2024-04-24T08:26:12.747913+0000","last_peered":"2024-04-24T08:26:12.747913+0000","last_clean":"2024-04-24T08:26:12.747913+0000","last_became_active":"2024-04-24T08:26:11.032373+0000","last_became_peered":"2024-04-24T08:26:11.032373+0000","last_unstale":"2024-04-24T08:26:12.747913+0000","last_undegraded":"2024-04-24T08:26:12.747913+0000","last_fullsized":"2024-04-24T08:26:12.747913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:37.375573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001769+0000","last_change":"2024-04-24T08:26:09.999108+0000","last_active":"2024-04-24T08:26:12.001769+0000","last_peered":"2024-04-24T08:26:12.001769+0000","last_clean":"2024-04-24T08:26:12.001769+0000","last_became_active":"2024-04-24T08:26:09.998732+0000","last_became_peered":"2024-04-24T08:26:09.998732+0000","last_unstale":"2024-04-24T08:26:12.001769+0000","last_undegraded":"2024-04-24T08:26:12.001769+0000","last_fullsized":"2024-04-24T08:26:12.001769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:24:18.785758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.001494+0000","last_change":"2024-04-24T08:26:11.008702+0000","last_active":"2024-04-24T08:26:12.001494+0000","last_peered":"2024-04-24T08:26:12.001494+0000","last_clean":"2024-04-24T08:26:12.001494+0000","last_became_active":"2024-04-24T08:26:11.008385+0000","last_became_peered":"2024-04-24T08:26:11.008385+0000","last_unstale":"2024-04-24T08:26:12.001494+0000","last_undegraded":"2024-04-24T08:26:12.001494+0000","last_fullsized":"2024-04-24T08:26:12.001494+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:28:20.630490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.748189+0000","last_change":"2024-04-24T08:26:10.014147+0000","last_active":"2024-04-24T08:26:12.748189+0000","last_peered":"2024-04-24T08:26:12.748189+0000","last_clean":"2024-04-24T08:26:12.748189+0000","last_became_active":"2024-04-24T08:26:10.013893+0000","last_became_peered":"2024-04-24T08:26:10.013893+0000","last_unstale":"2024-04-24T08:26:12.748189+0000","last_undegraded":"2024-04-24T08:26:12.748189+0000","last_fullsized":"2024-04-24T08:26:12.748189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:58:18.070188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.696627+0000","last_change":"2024-04-24T08:26:11.018199+0000","last_active":"2024-04-24T08:26:12.696627+0000","last_peered":"2024-04-24T08:26:12.696627+0000","last_clean":"2024-04-24T08:26:12.696627+0000","last_became_active":"2024-04-24T08:26:11.017100+0000","last_became_peered":"2024-04-24T08:26:11.017100+0000","last_unstale":"2024-04-24T08:26:12.696627+0000","last_undegraded":"2024-04-24T08:26:12.696627+0000","last_fullsized":"2024-04-24T08:26:12.696627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:09.977032+0000","last_clean_scrub_stamp":"2024-04-24T08:26:09.977032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:37.375573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.747438+0000","last_change":"2024-04-24T08:26:10.004578+0000","last_active":"2024-04-24T08:26:12.747438+0000","last_peered":"2024-04-24T08:26:12.747438+0000","last_clean":"2024-04-24T08:26:12.747438+0000","last_became_active":"2024-04-24T08:26:10.004401+0000","last_became_peered":"2024-04-24T08:26:10.004401+0000","last_unstale":"2024-04-24T08:26:12.747438+0000","last_undegraded":"2024-04-24T08:26:12.747438+0000","last_fullsized":"2024-04-24T08:26:12.747438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:26:08.965845+0000","last_clean_scrub_stamp":"2024-04-24T08:26:08.965845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:29:04.532307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.695902+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:26:12.695902+0000","last_peered":"2024-04-24T08:26:12.695902+0000","last_clean":"2024-04-24T08:26:12.695902+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:26:12.695902+0000","last_undegraded":"2024-04-24T08:26:12.695902+0000","last_fullsized":"2024-04-24T08:26:12.695902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":921600,"data_stored":714470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":124628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":331776,"data_stored":124684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":331776,"data_stored":124116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":124082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":917504,"data_stored":714380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:26:19.932 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-24T08:26:19.932 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-24T08:26:20.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.112+0000 7f3662c00640 1 Processor -- start 2024-04-24T08:26:20.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.112+0000 7f3662c00640 1 -- start start 2024-04-24T08:26:20.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.112+0000 7f3662c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f365c0b2d00 0x7f365c0b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:20.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.112+0000 7f3662c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f365c073cd0 0x7f365c150390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:20.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.112+0000 7f3662c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365c0b30e0 con 0x7f365c06d210 2024-04-24T08:26:20.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.112+0000 7f3662c00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f365c06db70 con 0x7f365c073cd0 2024-04-24T08:26:20.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.112+0000 7f3662c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f365c06e580 con 0x7f365c0b2d00 2024-04-24T08:26:20.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.112+0000 7f3660c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f365c073cd0 0x7f365c150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:20.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.112+0000 7f3660c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f365c073cd0 0x7f365c150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33406/0 (socket says 172.21.15.88:33406) 2024-04-24T08:26:20.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.112+0000 7f3660c00640 1 -- 172.21.15.88:0/1741261832 learned_addr learned my addr 172.21.15.88:0/1741261832 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:20.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.116+0000 7f365be00640 1 --2- 172.21.15.88:0/1741261832 >> v2:172.21.15.142:3300/0 conn(0x7f365c0b2d00 0x7f365c0b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:20.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.116+0000 7f3660c00640 1 -- 172.21.15.88:0/1741261832 >> v2:172.21.15.142:3300/0 conn(0x7f365c0b2d00 msgr2=0x7f365c0b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:20.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.116+0000 7f3660c00640 1 --2- 172.21.15.88:0/1741261832 >> v2:172.21.15.142:3300/0 conn(0x7f365c0b2d00 0x7f365c0b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.116+0000 7f3660c00640 1 -- 172.21.15.88:0/1741261832 >> v1:172.21.15.142:6789/0 conn(0x7f365c06d210 legacy=0x7f365c145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:20.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.116+0000 7f3660c00640 1 -- 172.21.15.88:0/1741261832 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c146180 con 0x7f365c073cd0 2024-04-24T08:26:20.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.116+0000 7f3660c00640 1 --2- 172.21.15.88:0/1741261832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c073cd0 0x7f365c150390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f365c0b6f00 tx=0x7f365401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c7b294c61c3717 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:20.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.116+0000 7f365b400640 1 -- 172.21.15.88:0/1741261832 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36540b1070 con 0x7f365c073cd0 2024-04-24T08:26:20.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.116+0000 7f365b400640 1 -- 172.21.15.88:0/1741261832 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36540ac640 con 0x7f365c073cd0 2024-04-24T08:26:20.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.116+0000 7f365b400640 1 -- 172.21.15.88:0/1741261832 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36540aca10 con 0x7f365c073cd0 2024-04-24T08:26:20.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.116+0000 7f3662c00640 1 -- 172.21.15.88:0/1741261832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c073cd0 msgr2=0x7f365c150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:20.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.116+0000 7f3662c00640 1 --2- 172.21.15.88:0/1741261832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c073cd0 0x7f365c150390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f365c0b6f00 tx=0x7f365401c400 comp rx=0 tx=0).stop 2024-04-24T08:26:20.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 -- 172.21.15.88:0/1741261832 shutdown_connections 2024-04-24T08:26:20.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 --2- 172.21.15.88:0/1741261832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c073cd0 0x7f365c150390 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 --2- 172.21.15.88:0/1741261832 >> v2:172.21.15.142:3300/0 conn(0x7f365c0b2d00 0x7f365c0b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 -- 172.21.15.88:0/1741261832 >> 172.21.15.88:0/1741261832 conn(0x7f365c0b9390 msgr2=0x7f365c0b97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:20.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 -- 172.21.15.88:0/1741261832 shutdown_connections 2024-04-24T08:26:20.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 -- 172.21.15.88:0/1741261832 wait complete. 2024-04-24T08:26:20.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 Processor -- start 2024-04-24T08:26:20.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 -- start start 2024-04-24T08:26:20.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f365c06d210 0x7f365c1e4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:20.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c073cd0 0x7f365c09c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:20.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f365c0b2d00 0x7f365c09b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:20.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f365c153480 con 0x7f365c073cd0 2024-04-24T08:26:20.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f365c153300 con 0x7f365c06d210 2024-04-24T08:26:20.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f365c153600 con 0x7f365c0b2d00 2024-04-24T08:26:20.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3653400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c073cd0 0x7f365c09c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:20.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3653400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c073cd0 0x7f365c09c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33410/0 (socket says 172.21.15.88:33410) 2024-04-24T08:26:20.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3653400640 1 -- 172.21.15.88:0/558762343 learned_addr learned my addr 172.21.15.88:0/558762343 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:20.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f365be00640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f365c06d210 0x7f365c1e4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:20.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3660c00640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f365c0b2d00 0x7f365c09b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:20.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3653400640 1 -- 172.21.15.88:0/558762343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f365c0b2d00 msgr2=0x7f365c09b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:20.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3653400640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f365c0b2d00 0x7f365c09b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3653400640 1 -- 172.21.15.88:0/558762343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f365c06d210 msgr2=0x7f365c1e4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:20.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3653400640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f365c06d210 0x7f365c1e4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3653400640 1 -- 172.21.15.88:0/558762343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c09df70 con 0x7f365c073cd0 2024-04-24T08:26:20.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3660c00640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f365c0b2d00 0x7f365c09b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:20.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3653400640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c073cd0 0x7f365c09c880 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f364400c450 tx=0x7f364400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:20.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3658c00640 1 -- 172.21.15.88:0/558762343 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644016020 con 0x7f365c073cd0 2024-04-24T08:26:20.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3658c00640 1 -- 172.21.15.88:0/558762343 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36440052d0 con 0x7f365c073cd0 2024-04-24T08:26:20.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 -- 172.21.15.88:0/558762343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365c1e3b10 con 0x7f365c073cd0 2024-04-24T08:26:20.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3658c00640 1 -- 172.21.15.88:0/558762343 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644007260 con 0x7f365c073cd0 2024-04-24T08:26:20.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.120+0000 7f3662c00640 1 -- 172.21.15.88:0/558762343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365c0b65b0 con 0x7f365c073cd0 2024-04-24T08:26:20.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.124+0000 7f3662c00640 1 -- 172.21.15.88:0/558762343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f365c068b90 con 0x7f365c073cd0 2024-04-24T08:26:20.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.124+0000 7f3658c00640 1 -- 172.21.15.88:0/558762343 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3644007400 con 0x7f365c073cd0 2024-04-24T08:26:20.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.124+0000 7f3658c00640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3638068380 0x7f363806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:20.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.124+0000 7f3658c00640 1 -- 172.21.15.88:0/558762343 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f36440862f0 con 0x7f365c073cd0 2024-04-24T08:26:20.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.124+0000 7f365be00640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3638068380 0x7f363806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:20.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.124+0000 7f365be00640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3638068380 0x7f363806a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f364c003fd0 tx=0x7f364c0039a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:20.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.128+0000 7f3658c00640 1 -- 172.21.15.88:0/558762343 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3644020020 con 0x7f365c073cd0 2024-04-24T08:26:20.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.340+0000 7f3662c00640 1 -- 172.21.15.88:0/558762343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f365c0b4d20 con 0x7f365c073cd0 2024-04-24T08:26:20.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3658c00640 1 -- 172.21.15.88:0/558762343 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f3644005480 con 0x7f365c073cd0 2024-04-24T08:26:20.346 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2024-04-24T08:26:20.346 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC8wShmTIw5NRAA2gyIbsJGs4xD5Edvy8KmQg== 2024-04-24T08:26:20.346 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow" 2024-04-24T08:26:20.346 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow r" 2024-04-24T08:26:20.346 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-24T08:26:20.347 INFO:teuthology.orchestra.run.smithi088.stderr:updated caps for client.0 2024-04-24T08:26:20.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3662c00640 1 -- 172.21.15.88:0/558762343 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3638068380 msgr2=0x7f363806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:20.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3662c00640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3638068380 0x7f363806a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f364c003fd0 tx=0x7f364c0039a0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3662c00640 1 -- 172.21.15.88:0/558762343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c073cd0 msgr2=0x7f365c09c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:20.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3662c00640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c073cd0 0x7f365c09c880 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f364400c450 tx=0x7f364400c910 comp rx=0 tx=0).stop 2024-04-24T08:26:20.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3662c00640 1 -- 172.21.15.88:0/558762343 shutdown_connections 2024-04-24T08:26:20.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3662c00640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f3638068380 0x7f363806a840 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3662c00640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f365c0b2d00 0x7f365c09b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3662c00640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c073cd0 0x7f365c09c880 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3662c00640 1 --2- 172.21.15.88:0/558762343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f365c06d210 0x7f365c1e4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3662c00640 1 -- 172.21.15.88:0/558762343 >> 172.21.15.88:0/558762343 conn(0x7f365c0b9390 msgr2=0x7f365c0aec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:20.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3662c00640 1 -- 172.21.15.88:0/558762343 shutdown_connections 2024-04-24T08:26:20.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.344+0000 7f3662c00640 1 -- 172.21.15.88:0/558762343 wait complete. 2024-04-24T08:26:20.368 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:26:20.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd003600640 1 Processor -- start 2024-04-24T08:26:20.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd003600640 1 -- start start 2024-04-24T08:26:20.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd003600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcffc0b7400 0x7fcffc0ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:20.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd003600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcffc145ec0 0x7fcffc150780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:20.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd003600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcffc0b64e0 con 0x7fcffc0a94c0 2024-04-24T08:26:20.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd003600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fcffc0b77e0 con 0x7fcffc0b7400 2024-04-24T08:26:20.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd003600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcffc0b69e0 con 0x7fcffc145ec0 2024-04-24T08:26:20.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd000c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcffc0b7400 0x7fcffc0ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:20.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fcffbe00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcffc0a94c0 0x7fcffc1466b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51078/0 (socket says 172.21.15.88:51078) 2024-04-24T08:26:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fcffbe00640 1 -- 172.21.15.88:0/765572599 learned_addr learned my addr 172.21.15.88:0/765572599 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd001600640 1 --2- 172.21.15.88:0/765572599 >> v2:172.21.15.142:3300/0 conn(0x7fcffc145ec0 0x7fcffc150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd000c00640 1 -- 172.21.15.88:0/765572599 >> v2:172.21.15.142:3300/0 conn(0x7fcffc145ec0 msgr2=0x7fcffc150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:20.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd000c00640 1 --2- 172.21.15.88:0/765572599 >> v2:172.21.15.142:3300/0 conn(0x7fcffc145ec0 0x7fcffc150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd000c00640 1 -- 172.21.15.88:0/765572599 >> v1:172.21.15.88:6789/0 conn(0x7fcffc0a94c0 legacy=0x7fcffc1466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:20.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd000c00640 1 -- 172.21.15.88:0/765572599 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc0b6700 con 0x7fcffc0b7400 2024-04-24T08:26:20.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fd001600640 1 --2- 172.21.15.88:0/765572599 >> v2:172.21.15.142:3300/0 conn(0x7fcffc145ec0 0x7fcffc150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:20.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.500+0000 7fcffb400640 1 -- 172.21.15.88:0/765572599 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485459865 0 0) 0x7fcffc0b64e0 con 0x7fcffc0a94c0 2024-04-24T08:26:20.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fd000c00640 1 --2- 172.21.15.88:0/765572599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc0b7400 0x7fcffc0ab360 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0aaa70 tx=0x7fcff001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fe1a42a2e66697 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fcffb400640 1 -- 172.21.15.88:0/765572599 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff00b0070 con 0x7fcffc0b7400 2024-04-24T08:26:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fcffb400640 1 -- 172.21.15.88:0/765572599 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff00ab600 con 0x7fcffc0b7400 2024-04-24T08:26:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fcffb400640 1 -- 172.21.15.88:0/765572599 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff00ab9d0 con 0x7fcffc0b7400 2024-04-24T08:26:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fd003600640 1 -- 172.21.15.88:0/765572599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc0b7400 msgr2=0x7fcffc0ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:20.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fd003600640 1 --2- 172.21.15.88:0/765572599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc0b7400 0x7fcffc0ab360 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0aaa70 tx=0x7fcff001c3f0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fd003600640 1 -- 172.21.15.88:0/765572599 shutdown_connections 2024-04-24T08:26:20.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fd003600640 1 --2- 172.21.15.88:0/765572599 >> v2:172.21.15.142:3300/0 conn(0x7fcffc145ec0 0x7fcffc150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fd003600640 1 --2- 172.21.15.88:0/765572599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc0b7400 0x7fcffc0ab360 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fd003600640 1 -- 172.21.15.88:0/765572599 >> 172.21.15.88:0/765572599 conn(0x7fcffc067810 msgr2=0x7fcffc067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:20.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fd003600640 1 -- 172.21.15.88:0/765572599 shutdown_connections 2024-04-24T08:26:20.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fd003600640 1 -- 172.21.15.88:0/765572599 wait complete. 2024-04-24T08:26:20.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fd003600640 1 Processor -- start 2024-04-24T08:26:20.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.504+0000 7fd003600640 1 -- start start 2024-04-24T08:26:20.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd003600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc0b7400 0x7fcffc06e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:20.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd003600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcffc145ec0 0x7fcffc13bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:20.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd003600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcffc1e3af0 0x7fcffc1388f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:20.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd003600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc0b7cd0 con 0x7fcffc0b7400 2024-04-24T08:26:20.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd003600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc0b5eb0 con 0x7fcffc145ec0 2024-04-24T08:26:20.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd003600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcffc0b7e50 con 0x7fcffc1e3af0 2024-04-24T08:26:20.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd000c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc0b7400 0x7fcffc06e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:20.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd000c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc0b7400 0x7fcffc06e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33434/0 (socket says 172.21.15.88:33434) 2024-04-24T08:26:20.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd000c00640 1 -- 172.21.15.88:0/1091382943 learned_addr learned my addr 172.21.15.88:0/1091382943 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:20.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd000c00640 1 -- 172.21.15.88:0/1091382943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcffc1e3af0 msgr2=0x7fcffc1388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:20.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd000c00640 1 --2- 172.21.15.88:0/1091382943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcffc1e3af0 0x7fcffc1388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd000c00640 1 -- 172.21.15.88:0/1091382943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcffc145ec0 msgr2=0x7fcffc13bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:20.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd000c00640 1 --2- 172.21.15.88:0/1091382943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcffc145ec0 0x7fcffc13bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd000c00640 1 -- 172.21.15.88:0/1091382943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc06d880 con 0x7fcffc0b7400 2024-04-24T08:26:20.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd000c00640 1 --2- 172.21.15.88:0/1091382943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc0b7400 0x7fcffc06e360 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcff00ae040 tx=0x7fcff0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:20.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fcff8c00640 1 -- 172.21.15.88:0/1091382943 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff00b8020 con 0x7fcffc0b7400 2024-04-24T08:26:20.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fcff8c00640 1 -- 172.21.15.88:0/1091382943 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff00b4410 con 0x7fcffc0b7400 2024-04-24T08:26:20.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd003600640 1 -- 172.21.15.88:0/1091382943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcffc06db60 con 0x7fcffc0b7400 2024-04-24T08:26:20.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fcff8c00640 1 -- 172.21.15.88:0/1091382943 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff00b0040 con 0x7fcffc0b7400 2024-04-24T08:26:20.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fd003600640 1 -- 172.21.15.88:0/1091382943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcffc147950 con 0x7fcffc0b7400 2024-04-24T08:26:20.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fcfee000640 1 -- 172.21.15.88:0/1091382943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd00052a0 con 0x7fcffc0b7400 2024-04-24T08:26:20.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.508+0000 7fcff8c00640 1 -- 172.21.15.88:0/1091382943 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcff00bb020 con 0x7fcffc0b7400 2024-04-24T08:26:20.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.512+0000 7fcff8c00640 1 --2- 172.21.15.88:0/1091382943 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fcfdc0683d0 0x7fcfdc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:20.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.512+0000 7fcff8c00640 1 -- 172.21.15.88:0/1091382943 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fcff0120620 con 0x7fcffc0b7400 2024-04-24T08:26:20.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.512+0000 7fcffbe00640 1 --2- 172.21.15.88:0/1091382943 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fcfdc0683d0 0x7fcfdc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:20.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.512+0000 7fcffbe00640 1 --2- 172.21.15.88:0/1091382943 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fcfdc0683d0 0x7fcfdc06a890 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcffc1e16b0 tx=0x7fcfe8007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:20.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.516+0000 7fcff8c00640 1 -- 172.21.15.88:0/1091382943 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcff00c2030 con 0x7fcffc0b7400 2024-04-24T08:26:20.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 -- 172.21.15.88:0/1091382943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfd0005860 con 0x7fcffc0b7400 2024-04-24T08:26:20.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcff8c00640 1 -- 172.21.15.88:0/1091382943 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3534 (secure 0 0 0) 0x7fcff0016070 con 0x7fcffc0b7400 2024-04-24T08:26:20.707 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:20.707 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1471179990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1471179990},{"type":"v1","addr":"172.21.15.142:6833","nonce":1471179990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:26:10.368031+0000","modified":"2024-04-24T08:26:13.385291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3724486177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3724486177},{"type":"v1","addr":"172.21.15.88:6835","nonce":3724486177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4962,"qdb_cluster":[4962]},"id":2}]} 2024-04-24T08:26:20.707 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 16 2024-04-24T08:26:20.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 -- 172.21.15.88:0/1091382943 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fcfdc0683d0 msgr2=0x7fcfdc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:20.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 --2- 172.21.15.88:0/1091382943 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fcfdc0683d0 0x7fcfdc06a890 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcffc1e16b0 tx=0x7fcfe8007970 comp rx=0 tx=0).stop 2024-04-24T08:26:20.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 -- 172.21.15.88:0/1091382943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc0b7400 msgr2=0x7fcffc06e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:20.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 --2- 172.21.15.88:0/1091382943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc0b7400 0x7fcffc06e360 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcff00ae040 tx=0x7fcff0019190 comp rx=0 tx=0).stop 2024-04-24T08:26:20.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 -- 172.21.15.88:0/1091382943 shutdown_connections 2024-04-24T08:26:20.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 --2- 172.21.15.88:0/1091382943 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fcfdc0683d0 0x7fcfdc06a890 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 --2- 172.21.15.88:0/1091382943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcffc1e3af0 0x7fcffc1388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 --2- 172.21.15.88:0/1091382943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcffc145ec0 0x7fcffc13bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 --2- 172.21.15.88:0/1091382943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcffc0b7400 0x7fcffc06e360 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:20.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 -- 172.21.15.88:0/1091382943 >> 172.21.15.88:0/1091382943 conn(0x7fcffc067810 msgr2=0x7fcffc067bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:20.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 -- 172.21.15.88:0/1091382943 shutdown_connections 2024-04-24T08:26:20.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:20.704+0000 7fcfee000640 1 -- 172.21.15.88:0/1091382943 wait complete. 2024-04-24T08:26:20.929 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T08:26:10.368031+0000', 'modified': '2024-04-24T08:26:13.385291+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4962}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4962': {'gid': 4962, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6835/3724486177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6834', 'nonce': 3724486177}, {'type': 'v1', 'addr': '172.21.15.88:6835', 'nonce': 3724486177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4962, 'qdb_cluster': [4962]} 2024-04-24T08:26:20.929 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T08:26:20.929 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-24T08:26:21.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.064+0000 7f8421a00640 1 Processor -- start 2024-04-24T08:26:21.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.064+0000 7f8421a00640 1 -- start start 2024-04-24T08:26:21.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f8421a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f841c09b620 0x7f841c09ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f8421a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f841c09c4d0 0x7f841c1492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f8421a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f841c1497f0 0x7f841c06d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f8421a00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f841c06eb30 con 0x7f841c09b620 2024-04-24T08:26:21.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f8421a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f841c09d430 con 0x7f841c1497f0 2024-04-24T08:26:21.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f8421a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f841c09dea0 con 0x7f841c09c4d0 2024-04-24T08:26:21.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f841aa00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f841c09b620 0x7f841c09ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f841aa00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f841c09b620 0x7f841c09ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33450/0 (socket says 172.21.15.88:33450) 2024-04-24T08:26:21.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f841aa00640 1 -- 172.21.15.88:0/193834760 learned_addr learned my addr 172.21.15.88:0/193834760 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:21.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f841a000640 1 --2- 172.21.15.88:0/193834760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f841c09c4d0 0x7f841c1492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f841b400640 1 --2- 172.21.15.88:0/193834760 >> v2:172.21.15.142:3300/0 conn(0x7f841c1497f0 0x7f841c06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f841aa00640 1 -- 172.21.15.88:0/193834760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f841c09c4d0 msgr2=0x7f841c1492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:21.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f841aa00640 1 --2- 172.21.15.88:0/193834760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f841c09c4d0 0x7f841c1492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f841aa00640 1 -- 172.21.15.88:0/193834760 >> v2:172.21.15.142:3300/0 conn(0x7f841c1497f0 msgr2=0x7f841c06d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:21.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f841aa00640 1 --2- 172.21.15.88:0/193834760 >> v2:172.21.15.142:3300/0 conn(0x7f841c1497f0 0x7f841c06d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f841aa00640 1 -- 172.21.15.88:0/193834760 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c09d6a0 con 0x7f841c09b620 2024-04-24T08:26:21.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f841aa00640 1 --2- 172.21.15.88:0/193834760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f841c09b620 0x7f841c09ba00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f841c0b5ec0 tx=0x7f840c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a979761e24d2e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:21.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f8419600640 1 -- 172.21.15.88:0/193834760 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0a55e0 con 0x7f841c09b620 2024-04-24T08:26:21.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.068+0000 7f8419600640 1 -- 172.21.15.88:0/193834760 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c0a5780 con 0x7f841c09b620 2024-04-24T08:26:21.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8419600640 1 -- 172.21.15.88:0/193834760 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0a5b50 con 0x7f841c09b620 2024-04-24T08:26:21.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 -- 172.21.15.88:0/193834760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f841c09b620 msgr2=0x7f841c09ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 --2- 172.21.15.88:0/193834760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f841c09b620 0x7f841c09ba00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f841c0b5ec0 tx=0x7f840c01c960 comp rx=0 tx=0).stop 2024-04-24T08:26:21.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 -- 172.21.15.88:0/193834760 shutdown_connections 2024-04-24T08:26:21.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 --2- 172.21.15.88:0/193834760 >> v2:172.21.15.142:3300/0 conn(0x7f841c1497f0 0x7f841c06d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 --2- 172.21.15.88:0/193834760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f841c09c4d0 0x7f841c1492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 --2- 172.21.15.88:0/193834760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f841c09b620 0x7f841c09ba00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 -- 172.21.15.88:0/193834760 >> 172.21.15.88:0/193834760 conn(0x7f841c0b9420 msgr2=0x7f841c0b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:21.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 -- 172.21.15.88:0/193834760 shutdown_connections 2024-04-24T08:26:21.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 -- 172.21.15.88:0/193834760 wait complete. 2024-04-24T08:26:21.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 Processor -- start 2024-04-24T08:26:21.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 -- start start 2024-04-24T08:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f841c09b620 0x7f841c1488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c09c4d0 0x7f841c1e15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f841c1497f0 0x7f841c1e1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f841c143010 con 0x7f841c09b620 2024-04-24T08:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f841c142e90 con 0x7f841c09c4d0 2024-04-24T08:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f8421a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f841c143190 con 0x7f841c1497f0 2024-04-24T08:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f841aa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f841c09b620 0x7f841c1488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f841aa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f841c09b620 0x7f841c1488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33454/0 (socket says 172.21.15.88:33454) 2024-04-24T08:26:21.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f841aa00640 1 -- 172.21.15.88:0/3182461333 learned_addr learned my addr 172.21.15.88:0/3182461333 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:21.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f841a000640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c09c4d0 0x7f841c1e15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f841b400640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f841c1497f0 0x7f841c1e1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f841aa00640 1 -- 172.21.15.88:0/3182461333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f841c1497f0 msgr2=0x7f841c1e1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f841aa00640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f841c1497f0 0x7f841c1e1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f841aa00640 1 -- 172.21.15.88:0/3182461333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c09c4d0 msgr2=0x7f841c1e15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f841aa00640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c09c4d0 0x7f841c1e15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.072+0000 7f841aa00640 1 -- 172.21.15.88:0/3182461333 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c147bd0 con 0x7f841c09b620 2024-04-24T08:26:21.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.076+0000 7f841aa00640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f841c09b620 0x7f841c1488a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f840c0af040 tx=0x7f840c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.076+0000 7f8412a00640 1 -- 172.21.15.88:0/3182461333 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0bc020 con 0x7f841c09b620 2024-04-24T08:26:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.076+0000 7f8412a00640 1 -- 172.21.15.88:0/3182461333 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c0b88a0 con 0x7f841c09b620 2024-04-24T08:26:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.076+0000 7f8412a00640 1 -- 172.21.15.88:0/3182461333 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c009510 con 0x7f841c09b620 2024-04-24T08:26:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.076+0000 7f8421a00640 1 -- 172.21.15.88:0/3182461333 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c0af190 con 0x7f841c09b620 2024-04-24T08:26:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.076+0000 7f8421a00640 1 -- 172.21.15.88:0/3182461333 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c147e40 con 0x7f841c09b620 2024-04-24T08:26:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.076+0000 7f8412a00640 1 -- 172.21.15.88:0/3182461333 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f840c0bf020 con 0x7f841c09b620 2024-04-24T08:26:21.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.076+0000 7f8412a00640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f83fc068380 0x7f83fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.076+0000 7f8412a00640 1 -- 172.21.15.88:0/3182461333 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f840c1219a0 con 0x7f841c09b620 2024-04-24T08:26:21.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.076+0000 7f841a000640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f83fc068380 0x7f83fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.076+0000 7f8424e79000 1 Processor -- start 2024-04-24T08:26:21.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.076+0000 7f8424e79000 1 -- start start 2024-04-24T08:26:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f841a000640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f83fc068380 0x7f83fc06a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f841c1debe0 tx=0x7f8408008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 0x55d3214de060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d3215089d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d321508f10 0x55d3215092f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55d3213bf6f0 con 0x55d3214ddc80 2024-04-24T08:26:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55d3213264d0 con 0x55d3214de5a0 2024-04-24T08:26:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55d3212c0bf0 con 0x55d321508f10 2024-04-24T08:26:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f841aa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 0x55d3214de060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f841aa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 0x55d3214de060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33466/0 (socket says 172.21.15.88:33466) 2024-04-24T08:26:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f841aa00640 1 -- 172.21.15.88:0/794542261 learned_addr learned my addr 172.21.15.88:0/794542261 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f841a000640 1 --2- 172.21.15.88:0/794542261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d3215089d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f841b400640 1 --2- 172.21.15.88:0/794542261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d321508f10 0x55d3215092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f841aa00640 1 -- 172.21.15.88:0/794542261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d321508f10 msgr2=0x55d3215092f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f841aa00640 1 --2- 172.21.15.88:0/794542261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d321508f10 0x55d3215092f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f841aa00640 1 -- 172.21.15.88:0/794542261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 msgr2=0x55d3215089d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f841aa00640 1 --2- 172.21.15.88:0/794542261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d3215089d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f841aa00640 1 -- 172.21.15.88:0/794542261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3212c0e40 con 0x55d3214ddc80 2024-04-24T08:26:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f841aa00640 1 --2- 172.21.15.88:0/794542261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 0x55d3214de060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f840c01d200 tx=0x7f840c0f12d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc72c379b34d908 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8407400640 1 -- 172.21.15.88:0/794542261 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0f5d20 con 0x55d3214ddc80 2024-04-24T08:26:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8407400640 1 -- 172.21.15.88:0/794542261 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c0fa550 con 0x55d3214ddc80 2024-04-24T08:26:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8407400640 1 -- 172.21.15.88:0/794542261 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0a5660 con 0x55d3214ddc80 2024-04-24T08:26:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 -- 172.21.15.88:0/794542261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 msgr2=0x55d3214de060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 --2- 172.21.15.88:0/794542261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 0x55d3214de060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f840c01d200 tx=0x7f840c0f12d0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 -- 172.21.15.88:0/794542261 shutdown_connections 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 --2- 172.21.15.88:0/794542261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d321508f10 0x55d3215092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 --2- 172.21.15.88:0/794542261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d3215089d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 --2- 172.21.15.88:0/794542261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 0x55d3214de060 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 -- 172.21.15.88:0/794542261 >> 172.21.15.88:0/794542261 conn(0x55d321504780 msgr2=0x55d321506b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 -- 172.21.15.88:0/794542261 shutdown_connections 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 -- 172.21.15.88:0/794542261 wait complete. 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 -- start start 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.080+0000 7f8424e79000 1 Processor -- start 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d3214ddc80 0x55d3214dd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d321511af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d321508f10 0x55d321512030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55d3213e2e50 con 0x55d321508f10 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55d3212e3a60 con 0x55d3214de5a0 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55d3212e1cf0 con 0x55d3214ddc80 2024-04-24T08:26:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 10 client.0 _ll_register_callbacks cb 0x55d3214c3a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841b400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d321508f10 0x55d321512030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841b400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d321508f10 0x55d321512030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33478/0 (socket says 172.21.15.88:33478) 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841b400640 1 -- 172.21.15.88:0/3407719942 learned_addr learned my addr 172.21.15.88:0/3407719942 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841aa00640 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d3214ddc80 0x55d3214dd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841a000640 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d321511af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841b400640 1 -- 172.21.15.88:0/3407719942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d3214ddc80 msgr2=0x55d3214dd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841b400640 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d3214ddc80 0x55d3214dd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841b400640 1 -- 172.21.15.88:0/3407719942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 msgr2=0x55d321511af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841b400640 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d321511af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841b400640 1 -- 172.21.15.88:0/3407719942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3212f1e00 con 0x55d321508f10 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841a000640 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d321511af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841b400640 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d321508f10 0x55d321512030 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8414012580 tx=0x7f8414012a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a343b456d8b19d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f83fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-04-24T08:26:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f83fbe00640 1 -- 172.21.15.88:0/3407719942 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414019070 con 0x55d321508f10 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f83fbe00640 1 -- 172.21.15.88:0/3407719942 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f8414004240 con 0x55d321508f10 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 -- 172.21.15.88:0/3407719942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f840c0fa550 con 0x55d321508f10 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f83fbe00640 1 -- 172.21.15.88:0/3407719942 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f8414024050 con 0x55d321508f10 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 10 client.5160 fetch_fsmap learned FSMap version 16 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 -- 172.21.15.88:0/3407719942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55d3213a8670 con 0x55d321508f10 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f83fbe00640 1 -- 172.21.15.88:0/3407719942 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c0fa550 con 0x55d321508f10 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f83fbe00640 1 -- 172.21.15.88:0/3407719942 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 16) ==== 2284+0+0 (secure 0 0 0) 0x7f8414027020 con 0x55d321508f10 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 10 client.5160 fetch_fsmap finished waiting for FSMap version 16 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 10 client.5160 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 20 client.5160 populate_metadata read hostname 'smithi088' 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.88:6834/3724486177,v1:172.21.15.88:6835/3724486177] conn(0x55d321512a40 0x55d321512e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 4 client.5160 mds_command: new command op to 4962 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T08:26:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 -- 172.21.15.88:0/3407719942 --> [v2:172.21.15.88:6834/3724486177,v1:172.21.15.88:6835/3724486177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3212bfbc0 con 0x55d321512a40 2024-04-24T08:26:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841aa00640 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.88:6834/3724486177,v1:172.21.15.88:6835/3724486177] conn(0x55d321512a40 0x55d321512e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f841aa00640 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.88:6834/3724486177,v1:172.21.15.88:6835/3724486177] conn(0x55d321512a40 0x55d321512e20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6598a4047a0f6742 server_cookie=1725cacd07b3dfa7 in_seq=0 out_seq=0 2024-04-24T08:26:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f83fbe00640 10 client.5160 ms_handle_connect on v2:172.21.15.88:6834/3724486177 2024-04-24T08:26:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f83fbe00640 1 -- 172.21.15.88:0/3407719942 <== mds.0 v2:172.21.15.88:6834/3724486177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d3212bfbc0 con 0x55d321512a40 2024-04-24T08:26:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f83fbe00640 10 client.5160 handle_command_reply: tid=0 2024-04-24T08:26:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 client.5160 shutdown 2024-04-24T08:26:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 -- 172.21.15.88:0/3407719942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d321508f10 msgr2=0x55d321512030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d321508f10 0x55d321512030 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8414012580 tx=0x7f8414012a40 comp rx=0 tx=0).stop 2024-04-24T08:26:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 -- 172.21.15.88:0/3407719942 shutdown_connections 2024-04-24T08:26:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d321508f10 0x55d321512030 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d321511af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.88:6834/3724486177,v1:172.21.15.88:6835/3724486177] conn(0x55d321512a40 0x55d321512e20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 --2- 172.21.15.88:0/3407719942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d3214ddc80 0x55d3214dd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f83fbe00640 0 client.5160 ms_handle_reset on v2:172.21.15.88:6834/3724486177 2024-04-24T08:26:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 -- 172.21.15.88:0/3407719942 >> 172.21.15.88:0/3407719942 conn(0x55d321504780 msgr2=0x55d321506b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 -- 172.21.15.88:0/3407719942 shutdown_connections 2024-04-24T08:26:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.084+0000 7f8424e79000 1 -- 172.21.15.88:0/3407719942 wait complete. 2024-04-24T08:26:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.088+0000 7f8424e79000 20 client.5160 trim_cache size 0 max 16384 2024-04-24T08:26:21.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 Processor -- start 2024-04-24T08:26:21.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 -- start start 2024-04-24T08:26:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d3214ddc80 0x55d3215242b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214de5a0 0x55d321507b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d321508f10 0x55d3215080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f841c1ed4d0 con 0x55d3214de5a0 2024-04-24T08:26:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f841c1e5110 con 0x55d321508f10 2024-04-24T08:26:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55d3213257e0 con 0x55d3214ddc80 2024-04-24T08:26:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f841a000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214de5a0 0x55d321507b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f841a000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214de5a0 0x55d321507b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33494/0 (socket says 172.21.15.88:33494) 2024-04-24T08:26:21.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f841a000640 1 -- 172.21.15.88:0/3560712740 learned_addr learned my addr 172.21.15.88:0/3560712740 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f841aa00640 1 --2- 172.21.15.88:0/3560712740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d3214ddc80 0x55d3215242b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f841b400640 1 --2- 172.21.15.88:0/3560712740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d321508f10 0x55d3215080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f841a000640 1 -- 172.21.15.88:0/3560712740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d3214ddc80 msgr2=0x55d3215242b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f841a000640 1 --2- 172.21.15.88:0/3560712740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d3214ddc80 0x55d3215242b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f841a000640 1 -- 172.21.15.88:0/3560712740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d321508f10 msgr2=0x55d3215080c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f841a000640 1 --2- 172.21.15.88:0/3560712740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d321508f10 0x55d3215080c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f841a000640 1 -- 172.21.15.88:0/3560712740 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d32137f340 con 0x55d3214de5a0 2024-04-24T08:26:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f841b400640 1 --2- 172.21.15.88:0/3560712740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d321508f10 0x55d3215080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f841a000640 1 --2- 172.21.15.88:0/3560712740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214de5a0 0x55d321507b80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8408008010 tx=0x7f8408016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f212454552d15b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8406a00640 1 -- 172.21.15.88:0/3560712740 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840801c040 con 0x55d3214de5a0 2024-04-24T08:26:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8406a00640 1 -- 172.21.15.88:0/3560712740 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840801d040 con 0x55d3214de5a0 2024-04-24T08:26:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8406a00640 1 -- 172.21.15.88:0/3560712740 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408014430 con 0x55d3214de5a0 2024-04-24T08:26:21.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 -- 172.21.15.88:0/3560712740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214de5a0 msgr2=0x55d321507b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 --2- 172.21.15.88:0/3560712740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214de5a0 0x55d321507b80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8408008010 tx=0x7f8408016000 comp rx=0 tx=0).stop 2024-04-24T08:26:21.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 -- 172.21.15.88:0/3560712740 shutdown_connections 2024-04-24T08:26:21.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 --2- 172.21.15.88:0/3560712740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d321508f10 0x55d3215080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 --2- 172.21.15.88:0/3560712740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214de5a0 0x55d321507b80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 --2- 172.21.15.88:0/3560712740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d3214ddc80 0x55d3215242b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 -- 172.21.15.88:0/3560712740 >> 172.21.15.88:0/3560712740 conn(0x55d321504780 msgr2=0x55d3215136b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:21.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 -- 172.21.15.88:0/3560712740 shutdown_connections 2024-04-24T08:26:21.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.104+0000 7f8424e79000 1 -- 172.21.15.88:0/3560712740 wait complete. 2024-04-24T08:26:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 -- start start 2024-04-24T08:26:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 Processor -- start 2024-04-24T08:26:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 0x55d321507a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d3215193b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d321508f10 0x55d3215198f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55d3213336e0 con 0x55d3214ddc80 2024-04-24T08:26:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55d32132ab00 con 0x55d3214de5a0 2024-04-24T08:26:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55d3212bc7b0 con 0x55d321508f10 2024-04-24T08:26:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 10 client.0 _ll_register_callbacks cb 0x7f8414007400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T08:26:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841aa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 0x55d321507a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841aa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 0x55d321507a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33508/0 (socket says 172.21.15.88:33508) 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841aa00640 1 -- 172.21.15.88:0/229387773 learned_addr learned my addr 172.21.15.88:0/229387773 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841a000640 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d3215193b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841b400640 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d321508f10 0x55d3215198f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841aa00640 1 -- 172.21.15.88:0/229387773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d321508f10 msgr2=0x55d3215198f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841aa00640 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d321508f10 0x55d3215198f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841aa00640 1 -- 172.21.15.88:0/229387773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 msgr2=0x55d3215193b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841aa00640 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d3215193b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841aa00640 1 -- 172.21.15.88:0/229387773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3212b87c0 con 0x55d3214ddc80 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841aa00640 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 0x55d321507a80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f840c0f1900 tx=0x7f840c0f8070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd56f0215805f14d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f83fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f83fbe00640 1 -- 172.21.15.88:0/229387773 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0fa550 con 0x55d3214ddc80 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f83fbe00640 1 -- 172.21.15.88:0/229387773 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f840c0edfe0 con 0x55d3214ddc80 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 -- 172.21.15.88:0/229387773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f840801d040 con 0x55d3214ddc80 2024-04-24T08:26:21.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f83fbe00640 1 -- 172.21.15.88:0/229387773 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f840c0f80e0 con 0x55d3214ddc80 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 10 client.5166 fetch_fsmap learned FSMap version 16 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 -- 172.21.15.88:0/229387773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55d3212cb650 con 0x55d3214ddc80 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f83fbe00640 1 -- 172.21.15.88:0/229387773 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840801d040 con 0x55d3214ddc80 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f83fbe00640 1 -- 172.21.15.88:0/229387773 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 16) ==== 2284+0+0 (secure 0 0 0) 0x7f840c0a55e0 con 0x55d3214ddc80 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 10 client.5166 fetch_fsmap finished waiting for FSMap version 16 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 10 client.5166 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 20 client.5166 populate_metadata read hostname 'smithi088' 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.88:6834/3724486177,v1:172.21.15.88:6835/3724486177] conn(0x55d321517390 0x55d3215177a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 4 client.5166 mds_command: new command op to 4962 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 -- 172.21.15.88:0/229387773 --> [v2:172.21.15.88:6834/3724486177,v1:172.21.15.88:6835/3724486177] -- command(tid 0: {"prefix": "status"}) -- 0x55d3212fb4e0 con 0x55d321517390 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841a000640 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.88:6834/3724486177,v1:172.21.15.88:6835/3724486177] conn(0x55d321517390 0x55d3215177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f841a000640 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.88:6834/3724486177,v1:172.21.15.88:6835/3724486177] conn(0x55d321517390 0x55d3215177a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d21d2ccfaa79edb server_cookie=78d4743ba4e61188 in_seq=0 out_seq=0 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f83fbe00640 10 client.5166 ms_handle_connect on v2:172.21.15.88:6834/3724486177 2024-04-24T08:26:21.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f83fbe00640 1 -- 172.21.15.88:0/229387773 <== mds.0 v2:172.21.15.88:6834/3724486177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55d3212fb4e0 con 0x55d321517390 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f83fbe00640 10 client.5166 handle_command_reply: tid=0 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.108+0000 7f8424e79000 1 client.5166 shutdown 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8424e79000 1 -- 172.21.15.88:0/229387773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 msgr2=0x55d321507a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8424e79000 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 0x55d321507a80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f840c0f1900 tx=0x7f840c0f8070 comp rx=0 tx=0).stop 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8424e79000 1 -- 172.21.15.88:0/229387773 shutdown_connections 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8424e79000 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.88:6834/3724486177,v1:172.21.15.88:6835/3724486177] conn(0x55d321517390 0x55d3215177a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8424e79000 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d321508f10 0x55d3215198f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8424e79000 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d3214de5a0 0x55d3215193b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f83fbe00640 0 client.5166 ms_handle_reset on v2:172.21.15.88:6834/3724486177 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8424e79000 1 --2- 172.21.15.88:0/229387773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d3214ddc80 0x55d321507a80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8424e79000 1 -- 172.21.15.88:0/229387773 >> 172.21.15.88:0/229387773 conn(0x55d321504780 msgr2=0x55d321523090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8424e79000 1 -- 172.21.15.88:0/229387773 shutdown_connections 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8424e79000 1 -- 172.21.15.88:0/229387773 wait complete. 2024-04-24T08:26:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8424e79000 20 client.5166 trim_cache size 0 max 16384 2024-04-24T08:26:21.119 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:26:21.119 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "0c7f29ca-8828-476d-9ca3-111d6acc4dca", 2024-04-24T08:26:21.119 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2024-04-24T08:26:21.119 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4962, 2024-04-24T08:26:21.119 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2024-04-24T08:26:21.119 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2024-04-24T08:26:21.119 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2024-04-24T08:26:21.119 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 10.126434325, 2024-04-24T08:26:21.119 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 16, 2024-04-24T08:26:21.119 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 29, 2024-04-24T08:26:21.119 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 29, 2024-04-24T08:26:21.120 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 18.010054011000001 2024-04-24T08:26:21.120 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:26:21.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8421a00640 1 -- 172.21.15.88:0/3182461333 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f83fc068380 msgr2=0x7f83fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8421a00640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f83fc068380 0x7f83fc06a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f841c1debe0 tx=0x7f8408008040 comp rx=0 tx=0).stop 2024-04-24T08:26:21.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8421a00640 1 -- 172.21.15.88:0/3182461333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f841c09b620 msgr2=0x7f841c1488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8421a00640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f841c09b620 0x7f841c1488a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f840c0af040 tx=0x7f840c019700 comp rx=0 tx=0).stop 2024-04-24T08:26:21.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8421a00640 1 -- 172.21.15.88:0/3182461333 shutdown_connections 2024-04-24T08:26:21.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8421a00640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f83fc068380 0x7f83fc06a840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8421a00640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f841c1497f0 0x7f841c1e1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8421a00640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c09c4d0 0x7f841c1e15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8421a00640 1 --2- 172.21.15.88:0/3182461333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f841c09b620 0x7f841c1488a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8421a00640 1 -- 172.21.15.88:0/3182461333 >> 172.21.15.88:0/3182461333 conn(0x7f841c0b9420 msgr2=0x7f841c145db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:21.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8421a00640 1 -- 172.21.15.88:0/3182461333 shutdown_connections 2024-04-24T08:26:21.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.112+0000 7f8421a00640 1 -- 172.21.15.88:0/3182461333 wait complete. 2024-04-24T08:26:21.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T08:26:21.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f71a6800640 1 Processor -- start 2024-04-24T08:26:21.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f71a6800640 1 -- start start 2024-04-24T08:26:21.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f71a6800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a014b020 0x7f71a0141880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f71a6800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a006e360 con 0x7f71a014b4a0 2024-04-24T08:26:21.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f71a6800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a006cc70 con 0x7f71a00b78a0 2024-04-24T08:26:21.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f71a6800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f71a006e5d0 con 0x7f71a014b020 2024-04-24T08:26:21.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f71a5e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f71a014b4a0 0x7f71a01523b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51082/0 (socket says 172.21.15.88:51082) 2024-04-24T08:26:21.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f71a5e00640 1 -- 172.21.15.88:0/3186569158 learned_addr learned my addr 172.21.15.88:0/3186569158 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:21.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f71a4a00640 1 --2- 172.21.15.88:0/3186569158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a014b020 0x7f71a0141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f719fe00640 1 -- 172.21.15.88:0/3186569158 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136093200 0 0) 0x7f71a006e360 con 0x7f71a014b4a0 2024-04-24T08:26:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f719fe00640 1 -- 172.21.15.88:0/3186569158 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7188003530 con 0x7f71a014b4a0 2024-04-24T08:26:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f719fe00640 1 -- 172.21.15.88:0/3186569158 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563801234 0 0) 0x7f71940014a0 con 0x7f71a00b78a0 2024-04-24T08:26:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f71a4a00640 1 -- 172.21.15.88:0/3186569158 >> v1:172.21.15.142:6789/0 conn(0x7f71a00b78a0 legacy=0x7f71a00b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f71a4a00640 1 -- 172.21.15.88:0/3186569158 >> v1:172.21.15.88:6789/0 conn(0x7f71a014b4a0 legacy=0x7f71a01523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.264+0000 7f71a4a00640 1 -- 172.21.15.88:0/3186569158 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a00b7c80 con 0x7f71a014b020 2024-04-24T08:26:21.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.268+0000 7f71a4a00640 1 --2- 172.21.15.88:0/3186569158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a014b020 0x7f71a0141880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f718c0097f0 tx=0x7f718c01c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e286146e173d41c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:21.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.268+0000 7f719fe00640 1 -- 172.21.15.88:0/3186569158 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c0b0070 con 0x7f71a014b020 2024-04-24T08:26:21.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.268+0000 7f719fe00640 1 -- 172.21.15.88:0/3186569158 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718c0ab600 con 0x7f71a014b020 2024-04-24T08:26:21.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.268+0000 7f719fe00640 1 -- 172.21.15.88:0/3186569158 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c0ab9d0 con 0x7f71a014b020 2024-04-24T08:26:21.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.268+0000 7f71a6800640 1 -- 172.21.15.88:0/3186569158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a014b020 msgr2=0x7f71a0141880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.268+0000 7f71a6800640 1 --2- 172.21.15.88:0/3186569158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a014b020 0x7f71a0141880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f718c0097f0 tx=0x7f718c01c390 comp rx=0 tx=0).stop 2024-04-24T08:26:21.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.268+0000 7f71a6800640 1 -- 172.21.15.88:0/3186569158 shutdown_connections 2024-04-24T08:26:21.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.268+0000 7f71a6800640 1 --2- 172.21.15.88:0/3186569158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a014b020 0x7f71a0141880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.268+0000 7f71a6800640 1 -- 172.21.15.88:0/3186569158 >> 172.21.15.88:0/3186569158 conn(0x7f71a0067e10 msgr2=0x7f71a00bb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:21.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.268+0000 7f71a6800640 1 -- 172.21.15.88:0/3186569158 shutdown_connections 2024-04-24T08:26:21.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.268+0000 7f71a6800640 1 -- 172.21.15.88:0/3186569158 wait complete. 2024-04-24T08:26:21.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a6800640 1 Processor -- start 2024-04-24T08:26:21.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a6800640 1 -- start start 2024-04-24T08:26:21.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a6800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a00b78a0 0x7f71a01401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a6800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a014b020 0x7f71a0142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a6800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a014b4a0 0x7f71a00b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a6800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f71a0156880 con 0x7f71a014b020 2024-04-24T08:26:21.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a6800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f71a0156700 con 0x7f71a00b78a0 2024-04-24T08:26:21.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a6800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f71a0156a00 con 0x7f71a014b4a0 2024-04-24T08:26:21.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a4a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a014b020 0x7f71a0142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a4a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a014b020 0x7f71a0142a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33518/0 (socket says 172.21.15.88:33518) 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a4a00640 1 -- 172.21.15.88:0/3900120428 learned_addr learned my addr 172.21.15.88:0/3900120428 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a5400640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a00b78a0 0x7f71a01401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a5e00640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a014b4a0 0x7f71a00b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a4a00640 1 -- 172.21.15.88:0/3900120428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a014b4a0 msgr2=0x7f71a00b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a4a00640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a014b4a0 0x7f71a00b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a4a00640 1 -- 172.21.15.88:0/3900120428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a00b78a0 msgr2=0x7f71a01401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a4a00640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a00b78a0 0x7f71a01401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a4a00640 1 -- 172.21.15.88:0/3900120428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a0143180 con 0x7f71a014b020 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a4a00640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a014b020 0x7f71a0142a90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f718c0097f0 tx=0x7f718c01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f719d600640 1 -- 172.21.15.88:0/3900120428 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c0bb020 con 0x7f71a014b020 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f719d600640 1 -- 172.21.15.88:0/3900120428 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718c0b1040 con 0x7f71a014b020 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f719d600640 1 -- 172.21.15.88:0/3900120428 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c0b0050 con 0x7f71a014b020 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a6800640 1 -- 172.21.15.88:0/3900120428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a0140cd0 con 0x7f71a014b020 2024-04-24T08:26:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.272+0000 7f71a6800640 1 -- 172.21.15.88:0/3900120428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a00b5790 con 0x7f71a014b020 2024-04-24T08:26:21.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.276+0000 7f71a6800640 1 -- 172.21.15.88:0/3900120428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a0068b20 con 0x7f71a014b020 2024-04-24T08:26:21.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.276+0000 7f719d600640 1 -- 172.21.15.88:0/3900120428 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f718c0be070 con 0x7f71a014b020 2024-04-24T08:26:21.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.276+0000 7f719d600640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f71800683b0 0x7f718006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.276+0000 7f719d600640 1 -- 172.21.15.88:0/3900120428 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f718c120070 con 0x7f71a014b020 2024-04-24T08:26:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.276+0000 7f71a5400640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f71800683b0 0x7f718006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.276+0000 7f71a5400640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f71800683b0 0x7f718006a870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f71940012f0 tx=0x7f7194009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.280+0000 7f719d600640 1 -- 172.21.15.88:0/3900120428 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f71a0143180 con 0x7f71a014b020 2024-04-24T08:26:21.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.472+0000 7f71a6800640 1 -- 172.21.15.88:0/3900120428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f71a006edf0 con 0x7f71a014b020 2024-04-24T08:26:21.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.472+0000 7f719d600640 1 -- 172.21.15.88:0/3900120428 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f718c0160d0 con 0x7f71a014b020 2024-04-24T08:26:21.477 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T08:26:21.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.476+0000 7f71a6800640 1 -- 172.21.15.88:0/3900120428 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f71800683b0 msgr2=0x7f718006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.476+0000 7f71a6800640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f71800683b0 0x7f718006a870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f71940012f0 tx=0x7f7194009040 comp rx=0 tx=0).stop 2024-04-24T08:26:21.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.476+0000 7f71a6800640 1 -- 172.21.15.88:0/3900120428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a014b020 msgr2=0x7f71a0142a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:21.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.476+0000 7f71a6800640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a014b020 0x7f71a0142a90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f718c0097f0 tx=0x7f718c01abd0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.476+0000 7f71a6800640 1 -- 172.21.15.88:0/3900120428 shutdown_connections 2024-04-24T08:26:21.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.476+0000 7f71a6800640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f71800683b0 0x7f718006a870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.476+0000 7f71a6800640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a014b4a0 0x7f71a00b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.476+0000 7f71a6800640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a014b020 0x7f71a0142a90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.476+0000 7f71a6800640 1 --2- 172.21.15.88:0/3900120428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a00b78a0 0x7f71a01401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:21.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.476+0000 7f71a6800640 1 -- 172.21.15.88:0/3900120428 >> 172.21.15.88:0/3900120428 conn(0x7f71a0067e10 msgr2=0x7f71a00b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:21.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.476+0000 7f71a6800640 1 -- 172.21.15.88:0/3900120428 shutdown_connections 2024-04-24T08:26:21.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21.476+0000 7f71a6800640 1 -- 172.21.15.88:0/3900120428 wait complete. 2024-04-24T08:26:21.498 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T08:26:21.498 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T08:26:21.498 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2024-04-24T08:26:21.498 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T08:26:21.498 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T08:26:21.498 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T08:26:21.498 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T08:26:21.498 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T08:26:21.499 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T08:26:21.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:21.499 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2024-04-24T08:26:21.508 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T08:26:21.508 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T08:26:21.508 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T08:26:21.508 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-24T08:26:21.508 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2024-04-24T08:26:21.508 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-24T08:26:21.508 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T08:26:21.508 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2024-04-24T08:26:21.508 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2024-04-24T08:26:21.508 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T08:26:21.508 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2024-04-24T08:26:21.508 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42445sec preferred_lft 42445sec 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:b8:c2:5a:7c brd ff:ff:ff:ff:ff:ff 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T08:26:21.509 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-24T08:26:21.510 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T08:26:21.510 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-24T08:26:21.510 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-24T08:26:21.510 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-24T08:26:21.510 INFO:teuthology.orchestra.run.smithi088.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T08:26:21.510 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T08:26:21.510 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-24T08:26:21.510 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-24T08:26:21.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:21.511 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T08:26:21.574 INFO:teuthology.orchestra.run.smithi088.stdout:1 2024-04-24T08:26:21.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:21.577 DEBUG:teuthology.orchestra.run.smithi088:> route 2024-04-24T08:26:21.628 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2024-04-24T08:26:21.628 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T08:26:21.628 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-24T08:26:21.628 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T08:26:21.628 INFO:teuthology.orchestra.run.smithi088.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-24T08:26:21.628 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-24T08:26:21.629 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T08:26:21.629 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T08:26:21.629 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T08:26:21.629 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T08:26:21.629 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T08:26:21.629 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T08:26:21.629 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-24T08:26:21.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T08:26:21.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T08:26:21.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T08:26:21.629 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-24T08:26:21.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T08:26:21.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T08:26:21.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:21.762 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-04-24T08:26:21.771 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T08:26:21.772 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T08:26:21.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:21.772 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2024-04-24T08:26:21.836 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-24T08:26:21.837 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T08:26:21.837 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T08:26:21.889 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T08:26:21.889 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T08:26:21.889 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T08:26:21.941 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2024-04-24T08:26:22.005 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T08:26:22.062 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2024-04-24T08:26:22.062 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2024-04-24T08:26:22.062 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2024-04-24T08:26:22.062 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2024-04-24T08:26:22.062 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2024-04-24T08:26:22.062 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2024-04-24T08:26:22.062 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T08:26:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2024-04-24T08:26:22.064 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2024-04-24T08:26:22.064 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2024-04-24T08:26:22.064 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T08:26:22.064 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T08:26:22.064 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T08:26:22.064 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T08:26:22.064 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2024-04-24T08:26:22.064 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T08:26:22.064 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T08:26:22.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:22.065 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2024-04-24T08:26:22.121 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-24T08:26:22.121 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-24T08:26:22.163 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2024-04-24T08:26:22.183 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T08:26:22.238 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2024-04-24T08:26:22.238 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2024-04-24T08:26:22.238 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2024-04-24T08:26:22.239 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T08:26:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T08:26:22.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:22.241 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2024-04-24T08:26:22.256 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:2024-04-24T08:26:22.252+0000 7f898cb15580 -1 init, newargv = 0x56144cb6dfe0 newargc=15 2024-04-24T08:26:22.256 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[37335]: starting ceph client 2024-04-24T08:26:22.262 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[37335]: starting fuse 2024-04-24T08:26:22.264 INFO:teuthology.orchestra.run.smithi088.stdout:44 2024-04-24T08:26:22.264 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> sudo stdin-killer -- python3 -c ' 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> import re 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> import os 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2024-04-24T08:26:22.265 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> return f 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.0")) 2024-04-24T08:26:22.266 DEBUG:teuthology.orchestra.run.smithi088:> ' 2024-04-24T08:26:22.385 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.0.37335.asok 2024-04-24T08:26:22.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T08:26:22.467 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37335.asok 2024-04-24T08:26:22.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:22.467 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37335.asok status 2024-04-24T08:26:22.636 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:26:22.636 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2024-04-24T08:26:22.636 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "1f81fb397ae98da7563d451a78c61574c8f4e6e0", 2024-04-24T08:26:22.636 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 19.0.0-3116-g1f81fb39 (1f81fb397ae98da7563d451a78c61574c8f4e6e0) squid (dev)", 2024-04-24T08:26:22.636 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "0", 2024-04-24T08:26:22.636 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2024-04-24T08:26:22.636 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-24T08:26:22.636 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "37335", 2024-04-24T08:26:22.636 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 5178, 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5178 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2024-04-24T08:26:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 3025607599 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 3025607599 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.5178 192.168.0.1:0/3025607599", 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "192.168.0.1:0/3025607599", 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 16, 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 29, 2024-04-24T08:26:22.638 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2024-04-24T08:26:22.639 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2024-04-24T08:26:22.639 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2024-04-24T08:26:22.639 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:26:22.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:22.651 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2024-04-24T08:26:22.651 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-24T08:26:22.660 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2024-04-24T08:26:22.660 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-24T08:26:22.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:22.660 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T08:26:22.720 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-04-24T08:26:22.768 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.axSN5pT520 2024-04-24T08:26:22.769 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:26:22.769 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/tmp/tmp.axSN5pT520 2024-04-24T08:26:22.817 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p dir1/dir2/dir3') 2024-04-24T08:26:22.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T08:26:22.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T08:26:22.939 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'chmod 755 /tmp/test-cephfshf3rsft9') 2024-04-24T08:26:22.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T08:26:22.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T08:26:22.997 INFO:tasks.cephfs.test_cephfs_shell:Running script "/tmp/test-cephfshf3rsft9" 2024-04-24T08:26:22.997 DEBUG:teuthology.orchestra.run.smithi088:> cephfs-shell -b /tmp/test-cephfshf3rsft9 2024-04-24T08:26:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:Unrecognized command 2024-04-24T08:26:23.334 DEBUG:teuthology.orchestra.run:got remote process result: 127 2024-04-24T08:26:23.334 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T08:26:23.334 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T08:26:23.424 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T08:26:23.523 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T08:26:23.523 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T08:26:23.523 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:26:23.523 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T08:26:23.532 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:26:23.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c09800640 1 Processor -- start 2024-04-24T08:26:23.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c09800640 1 -- start start 2024-04-24T08:26:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c09800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c040b9d90 0x7f8c0406d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c09800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c04145f20 0x7f8c041504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c09800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c040ba170 con 0x7f8c0409be30 2024-04-24T08:26:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c09800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8c0409cd30 con 0x7f8c04145f20 2024-04-24T08:26:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c09800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8c0414a060 con 0x7f8c040b9d90 2024-04-24T08:26:23.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c03400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c04145f20 0x7f8c041504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:23.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c02a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c040b9d90 0x7f8c0406d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:23.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8bfa000640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8c0409be30 0x7f8c0406d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:46928/0 (socket says 172.21.15.88:46928) 2024-04-24T08:26:23.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8bfa000640 1 -- 172.21.15.88:0/837201826 learned_addr learned my addr 172.21.15.88:0/837201826 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:23.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c02a00640 1 -- 172.21.15.88:0/837201826 >> v2:172.21.15.142:3300/0 conn(0x7f8c04145f20 msgr2=0x7f8c041504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:23.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c02a00640 1 --2- 172.21.15.88:0/837201826 >> v2:172.21.15.142:3300/0 conn(0x7f8c04145f20 0x7f8c041504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:23.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c02a00640 1 -- 172.21.15.88:0/837201826 >> v1:172.21.15.142:6789/0 conn(0x7f8c0409be30 legacy=0x7f8c0406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:23.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c02a00640 1 -- 172.21.15.88:0/837201826 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c04149860 con 0x7f8c040b9d90 2024-04-24T08:26:23.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.704+0000 7f8c03400640 1 --2- 172.21.15.88:0/837201826 >> v2:172.21.15.142:3300/0 conn(0x7f8c04145f20 0x7f8c041504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:26:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.708+0000 7f8c02a00640 1 --2- 172.21.15.88:0/837201826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c040b9d90 0x7f8c0406d210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40097c0 tx=0x7f8bf401c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=254fad128e9b775 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.708+0000 7f8c02000640 1 -- 172.21.15.88:0/837201826 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40b0070 con 0x7f8c040b9d90 2024-04-24T08:26:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.708+0000 7f8c02000640 1 -- 172.21.15.88:0/837201826 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf40ab600 con 0x7f8c040b9d90 2024-04-24T08:26:23.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.708+0000 7f8c02000640 1 -- 172.21.15.88:0/837201826 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40ab9d0 con 0x7f8c040b9d90 2024-04-24T08:26:23.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.708+0000 7f8c09800640 1 -- 172.21.15.88:0/837201826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c040b9d90 msgr2=0x7f8c0406d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:23.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.708+0000 7f8c09800640 1 --2- 172.21.15.88:0/837201826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c040b9d90 0x7f8c0406d210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40097c0 tx=0x7f8bf401c380 comp rx=0 tx=0).stop 2024-04-24T08:26:23.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.708+0000 7f8c09800640 1 -- 172.21.15.88:0/837201826 shutdown_connections 2024-04-24T08:26:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.708+0000 7f8c09800640 1 --2- 172.21.15.88:0/837201826 >> v2:172.21.15.142:3300/0 conn(0x7f8c04145f20 0x7f8c041504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.708+0000 7f8c09800640 1 --2- 172.21.15.88:0/837201826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c040b9d90 0x7f8c0406d210 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.708+0000 7f8c09800640 1 -- 172.21.15.88:0/837201826 >> 172.21.15.88:0/837201826 conn(0x7f8c0406c0d0 msgr2=0x7f8c040b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.708+0000 7f8c09800640 1 -- 172.21.15.88:0/837201826 shutdown_connections 2024-04-24T08:26:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.708+0000 7f8c09800640 1 -- 172.21.15.88:0/837201826 wait complete. 2024-04-24T08:26:23.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c09800640 1 Processor -- start 2024-04-24T08:26:23.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c09800640 1 -- start start 2024-04-24T08:26:23.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c09800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c0409be30 0x7f8c040b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:23.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c09800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c040b9d90 0x7f8c04143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:23.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c09800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c04145f20 0x7f8c0414e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c09800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8c040b3fa0 con 0x7f8c040b9d90 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c09800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8c040b3e20 con 0x7f8c0409be30 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c09800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8c0406de60 con 0x7f8c04145f20 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8bfa000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c040b9d90 0x7f8c04143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8bfa000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c040b9d90 0x7f8c04143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33546/0 (socket says 172.21.15.88:33546) 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8bfa000640 1 -- 172.21.15.88:0/3600368540 learned_addr learned my addr 172.21.15.88:0/3600368540 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c02a00640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c0409be30 0x7f8c040b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c03400640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c04145f20 0x7f8c0414e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8bfa000640 1 -- 172.21.15.88:0/3600368540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c04145f20 msgr2=0x7f8c0414e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8bfa000640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c04145f20 0x7f8c0414e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8bfa000640 1 -- 172.21.15.88:0/3600368540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c0409be30 msgr2=0x7f8c040b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8bfa000640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c0409be30 0x7f8c040b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8bfa000640 1 -- 172.21.15.88:0/3600368540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0414ebf0 con 0x7f8c040b9d90 2024-04-24T08:26:23.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8bfa000640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c040b9d90 0x7f8c04143830 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00c450 tx=0x7f8bec00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:23.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8bfb400640 1 -- 172.21.15.88:0/3600368540 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec017070 con 0x7f8c040b9d90 2024-04-24T08:26:23.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8bfb400640 1 -- 172.21.15.88:0/3600368540 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bec005cf0 con 0x7f8c040b9d90 2024-04-24T08:26:23.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8bfb400640 1 -- 172.21.15.88:0/3600368540 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0072f0 con 0x7f8c040b9d90 2024-04-24T08:26:23.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c09800640 1 -- 172.21.15.88:0/3600368540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c04142dd0 con 0x7f8c040b9d90 2024-04-24T08:26:23.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c09800640 1 -- 172.21.15.88:0/3600368540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c040b7cc0 con 0x7f8c040b9d90 2024-04-24T08:26:23.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.712+0000 7f8c09800640 1 -- 172.21.15.88:0/3600368540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c04068b90 con 0x7f8c040b9d90 2024-04-24T08:26:23.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.716+0000 7f8bfb400640 1 -- 172.21.15.88:0/3600368540 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8bec01a070 con 0x7f8c040b9d90 2024-04-24T08:26:23.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.716+0000 7f8bfb400640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8be00683b0 0x7f8be006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:23.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.716+0000 7f8bfb400640 1 -- 172.21.15.88:0/3600368540 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f8bec085c20 con 0x7f8c040b9d90 2024-04-24T08:26:23.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.716+0000 7f8c02a00640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8be00683b0 0x7f8be006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:23.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.716+0000 7f8c02a00640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8be00683b0 0x7f8be006a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40ad000 tx=0x7f8bf40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:23.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.720+0000 7f8bfb400640 1 -- 172.21.15.88:0/3600368540 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8bec055b80 con 0x7f8c040b9d90 2024-04-24T08:26:23.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.880+0000 7f8c09800640 1 -- 172.21.15.88:0/3600368540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c04142af0 con 0x7f8c040b9d90 2024-04-24T08:26:23.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.880+0000 7f8bfb400640 1 -- 172.21.15.88:0/3600368540 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+16669 (secure 0 0 0) 0x7f8bec059e80 con 0x7f8c040b9d90 2024-04-24T08:26:23.884 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:23.884 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:26:11.996420+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:26:08.022146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T08:26:09.337841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:26:23.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.884+0000 7f8c09800640 1 -- 172.21.15.88:0/3600368540 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8be00683b0 msgr2=0x7f8be006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:23.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.884+0000 7f8c09800640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8be00683b0 0x7f8be006a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40ad000 tx=0x7f8bf40a6000 comp rx=0 tx=0).stop 2024-04-24T08:26:23.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.884+0000 7f8c09800640 1 -- 172.21.15.88:0/3600368540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c040b9d90 msgr2=0x7f8c04143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:23.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.884+0000 7f8c09800640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c040b9d90 0x7f8c04143830 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00c450 tx=0x7f8bec00c850 comp rx=0 tx=0).stop 2024-04-24T08:26:23.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.884+0000 7f8c09800640 1 -- 172.21.15.88:0/3600368540 shutdown_connections 2024-04-24T08:26:23.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.884+0000 7f8c09800640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8be00683b0 0x7f8be006a870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:23.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.884+0000 7f8c09800640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c04145f20 0x7f8c0414e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:23.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.884+0000 7f8c09800640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c040b9d90 0x7f8c04143830 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:23.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.884+0000 7f8c09800640 1 --2- 172.21.15.88:0/3600368540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c0409be30 0x7f8c040b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:23.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.884+0000 7f8c09800640 1 -- 172.21.15.88:0/3600368540 >> 172.21.15.88:0/3600368540 conn(0x7f8c0406c0d0 msgr2=0x7f8c04144ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:23.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.884+0000 7f8c09800640 1 -- 172.21.15.88:0/3600368540 shutdown_connections 2024-04-24T08:26:23.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:23.884+0000 7f8c09800640 1 -- 172.21.15.88:0/3600368540 wait complete. 2024-04-24T08:26:23.905 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T08:26:08.022146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T08:26:09.337841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:26:23.905 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:26:24.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.040+0000 7f5e69400640 1 Processor -- start 2024-04-24T08:26:24.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e69400640 1 -- start start 2024-04-24T08:26:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e69400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5e64146690 0x7f5e6409e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e69400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5e6406e490 0x7f5e6409e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e69400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e6406d4f0 con 0x7f5e640b4c90 2024-04-24T08:26:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e69400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f5e6406d2a0 con 0x7f5e6406e490 2024-04-24T08:26:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e69400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5e6406d7d0 con 0x7f5e64146690 2024-04-24T08:26:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e63200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5e6406e490 0x7f5e6409e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e63200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5e6406e490 0x7f5e6409e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33558/0 (socket says 172.21.15.88:33558) 2024-04-24T08:26:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e63200640 1 -- 172.21.15.88:0/2811870788 learned_addr learned my addr 172.21.15.88:0/2811870788 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:24.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e61e00640 1 --2- 172.21.15.88:0/2811870788 >> v2:172.21.15.142:3300/0 conn(0x7f5e64146690 0x7f5e6409e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e63200640 1 -- 172.21.15.88:0/2811870788 >> v2:172.21.15.142:3300/0 conn(0x7f5e64146690 msgr2=0x7f5e6409e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:24.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e63200640 1 --2- 172.21.15.88:0/2811870788 >> v2:172.21.15.142:3300/0 conn(0x7f5e64146690 0x7f5e6409e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e63200640 1 -- 172.21.15.88:0/2811870788 >> v1:172.21.15.142:6789/0 conn(0x7f5e640b4c90 legacy=0x7f5e64145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:24.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e63200640 1 -- 172.21.15.88:0/2811870788 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6409c570 con 0x7f5e6406e490 2024-04-24T08:26:24.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.044+0000 7f5e61e00640 1 --2- 172.21.15.88:0/2811870788 >> v2:172.21.15.142:3300/0 conn(0x7f5e64146690 0x7f5e6409e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:24.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e63200640 1 --2- 172.21.15.88:0/2811870788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e6406e490 0x7f5e6409e5d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5e6409be20 tx=0x7f5e5c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b75cea0d8cacd6b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:24.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e61400640 1 -- 172.21.15.88:0/2811870788 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c0a55e0 con 0x7f5e6406e490 2024-04-24T08:26:24.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e61400640 1 -- 172.21.15.88:0/2811870788 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e5c0a5780 con 0x7f5e6406e490 2024-04-24T08:26:24.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e61400640 1 -- 172.21.15.88:0/2811870788 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c0a5b50 con 0x7f5e6406e490 2024-04-24T08:26:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 -- 172.21.15.88:0/2811870788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e6406e490 msgr2=0x7f5e6409e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 --2- 172.21.15.88:0/2811870788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e6406e490 0x7f5e6409e5d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5e6409be20 tx=0x7f5e5c01c920 comp rx=0 tx=0).stop 2024-04-24T08:26:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 -- 172.21.15.88:0/2811870788 shutdown_connections 2024-04-24T08:26:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 --2- 172.21.15.88:0/2811870788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e6406e490 0x7f5e6409e5d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 --2- 172.21.15.88:0/2811870788 >> v2:172.21.15.142:3300/0 conn(0x7f5e64146690 0x7f5e6409e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 -- 172.21.15.88:0/2811870788 >> 172.21.15.88:0/2811870788 conn(0x7f5e640b9690 msgr2=0x7f5e640b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:24.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 -- 172.21.15.88:0/2811870788 shutdown_connections 2024-04-24T08:26:24.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 -- 172.21.15.88:0/2811870788 wait complete. 2024-04-24T08:26:24.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 Processor -- start 2024-04-24T08:26:24.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 -- start start 2024-04-24T08:26:24.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e6406e490 0x7f5e6413a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640b4c90 0x7f5e641e2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e64146690 0x7f5e64147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5e64152fc0 con 0x7f5e640b4c90 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5e64152e40 con 0x7f5e64146690 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.048+0000 7f5e69400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5e64153140 con 0x7f5e6406e490 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e61e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640b4c90 0x7f5e641e2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e61e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640b4c90 0x7f5e641e2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33560/0 (socket says 172.21.15.88:33560) 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e61e00640 1 -- 172.21.15.88:0/3158360046 learned_addr learned my addr 172.21.15.88:0/3158360046 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e62800640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e6406e490 0x7f5e6413a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e63200640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e64146690 0x7f5e64147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e61e00640 1 -- 172.21.15.88:0/3158360046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e6406e490 msgr2=0x7f5e6413a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e61e00640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e6406e490 0x7f5e6413a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e61e00640 1 -- 172.21.15.88:0/3158360046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e64146690 msgr2=0x7f5e64147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e61e00640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e64146690 0x7f5e64147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e61e00640 1 -- 172.21.15.88:0/3158360046 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e64147990 con 0x7f5e640b4c90 2024-04-24T08:26:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e62800640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e6406e490 0x7f5e6413a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e61e00640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640b4c90 0x7f5e641e2480 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000c820 tx=0x7f5e5000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e5aa00640 1 -- 172.21.15.88:0/3158360046 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50015070 con 0x7f5e640b4c90 2024-04-24T08:26:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e5aa00640 1 -- 172.21.15.88:0/3158360046 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e50007a30 con 0x7f5e640b4c90 2024-04-24T08:26:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e69400640 1 -- 172.21.15.88:0/3158360046 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e641e29c0 con 0x7f5e640b4c90 2024-04-24T08:26:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e5aa00640 1 -- 172.21.15.88:0/3158360046 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50007e40 con 0x7f5e640b4c90 2024-04-24T08:26:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e69400640 1 -- 172.21.15.88:0/3158360046 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e641e1f60 con 0x7f5e640b4c90 2024-04-24T08:26:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e69400640 1 -- 172.21.15.88:0/3158360046 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e64068c00 con 0x7f5e640b4c90 2024-04-24T08:26:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.052+0000 7f5e5aa00640 1 -- 172.21.15.88:0/3158360046 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5e50018070 con 0x7f5e640b4c90 2024-04-24T08:26:24.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.056+0000 7f5e5aa00640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5e44068380 0x7f5e4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.056+0000 7f5e5aa00640 1 -- 172.21.15.88:0/3158360046 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f5e500868b0 con 0x7f5e640b4c90 2024-04-24T08:26:24.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.056+0000 7f5e62800640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5e44068380 0x7f5e4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.056+0000 7f5e62800640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5e44068380 0x7f5e4406a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5e6413eef0 tx=0x7f5e54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:24.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.060+0000 7f5e5aa00640 1 -- 172.21.15.88:0/3158360046 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5e50056e60 con 0x7f5e640b4c90 2024-04-24T08:26:24.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 -- 172.21.15.88:0/3158360046 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5e641e2130 con 0x7f5e640b4c90 2024-04-24T08:26:24.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e5aa00640 1 -- 172.21.15.88:0/3158360046 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f5e50056760 con 0x7f5e640b4c90 2024-04-24T08:26:24.218 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:26:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 -- 172.21.15.88:0/3158360046 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5e44068380 msgr2=0x7f5e4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5e44068380 0x7f5e4406a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5e6413eef0 tx=0x7f5e54009040 comp rx=0 tx=0).stop 2024-04-24T08:26:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 -- 172.21.15.88:0/3158360046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640b4c90 msgr2=0x7f5e641e2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640b4c90 0x7f5e641e2480 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000c820 tx=0x7f5e5000cce0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 -- 172.21.15.88:0/3158360046 shutdown_connections 2024-04-24T08:26:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f5e44068380 0x7f5e4406a840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e64146690 0x7f5e64147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e640b4c90 0x7f5e641e2480 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 --2- 172.21.15.88:0/3158360046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e6406e490 0x7f5e6413a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 -- 172.21.15.88:0/3158360046 >> 172.21.15.88:0/3158360046 conn(0x7f5e640b9690 msgr2=0x7f5e641450e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 -- 172.21.15.88:0/3158360046 shutdown_connections 2024-04-24T08:26:24.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.216+0000 7f5e69400640 1 -- 172.21.15.88:0/3158360046 wait complete. 2024-04-24T08:26:24.239 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T08:26:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.372+0000 7f09f1c00640 1 Processor -- start 2024-04-24T08:26:24.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09f1c00640 1 -- start start 2024-04-24T08:26:24.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09f1c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09ec146690 0x7f09ec09e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09f1c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09ec06e490 0x7f09ec09e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09f1c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09ec06d4f0 con 0x7f09ec0b4c90 2024-04-24T08:26:24.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09f1c00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f09ec06d2a0 con 0x7f09ec06e490 2024-04-24T08:26:24.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09f1c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f09ec06d7d0 con 0x7f09ec146690 2024-04-24T08:26:24.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09eb400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09ec06e490 0x7f09ec09e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09eb400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09ec06e490 0x7f09ec09e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33574/0 (socket says 172.21.15.88:33574) 2024-04-24T08:26:24.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09eb400640 1 -- 172.21.15.88:0/4088570550 learned_addr learned my addr 172.21.15.88:0/4088570550 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:24.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09ea000640 1 --2- 172.21.15.88:0/4088570550 >> v2:172.21.15.142:3300/0 conn(0x7f09ec146690 0x7f09ec09e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09eb400640 1 -- 172.21.15.88:0/4088570550 >> v2:172.21.15.142:3300/0 conn(0x7f09ec146690 msgr2=0x7f09ec09e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:24.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09eb400640 1 --2- 172.21.15.88:0/4088570550 >> v2:172.21.15.142:3300/0 conn(0x7f09ec146690 0x7f09ec09e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09eb400640 1 -- 172.21.15.88:0/4088570550 >> v1:172.21.15.142:6789/0 conn(0x7f09ec0b4c90 legacy=0x7f09ec145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:24.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09eb400640 1 -- 172.21.15.88:0/4088570550 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec09c570 con 0x7f09ec06e490 2024-04-24T08:26:24.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.376+0000 7f09ea000640 1 --2- 172.21.15.88:0/4088570550 >> v2:172.21.15.142:3300/0 conn(0x7f09ec146690 0x7f09ec09e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:24.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09eb400640 1 --2- 172.21.15.88:0/4088570550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09ec06e490 0x7f09ec09e5d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f09ec09be20 tx=0x7f09e401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea673d56965137d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:24.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09e9600640 1 -- 172.21.15.88:0/4088570550 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40a55e0 con 0x7f09ec06e490 2024-04-24T08:26:24.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09e9600640 1 -- 172.21.15.88:0/4088570550 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e40a5780 con 0x7f09ec06e490 2024-04-24T08:26:24.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09e9600640 1 -- 172.21.15.88:0/4088570550 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40a5b50 con 0x7f09ec06e490 2024-04-24T08:26:24.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 -- 172.21.15.88:0/4088570550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09ec06e490 msgr2=0x7f09ec09e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 --2- 172.21.15.88:0/4088570550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09ec06e490 0x7f09ec09e5d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f09ec09be20 tx=0x7f09e401c920 comp rx=0 tx=0).stop 2024-04-24T08:26:24.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 -- 172.21.15.88:0/4088570550 shutdown_connections 2024-04-24T08:26:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 --2- 172.21.15.88:0/4088570550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09ec06e490 0x7f09ec09e5d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 --2- 172.21.15.88:0/4088570550 >> v2:172.21.15.142:3300/0 conn(0x7f09ec146690 0x7f09ec09e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 -- 172.21.15.88:0/4088570550 >> 172.21.15.88:0/4088570550 conn(0x7f09ec0b9690 msgr2=0x7f09ec0b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 -- 172.21.15.88:0/4088570550 shutdown_connections 2024-04-24T08:26:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 -- 172.21.15.88:0/4088570550 wait complete. 2024-04-24T08:26:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 Processor -- start 2024-04-24T08:26:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 -- start start 2024-04-24T08:26:24.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09ec06e490 0x7f09ec146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09ec0b4c90 0x7f09ec147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09ec146690 0x7f09ec13d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec152fc0 con 0x7f09ec06e490 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec152e40 con 0x7f09ec146690 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.380+0000 7f09f1c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f09ec153140 con 0x7f09ec0b4c90 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09eaa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09ec06e490 0x7f09ec146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09eaa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09ec06e490 0x7f09ec146ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33584/0 (socket says 172.21.15.88:33584) 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09eaa00640 1 -- 172.21.15.88:0/3136693979 learned_addr learned my addr 172.21.15.88:0/3136693979 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09eb400640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09ec146690 0x7f09ec13d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09ea000640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09ec0b4c90 0x7f09ec147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09eaa00640 1 -- 172.21.15.88:0/3136693979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09ec0b4c90 msgr2=0x7f09ec147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09eaa00640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09ec0b4c90 0x7f09ec147a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09eaa00640 1 -- 172.21.15.88:0/3136693979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09ec146690 msgr2=0x7f09ec13d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09eaa00640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09ec146690 0x7f09ec13d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09eaa00640 1 -- 172.21.15.88:0/3136693979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec0aeee0 con 0x7f09ec06e490 2024-04-24T08:26:24.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09ea000640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09ec0b4c90 0x7f09ec147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:24.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09eaa00640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09ec06e490 0x7f09ec146ef0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f09d400c4c0 tx=0x7f09d4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:24.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09e2a00640 1 -- 172.21.15.88:0/3136693979 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4017070 con 0x7f09ec06e490 2024-04-24T08:26:24.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09e2a00640 1 -- 172.21.15.88:0/3136693979 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d4003600 con 0x7f09ec06e490 2024-04-24T08:26:24.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09f1c00640 1 -- 172.21.15.88:0/3136693979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ec0afe30 con 0x7f09ec06e490 2024-04-24T08:26:24.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09e2a00640 1 -- 172.21.15.88:0/3136693979 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d40039f0 con 0x7f09ec06e490 2024-04-24T08:26:24.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09f1c00640 1 -- 172.21.15.88:0/3136693979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ec148570 con 0x7f09ec06e490 2024-04-24T08:26:24.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09f1c00640 1 -- 172.21.15.88:0/3136693979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09ec148020 con 0x7f09ec06e490 2024-04-24T08:26:24.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.384+0000 7f09e2a00640 1 -- 172.21.15.88:0/3136693979 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f09d401a070 con 0x7f09ec06e490 2024-04-24T08:26:24.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.388+0000 7f09e2a00640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f09c8068380 0x7f09c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.388+0000 7f09e2a00640 1 -- 172.21.15.88:0/3136693979 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f09d4085d90 con 0x7f09ec06e490 2024-04-24T08:26:24.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.388+0000 7f09ea000640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f09c8068380 0x7f09c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.388+0000 7f09ea000640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f09c8068380 0x7f09c806a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0af970 tx=0x7f09dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:24.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.392+0000 7f09e2a00640 1 -- 172.21.15.88:0/3136693979 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f09d4056340 con 0x7f09ec06e490 2024-04-24T08:26:24.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 -- 172.21.15.88:0/3136693979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f09ec068c00 con 0x7f09ec06e490 2024-04-24T08:26:24.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09e2a00640 1 -- 172.21.15.88:0/3136693979 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f09d4055c40 con 0x7f09ec06e490 2024-04-24T08:26:24.551 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-24T08:26:24.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 -- 172.21.15.88:0/3136693979 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f09c8068380 msgr2=0x7f09c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f09c8068380 0x7f09c806a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0af970 tx=0x7f09dc008040 comp rx=0 tx=0).stop 2024-04-24T08:26:24.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 -- 172.21.15.88:0/3136693979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09ec06e490 msgr2=0x7f09ec146ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09ec06e490 0x7f09ec146ef0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f09d400c4c0 tx=0x7f09d4001e80 comp rx=0 tx=0).stop 2024-04-24T08:26:24.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 -- 172.21.15.88:0/3136693979 shutdown_connections 2024-04-24T08:26:24.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f09c8068380 0x7f09c806a840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09ec146690 0x7f09ec13d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09ec0b4c90 0x7f09ec147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 --2- 172.21.15.88:0/3136693979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09ec06e490 0x7f09ec146ef0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 -- 172.21.15.88:0/3136693979 >> 172.21.15.88:0/3136693979 conn(0x7f09ec0b9690 msgr2=0x7f09ec143f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:24.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 -- 172.21.15.88:0/3136693979 shutdown_connections 2024-04-24T08:26:24.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.548+0000 7f09f1c00640 1 -- 172.21.15.88:0/3136693979 wait complete. 2024-04-24T08:26:24.572 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T08:26:24.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.704+0000 7ff92f400640 1 Processor -- start 2024-04-24T08:26:24.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.704+0000 7ff92f400640 1 -- start start 2024-04-24T08:26:24.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff92f400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280b01a0 0x7ff92806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff92f400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff9280ae4e0 0x7ff92813e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff92f400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9280b0580 con 0x7ff9280737c0 2024-04-24T08:26:24.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff92f400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff9280b59d0 con 0x7ff9280ae4e0 2024-04-24T08:26:24.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff92f400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff9280ae970 con 0x7ff9280b01a0 2024-04-24T08:26:24.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff92ca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280b01a0 0x7ff92806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff91fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff9280ae4e0 0x7ff92813e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff92ca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280b01a0 0x7ff92806d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:43624/0 (socket says 172.21.15.88:43624) 2024-04-24T08:26:24.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff92ca00640 1 -- 172.21.15.88:0/3317111371 learned_addr learned my addr 172.21.15.88:0/3317111371 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:24.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff92ca00640 1 -- 172.21.15.88:0/3317111371 >> v2:172.21.15.142:3300/0 conn(0x7ff9280ae4e0 msgr2=0x7ff92813e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:24.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff92ca00640 1 --2- 172.21.15.88:0/3317111371 >> v2:172.21.15.142:3300/0 conn(0x7ff9280ae4e0 0x7ff92813e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff92ca00640 1 -- 172.21.15.88:0/3317111371 >> v1:172.21.15.142:6789/0 conn(0x7ff9280737c0 legacy=0x7ff928148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff92ca00640 1 -- 172.21.15.88:0/3317111371 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9280b53a0 con 0x7ff9280b01a0 2024-04-24T08:26:24.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.708+0000 7ff91fe00640 1 --2- 172.21.15.88:0/3317111371 >> v2:172.21.15.142:3300/0 conn(0x7ff9280ae4e0 0x7ff92813e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:26:24.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff92ca00640 1 --2- 172.21.15.88:0/3317111371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280b01a0 0x7ff92806d2a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff918009870 tx=0x7ff91801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73e0bbf1ff24e90f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:24.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff927e00640 1 -- 172.21.15.88:0/3317111371 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9180b0070 con 0x7ff9280b01a0 2024-04-24T08:26:24.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff927e00640 1 -- 172.21.15.88:0/3317111371 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9180ab600 con 0x7ff9280b01a0 2024-04-24T08:26:24.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff927e00640 1 -- 172.21.15.88:0/3317111371 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9180ab9d0 con 0x7ff9280b01a0 2024-04-24T08:26:24.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff92f400640 1 -- 172.21.15.88:0/3317111371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280b01a0 msgr2=0x7ff92806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff92f400640 1 --2- 172.21.15.88:0/3317111371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280b01a0 0x7ff92806d2a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff918009870 tx=0x7ff91801c440 comp rx=0 tx=0).stop 2024-04-24T08:26:24.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff92f400640 1 -- 172.21.15.88:0/3317111371 shutdown_connections 2024-04-24T08:26:24.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff92f400640 1 --2- 172.21.15.88:0/3317111371 >> v2:172.21.15.142:3300/0 conn(0x7ff9280ae4e0 0x7ff92813e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff92f400640 1 --2- 172.21.15.88:0/3317111371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280b01a0 0x7ff92806d2a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff92f400640 1 -- 172.21.15.88:0/3317111371 >> 172.21.15.88:0/3317111371 conn(0x7ff9280b9690 msgr2=0x7ff9280b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:24.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff92f400640 1 -- 172.21.15.88:0/3317111371 shutdown_connections 2024-04-24T08:26:24.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff92f400640 1 -- 172.21.15.88:0/3317111371 wait complete. 2024-04-24T08:26:24.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff92f400640 1 Processor -- start 2024-04-24T08:26:24.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.712+0000 7ff92f400640 1 -- start start 2024-04-24T08:26:24.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff92f400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280737c0 0x7ff9281e0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff92f400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9280b01a0 0x7ff9280b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff92f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9280b27e0 0x7ff9280b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff92f400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff92806e3e0 con 0x7ff9280b01a0 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff92f400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff92806e260 con 0x7ff9280b27e0 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff92f400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff928152450 con 0x7ff9280737c0 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff91fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9280b01a0 0x7ff9280b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff91fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9280b01a0 0x7ff9280b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33596/0 (socket says 172.21.15.88:33596) 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff91fe00640 1 -- 172.21.15.88:0/469959864 learned_addr learned my addr 172.21.15.88:0/469959864 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff92ca00640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280737c0 0x7ff9281e0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff92d400640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9280b27e0 0x7ff9280b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff91fe00640 1 -- 172.21.15.88:0/469959864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280737c0 msgr2=0x7ff9281e0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff91fe00640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280737c0 0x7ff9281e0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff91fe00640 1 -- 172.21.15.88:0/469959864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9280b27e0 msgr2=0x7ff9280b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff91fe00640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9280b27e0 0x7ff9280b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff91fe00640 1 -- 172.21.15.88:0/469959864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff928142d50 con 0x7ff9280b01a0 2024-04-24T08:26:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff91fe00640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9280b01a0 0x7ff9280b22a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff91000ebe0 tx=0x7ff91000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff925600640 1 -- 172.21.15.88:0/469959864 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910017070 con 0x7ff9280b01a0 2024-04-24T08:26:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff925600640 1 -- 172.21.15.88:0/469959864 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91000cc30 con 0x7ff9280b01a0 2024-04-24T08:26:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff925600640 1 -- 172.21.15.88:0/469959864 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910013470 con 0x7ff9280b01a0 2024-04-24T08:26:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff92f400640 1 -- 172.21.15.88:0/469959864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9281e04e0 con 0x7ff9280b01a0 2024-04-24T08:26:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff92f400640 1 -- 172.21.15.88:0/469959864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff92809de60 con 0x7ff9280b01a0 2024-04-24T08:26:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.716+0000 7ff92f400640 1 -- 172.21.15.88:0/469959864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff928068c00 con 0x7ff9280b01a0 2024-04-24T08:26:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.720+0000 7ff925600640 1 -- 172.21.15.88:0/469959864 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff91001a070 con 0x7ff9280b01a0 2024-04-24T08:26:24.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.720+0000 7ff925600640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff9040683b0 0x7ff90406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:24.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.720+0000 7ff925600640 1 -- 172.21.15.88:0/469959864 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7ff9100868a0 con 0x7ff9280b01a0 2024-04-24T08:26:24.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.720+0000 7ff92ca00640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff9040683b0 0x7ff90406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:24.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.720+0000 7ff92ca00640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff9040683b0 0x7ff90406a870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff9180ad000 tx=0x7ff9180a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:24.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.724+0000 7ff925600640 1 -- 172.21.15.88:0/469959864 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff9281e04e0 con 0x7ff9280b01a0 2024-04-24T08:26:24.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.880+0000 7ff92f400640 1 -- 172.21.15.88:0/469959864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff92813e100 con 0x7ff9280b01a0 2024-04-24T08:26:24.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.880+0000 7ff925600640 1 -- 172.21.15.88:0/469959864 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7ff910056800 con 0x7ff9280b01a0 2024-04-24T08:26:24.884 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-24T08:26:24.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.880+0000 7ff92f400640 1 -- 172.21.15.88:0/469959864 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff9040683b0 msgr2=0x7ff90406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.880+0000 7ff92f400640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff9040683b0 0x7ff90406a870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff9180ad000 tx=0x7ff9180a6000 comp rx=0 tx=0).stop 2024-04-24T08:26:24.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.880+0000 7ff92f400640 1 -- 172.21.15.88:0/469959864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9280b01a0 msgr2=0x7ff9280b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:24.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.880+0000 7ff92f400640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9280b01a0 0x7ff9280b22a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff91000ebe0 tx=0x7ff91000c520 comp rx=0 tx=0).stop 2024-04-24T08:26:24.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.884+0000 7ff92f400640 1 -- 172.21.15.88:0/469959864 shutdown_connections 2024-04-24T08:26:24.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.884+0000 7ff92f400640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff9040683b0 0x7ff90406a870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.884+0000 7ff92f400640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9280b27e0 0x7ff9280b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.884+0000 7ff92f400640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9280b01a0 0x7ff9280b22a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.884+0000 7ff92f400640 1 --2- 172.21.15.88:0/469959864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280737c0 0x7ff9281e0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:24.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.884+0000 7ff92f400640 1 -- 172.21.15.88:0/469959864 >> 172.21.15.88:0/469959864 conn(0x7ff9280b9690 msgr2=0x7ff92809aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:24.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.884+0000 7ff92f400640 1 -- 172.21.15.88:0/469959864 shutdown_connections 2024-04-24T08:26:24.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:24.884+0000 7ff92f400640 1 -- 172.21.15.88:0/469959864 wait complete. 2024-04-24T08:26:24.905 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T08:26:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f048b000640 1 Processor -- start 2024-04-24T08:26:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f048b000640 1 -- start start 2024-04-24T08:26:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f048b000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0484142060 0x7f0484153440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f048b000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04840b2570 con 0x7f04840b6a90 2024-04-24T08:26:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f048b000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04840b6670 con 0x7f04840b6290 2024-04-24T08:26:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f048b000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f04840b7b40 con 0x7f0484142060 2024-04-24T08:26:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0489200640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f04840b6a90 0x7f0484141950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51084/0 (socket says 172.21.15.88:51084) 2024-04-24T08:26:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0489200640 1 -- 172.21.15.88:0/362279192 learned_addr learned my addr 172.21.15.88:0/362279192 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f048a600640 1 --2- 172.21.15.88:0/362279192 >> v2:172.21.15.142:3300/0 conn(0x7f0484142060 0x7f0484153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473362181 0 0) 0x7f04840b2570 con 0x7f04840b6a90 2024-04-24T08:26:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f046c003530 con 0x7f04840b6a90 2024-04-24T08:26:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 596125631 0 0) 0x7f04840b6670 con 0x7f04840b6290 2024-04-24T08:26:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04840b2570 con 0x7f04840b6290 2024-04-24T08:26:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3079785595 0 0) 0x7f046c003530 con 0x7f04840b6a90 2024-04-24T08:26:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 >> v2:172.21.15.142:3300/0 conn(0x7f0484142060 msgr2=0x7f0484153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 --2- 172.21.15.88:0/362279192 >> v2:172.21.15.142:3300/0 conn(0x7f0484142060 0x7f0484153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 >> v1:172.21.15.142:6789/0 conn(0x7f04840b6290 legacy=0x7f048406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04840b1d70 con 0x7f04840b6a90 2024-04-24T08:26:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f0470001680 con 0x7f04840b6a90 2024-04-24T08:26:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 >> v1:172.21.15.88:6789/0 conn(0x7f04840b6a90 legacy=0x7f0484141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 --2- 172.21.15.88:0/362279192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f046c003b50 0x7f046c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 --2- 172.21.15.88:0/362279192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c004810 0x7f046c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 --2- 172.21.15.88:0/362279192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f046c0051d0 0x7f046c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f04840b7b40 con 0x7f046c004810 2024-04-24T08:26:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f046c00c100 con 0x7f046c0051d0 2024-04-24T08:26:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f046c00c300 con 0x7f046c003b50 2024-04-24T08:26:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0489200640 1 --2- 172.21.15.88:0/362279192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c004810 0x7f046c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f048a600640 1 --2- 172.21.15.88:0/362279192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f046c0051d0 0x7f046c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0489c00640 1 --2- 172.21.15.88:0/362279192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f046c003b50 0x7f046c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0489200640 1 -- 172.21.15.88:0/362279192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f046c003b50 msgr2=0x7f046c003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:25.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0489200640 1 --2- 172.21.15.88:0/362279192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f046c003b50 0x7f046c003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0489200640 1 -- 172.21.15.88:0/362279192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f046c0051d0 msgr2=0x7f046c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:25.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0489200640 1 --2- 172.21.15.88:0/362279192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f046c0051d0 0x7f046c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f0489200640 1 -- 172.21.15.88:0/362279192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c003530 con 0x7f046c004810 2024-04-24T08:26:25.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.040+0000 7f048a600640 1 -- 172.21.15.88:0/362279192 reap_dead start 2024-04-24T08:26:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.044+0000 7f0489200640 1 --2- 172.21.15.88:0/362279192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c004810 0x7f046c004c90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f047000c190 tx=0x7f047001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dc79ba9005f56f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.044+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0470007cd0 con 0x7f046c004810 2024-04-24T08:26:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.044+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04700a9020 con 0x7f046c004810 2024-04-24T08:26:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.044+0000 7f0483e00640 1 -- 172.21.15.88:0/362279192 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0470005ae0 con 0x7f046c004810 2024-04-24T08:26:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.044+0000 7f048b000640 1 -- 172.21.15.88:0/362279192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c004810 msgr2=0x7f046c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.044+0000 7f048b000640 1 --2- 172.21.15.88:0/362279192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c004810 0x7f046c004c90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f047000c190 tx=0x7f047001cbc0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.044+0000 7f048b000640 1 -- 172.21.15.88:0/362279192 shutdown_connections 2024-04-24T08:26:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.044+0000 7f048b000640 1 --2- 172.21.15.88:0/362279192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046c004810 0x7f046c004c90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.044+0000 7f048b000640 1 -- 172.21.15.88:0/362279192 >> 172.21.15.88:0/362279192 conn(0x7f04840bb380 msgr2=0x7f04840bb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.044+0000 7f048b000640 1 -- 172.21.15.88:0/362279192 shutdown_connections 2024-04-24T08:26:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.044+0000 7f048b000640 1 -- 172.21.15.88:0/362279192 wait complete. 2024-04-24T08:26:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048b000640 1 Processor -- start 2024-04-24T08:26:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048b000640 1 -- start start 2024-04-24T08:26:25.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f046c004810 0x7f04841e0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048b000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0484144e90 0x7f04840b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048b000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04840b16c0 0x7f0484143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048b000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f048406cd60 con 0x7f04840b16c0 2024-04-24T08:26:25.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048b000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f048406cbe0 con 0x7f0484144e90 2024-04-24T08:26:25.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0484147ad0 con 0x7f046c004810 2024-04-24T08:26:25.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048a600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04840b16c0 0x7f0484143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048a600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04840b16c0 0x7f0484143b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33622/0 (socket says 172.21.15.88:33622) 2024-04-24T08:26:25.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048a600640 1 -- 172.21.15.88:0/1707825899 learned_addr learned my addr 172.21.15.88:0/1707825899 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:25.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f0489200640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0484144e90 0x7f04840b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f0489c00640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f046c004810 0x7f04841e0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048a600640 1 -- 172.21.15.88:0/1707825899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f046c004810 msgr2=0x7f04841e0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048a600640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f046c004810 0x7f04841e0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048a600640 1 -- 172.21.15.88:0/1707825899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0484144e90 msgr2=0x7f04840b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048a600640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0484144e90 0x7f04840b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048a600640 1 -- 172.21.15.88:0/1707825899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0484145350 con 0x7f04840b16c0 2024-04-24T08:26:25.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f0489c00640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f046c004810 0x7f04841e0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:25.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048a600640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04840b16c0 0x7f0484143b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0484075a90 tx=0x7f047c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:25.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f0481600640 1 -- 172.21.15.88:0/1707825899 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c00fce0 con 0x7f04840b16c0 2024-04-24T08:26:25.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f0481600640 1 -- 172.21.15.88:0/1707825899 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047c00fe80 con 0x7f04840b16c0 2024-04-24T08:26:25.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f0481600640 1 -- 172.21.15.88:0/1707825899 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c015670 con 0x7f04840b16c0 2024-04-24T08:26:25.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048b000640 1 -- 172.21.15.88:0/1707825899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04841e0680 con 0x7f04840b16c0 2024-04-24T08:26:25.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.048+0000 7f048b000640 1 -- 172.21.15.88:0/1707825899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04841e13c0 con 0x7f04840b16c0 2024-04-24T08:26:25.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.052+0000 7f048b000640 1 -- 172.21.15.88:0/1707825899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f048404fe10 con 0x7f04840b16c0 2024-04-24T08:26:25.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.052+0000 7f0481600640 1 -- 172.21.15.88:0/1707825899 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f047c015810 con 0x7f04840b16c0 2024-04-24T08:26:25.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.052+0000 7f0481600640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0464068380 0x7f046406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.052+0000 7f0481600640 1 -- 172.21.15.88:0/1707825899 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f047c0877b0 con 0x7f04840b16c0 2024-04-24T08:26:25.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.052+0000 7f0489c00640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0464068380 0x7f046406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.052+0000 7f0489c00640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0464068380 0x7f046406a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0478007af0 tx=0x7f0478009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:25.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.056+0000 7f0481600640 1 -- 172.21.15.88:0/1707825899 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f047c019030 con 0x7f04840b16c0 2024-04-24T08:26:25.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 -- 172.21.15.88:0/1707825899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f04840b6670 con 0x7f04840b16c0 2024-04-24T08:26:25.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f0481600640 1 -- 172.21.15.88:0/1707825899 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f047c010040 con 0x7f04840b16c0 2024-04-24T08:26:25.226 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2024-04-24T08:26:25.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 -- 172.21.15.88:0/1707825899 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0464068380 msgr2=0x7f046406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0464068380 0x7f046406a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0478007af0 tx=0x7f0478009040 comp rx=0 tx=0).stop 2024-04-24T08:26:25.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 -- 172.21.15.88:0/1707825899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04840b16c0 msgr2=0x7f0484143b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04840b16c0 0x7f0484143b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0484075a90 tx=0x7f047c00f1b0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 -- 172.21.15.88:0/1707825899 shutdown_connections 2024-04-24T08:26:25.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0464068380 0x7f046406a840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04840b16c0 0x7f0484143b90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0484144e90 0x7f04840b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 --2- 172.21.15.88:0/1707825899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f046c004810 0x7f04841e0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 -- 172.21.15.88:0/1707825899 >> 172.21.15.88:0/1707825899 conn(0x7f04840bb380 msgr2=0x7f0484072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:25.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 -- 172.21.15.88:0/1707825899 shutdown_connections 2024-04-24T08:26:25.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.224+0000 7f048b000640 1 -- 172.21.15.88:0/1707825899 wait complete. 2024-04-24T08:26:25.247 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2024-04-24T08:26:25.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:25.247 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-24T08:26:25.266 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[37335]: fuse finished with error 0 and tester_r 0 2024-04-24T08:26:25.268 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:26:25.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:25.269 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T08:26:25.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:26:25.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc121400640 1 Processor -- start 2024-04-24T08:26:25.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc121400640 1 -- start start 2024-04-24T08:26:25.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc121400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc11c0b9d90 0x7fc11c06d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc121400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 0x7fc11c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc121400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc11c0ba170 con 0x7fc11c09be30 2024-04-24T08:26:25.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc121400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc11c09cd30 con 0x7fc11c0b9d90 2024-04-24T08:26:25.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc121400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc11c14a060 con 0x7fc11c145f20 2024-04-24T08:26:25.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc11b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 0x7fc11c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc11a800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc11c0b9d90 0x7fc11c06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc11b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 0x7fc11c1504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.88:43662/0 (socket says 172.21.15.88:43662) 2024-04-24T08:26:25.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc11b200640 1 -- 172.21.15.88:0/1681562510 learned_addr learned my addr 172.21.15.88:0/1681562510 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:25.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc11b200640 1 -- 172.21.15.88:0/1681562510 >> v2:172.21.15.142:3300/0 conn(0x7fc11c0b9d90 msgr2=0x7fc11c06d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:25.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc11b200640 1 --2- 172.21.15.88:0/1681562510 >> v2:172.21.15.142:3300/0 conn(0x7fc11c0b9d90 0x7fc11c06d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc11b200640 1 -- 172.21.15.88:0/1681562510 >> v1:172.21.15.142:6789/0 conn(0x7fc11c09be30 legacy=0x7fc11c06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc11b200640 1 -- 172.21.15.88:0/1681562510 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11c149860 con 0x7fc11c145f20 2024-04-24T08:26:25.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc119400640 1 -- 172.21.15.88:0/1681562510 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1721866673 0 0) 0x7fc11c0ba170 con 0x7fc11c09be30 2024-04-24T08:26:25.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.608+0000 7fc11a800640 1 --2- 172.21.15.88:0/1681562510 >> v2:172.21.15.142:3300/0 conn(0x7fc11c0b9d90 0x7fc11c06d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:26:25.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.612+0000 7fc11b200640 1 --2- 172.21.15.88:0/1681562510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 0x7fc11c1504e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc114009e50 tx=0x7fc11401c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff46b2c2f7ed0bc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:25.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.612+0000 7fc119400640 1 -- 172.21.15.88:0/1681562510 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1140a56a0 con 0x7fc11c145f20 2024-04-24T08:26:25.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.612+0000 7fc119400640 1 -- 172.21.15.88:0/1681562510 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1140a5840 con 0x7fc11c145f20 2024-04-24T08:26:25.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.612+0000 7fc119400640 1 -- 172.21.15.88:0/1681562510 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1140a5c10 con 0x7fc11c145f20 2024-04-24T08:26:25.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.612+0000 7fc121400640 1 -- 172.21.15.88:0/1681562510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 msgr2=0x7fc11c1504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.612+0000 7fc121400640 1 --2- 172.21.15.88:0/1681562510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 0x7fc11c1504e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc114009e50 tx=0x7fc11401c910 comp rx=0 tx=0).stop 2024-04-24T08:26:25.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.612+0000 7fc121400640 1 -- 172.21.15.88:0/1681562510 shutdown_connections 2024-04-24T08:26:25.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.612+0000 7fc121400640 1 --2- 172.21.15.88:0/1681562510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 0x7fc11c1504e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.612+0000 7fc121400640 1 --2- 172.21.15.88:0/1681562510 >> v2:172.21.15.142:3300/0 conn(0x7fc11c0b9d90 0x7fc11c06d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.612+0000 7fc121400640 1 -- 172.21.15.88:0/1681562510 >> 172.21.15.88:0/1681562510 conn(0x7fc11c06c0d0 msgr2=0x7fc11c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:25.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.612+0000 7fc121400640 1 -- 172.21.15.88:0/1681562510 shutdown_connections 2024-04-24T08:26:25.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.612+0000 7fc121400640 1 -- 172.21.15.88:0/1681562510 wait complete. 2024-04-24T08:26:25.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc121400640 1 Processor -- start 2024-04-24T08:26:25.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc121400640 1 -- start start 2024-04-24T08:26:25.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc121400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc11c09be30 0x7fc11c13d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc121400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11c0b9d90 0x7fc11c14f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc121400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 0x7fc11c147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc121400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc11c0b3fa0 con 0x7fc11c09be30 2024-04-24T08:26:25.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc121400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc11c0b3e20 con 0x7fc11c0b9d90 2024-04-24T08:26:25.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc121400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc11c06de60 con 0x7fc11c145f20 2024-04-24T08:26:25.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc11a800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc11c09be30 0x7fc11c13d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc11a800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc11c09be30 0x7fc11c13d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33628/0 (socket says 172.21.15.88:33628) 2024-04-24T08:26:25.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc11a800640 1 -- 172.21.15.88:0/3443673771 learned_addr learned my addr 172.21.15.88:0/3443673771 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:25.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc11b200640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 0x7fc11c147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc119e00640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11c0b9d90 0x7fc11c14f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc11a800640 1 -- 172.21.15.88:0/3443673771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 msgr2=0x7fc11c147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc11a800640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 0x7fc11c147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc11a800640 1 -- 172.21.15.88:0/3443673771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11c0b9d90 msgr2=0x7fc11c14f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc11a800640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11c0b9d90 0x7fc11c14f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc11a800640 1 -- 172.21.15.88:0/3443673771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11c1483e0 con 0x7fc11c09be30 2024-04-24T08:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc11b200640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 0x7fc11c147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc119e00640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11c0b9d90 0x7fc11c14f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc11a800640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc11c09be30 0x7fc11c13d750 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00ebe0 tx=0x7fc10c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc112a00640 1 -- 172.21.15.88:0/3443673771 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c017070 con 0x7fc11c09be30 2024-04-24T08:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc112a00640 1 -- 172.21.15.88:0/3443673771 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10c00cc30 con 0x7fc11c09be30 2024-04-24T08:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc112a00640 1 -- 172.21.15.88:0/3443673771 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c013470 con 0x7fc11c09be30 2024-04-24T08:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc121400640 1 -- 172.21.15.88:0/3443673771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc11c147770 con 0x7fc11c09be30 2024-04-24T08:26:25.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.616+0000 7fc121400640 1 -- 172.21.15.88:0/3443673771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc11c0b92a0 con 0x7fc11c09be30 2024-04-24T08:26:25.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.620+0000 7fc121400640 1 -- 172.21.15.88:0/3443673771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc11c147560 con 0x7fc11c09be30 2024-04-24T08:26:25.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.620+0000 7fc112a00640 1 -- 172.21.15.88:0/3443673771 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc10c01a070 con 0x7fc11c09be30 2024-04-24T08:26:25.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.620+0000 7fc112a00640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc0fc068380 0x7fc0fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.620+0000 7fc112a00640 1 -- 172.21.15.88:0/3443673771 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fc10c0868f0 con 0x7fc11c09be30 2024-04-24T08:26:25.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.620+0000 7fc119e00640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc0fc068380 0x7fc0fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.620+0000 7fc119e00640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc0fc068380 0x7fc0fc06a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc11c14f670 tx=0x7fc108009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:25.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.624+0000 7fc112a00640 1 -- 172.21.15.88:0/3443673771 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc10c056ea0 con 0x7fc11c09be30 2024-04-24T08:26:25.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.812+0000 7fc121400640 1 -- 172.21.15.88:0/3443673771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc11c068b90 con 0x7fc11c09be30 2024-04-24T08:26:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.812+0000 7fc112a00640 1 -- 172.21.15.88:0/3443673771 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3534 (secure 0 0 0) 0x7fc10c0567a0 con 0x7fc11c09be30 2024-04-24T08:26:25.816 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:25.816 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1471179990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1471179990},{"type":"v1","addr":"172.21.15.142:6833","nonce":1471179990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:26:10.368031+0000","modified":"2024-04-24T08:26:13.385291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3724486177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3724486177},{"type":"v1","addr":"172.21.15.88:6835","nonce":3724486177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4962,"qdb_cluster":[4962]},"id":2}]} 2024-04-24T08:26:25.816 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 16 2024-04-24T08:26:25.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.816+0000 7fc121400640 1 -- 172.21.15.88:0/3443673771 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc0fc068380 msgr2=0x7fc0fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.816+0000 7fc121400640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc0fc068380 0x7fc0fc06a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc11c14f670 tx=0x7fc108009040 comp rx=0 tx=0).stop 2024-04-24T08:26:25.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.816+0000 7fc121400640 1 -- 172.21.15.88:0/3443673771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc11c09be30 msgr2=0x7fc11c13d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.816+0000 7fc121400640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc11c09be30 0x7fc11c13d750 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00ebe0 tx=0x7fc10c00c520 comp rx=0 tx=0).stop 2024-04-24T08:26:25.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.816+0000 7fc121400640 1 -- 172.21.15.88:0/3443673771 shutdown_connections 2024-04-24T08:26:25.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.816+0000 7fc121400640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc0fc068380 0x7fc0fc06a840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.816+0000 7fc121400640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c145f20 0x7fc11c147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.816+0000 7fc121400640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11c0b9d90 0x7fc11c14f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.816+0000 7fc121400640 1 --2- 172.21.15.88:0/3443673771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc11c09be30 0x7fc11c13d750 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.816+0000 7fc121400640 1 -- 172.21.15.88:0/3443673771 >> 172.21.15.88:0/3443673771 conn(0x7fc11c06c0d0 msgr2=0x7fc11c09d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:25.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.816+0000 7fc121400640 1 -- 172.21.15.88:0/3443673771 shutdown_connections 2024-04-24T08:26:25.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.816+0000 7fc121400640 1 -- 172.21.15.88:0/3443673771 wait complete. 2024-04-24T08:26:25.838 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:26:25.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.968+0000 7fce77e00640 1 Processor -- start 2024-04-24T08:26:25.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.968+0000 7fce77e00640 1 -- start start 2024-04-24T08:26:25.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.968+0000 7fce77e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fce78141950 0x7fce78072c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.968+0000 7fce77e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce78147ed0 0x7fce78148380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.968+0000 7fce77e00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce7806ee30 con 0x7fce78071560 2024-04-24T08:26:25.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.968+0000 7fce77e00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fce781488c0 con 0x7fce78141950 2024-04-24T08:26:25.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.968+0000 7fce77e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fce781479d0 con 0x7fce78147ed0 2024-04-24T08:26:25.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.968+0000 7fce6e000640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fce78071560 0x7fce78067810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51088/0 (socket says 172.21.15.88:51088) 2024-04-24T08:26:25.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.968+0000 7fce76a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fce78141950 0x7fce78072c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.968+0000 7fce6e000640 1 -- 172.21.15.88:0/1507366198 learned_addr learned my addr 172.21.15.88:0/1507366198 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:25.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.968+0000 7fce77400640 1 --2- 172.21.15.88:0/1507366198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce78147ed0 0x7fce78148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.972+0000 7fce76000640 1 -- 172.21.15.88:0/1507366198 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1862162721 0 0) 0x7fce7806ee30 con 0x7fce78071560 2024-04-24T08:26:25.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.972+0000 7fce76000640 1 -- 172.21.15.88:0/1507366198 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce5c003530 con 0x7fce78071560 2024-04-24T08:26:25.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.972+0000 7fce76a00640 1 -- 172.21.15.88:0/1507366198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce78147ed0 msgr2=0x7fce78148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:25.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.972+0000 7fce76a00640 1 --2- 172.21.15.88:0/1507366198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce78147ed0 0x7fce78148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.972+0000 7fce76a00640 1 -- 172.21.15.88:0/1507366198 >> v1:172.21.15.88:6789/0 conn(0x7fce78071560 legacy=0x7fce78067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.972+0000 7fce76a00640 1 -- 172.21.15.88:0/1507366198 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce780732f0 con 0x7fce78141950 2024-04-24T08:26:25.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.972+0000 7fce76a00640 1 --2- 172.21.15.88:0/1507366198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce78141950 0x7fce78072c60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fce78148a40 tx=0x7fce6801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7cc8272c7e25e8f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:25.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.972+0000 7fce76000640 1 -- 172.21.15.88:0/1507366198 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce680b0070 con 0x7fce78141950 2024-04-24T08:26:25.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.972+0000 7fce76000640 1 -- 172.21.15.88:0/1507366198 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce680ab600 con 0x7fce78141950 2024-04-24T08:26:25.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.972+0000 7fce76000640 1 -- 172.21.15.88:0/1507366198 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce680ab9b0 con 0x7fce78141950 2024-04-24T08:26:25.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.972+0000 7fce77e00640 1 -- 172.21.15.88:0/1507366198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce78141950 msgr2=0x7fce78072c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.972+0000 7fce77e00640 1 --2- 172.21.15.88:0/1507366198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce78141950 0x7fce78072c60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fce78148a40 tx=0x7fce6801c4a0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 -- 172.21.15.88:0/1507366198 shutdown_connections 2024-04-24T08:26:25.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 --2- 172.21.15.88:0/1507366198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce78147ed0 0x7fce78148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 --2- 172.21.15.88:0/1507366198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce78141950 0x7fce78072c60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 -- 172.21.15.88:0/1507366198 >> 172.21.15.88:0/1507366198 conn(0x7fce7806bad0 msgr2=0x7fce7806bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:25.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 -- 172.21.15.88:0/1507366198 shutdown_connections 2024-04-24T08:26:25.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 -- 172.21.15.88:0/1507366198 wait complete. 2024-04-24T08:26:25.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 Processor -- start 2024-04-24T08:26:25.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 -- start start 2024-04-24T08:26:25.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce78071560 0x7fce780adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce78141950 0x7fce780ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce78147ed0 0x7fce781e4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fce78154f00 con 0x7fce78141950 2024-04-24T08:26:25.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fce78154d80 con 0x7fce78071560 2024-04-24T08:26:25.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fce78155080 con 0x7fce78147ed0 2024-04-24T08:26:25.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce6e000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce78141950 0x7fce780ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce6e000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce78141950 0x7fce780ae6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33648/0 (socket says 172.21.15.88:33648) 2024-04-24T08:26:25.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce6e000640 1 -- 172.21.15.88:0/2420681674 learned_addr learned my addr 172.21.15.88:0/2420681674 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:25.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77400640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce78147ed0 0x7fce781e4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce76a00640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce78071560 0x7fce780adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce6e000640 1 -- 172.21.15.88:0/2420681674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce78147ed0 msgr2=0x7fce781e4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce6e000640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce78147ed0 0x7fce781e4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce6e000640 1 -- 172.21.15.88:0/2420681674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce78071560 msgr2=0x7fce780adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce6e000640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce78071560 0x7fce780adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce6e000640 1 -- 172.21.15.88:0/2420681674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce780afa40 con 0x7fce78141950 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77400640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce78147ed0 0x7fce781e4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce76a00640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce78071560 0x7fce780adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce6e000640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce78141950 0x7fce780ae6c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fce6000c420 tx=0x7fce6000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce6fe00640 1 -- 172.21.15.88:0/2420681674 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60017070 con 0x7fce78141950 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce6fe00640 1 -- 172.21.15.88:0/2420681674 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce60005d10 con 0x7fce78141950 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce6fe00640 1 -- 172.21.15.88:0/2420681674 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60007310 con 0x7fce78141950 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 -- 172.21.15.88:0/2420681674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce780b35d0 con 0x7fce78141950 2024-04-24T08:26:25.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.976+0000 7fce77e00640 1 -- 172.21.15.88:0/2420681674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce78145240 con 0x7fce78141950 2024-04-24T08:26:25.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.980+0000 7fce77e00640 1 -- 172.21.15.88:0/2420681674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce78068b20 con 0x7fce78141950 2024-04-24T08:26:25.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.980+0000 7fce6fe00640 1 -- 172.21.15.88:0/2420681674 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fce6001a070 con 0x7fce78141950 2024-04-24T08:26:25.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.980+0000 7fce6fe00640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fce54068380 0x7fce5406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:25.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.980+0000 7fce6fe00640 1 -- 172.21.15.88:0/2420681674 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fce60085dc0 con 0x7fce78141950 2024-04-24T08:26:25.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.980+0000 7fce76a00640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fce54068380 0x7fce5406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:25.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.980+0000 7fce76a00640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fce54068380 0x7fce5406a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fce680ad000 tx=0x7fce68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:25.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:25.984+0000 7fce6fe00640 1 -- 172.21.15.88:0/2420681674 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fce60056430 con 0x7fce78141950 2024-04-24T08:26:26.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.144+0000 7fce77e00640 1 -- 172.21.15.88:0/2420681674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce78147570 con 0x7fce78141950 2024-04-24T08:26:26.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.144+0000 7fce6fe00640 1 -- 172.21.15.88:0/2420681674 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+16669 (secure 0 0 0) 0x7fce60055d30 con 0x7fce78141950 2024-04-24T08:26:26.149 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:26.149 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:26:11.996420+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:26:08.022146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T08:26:09.337841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:26:26.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.148+0000 7fce77e00640 1 -- 172.21.15.88:0/2420681674 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fce54068380 msgr2=0x7fce5406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.148+0000 7fce77e00640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fce54068380 0x7fce5406a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fce680ad000 tx=0x7fce68008040 comp rx=0 tx=0).stop 2024-04-24T08:26:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.148+0000 7fce77e00640 1 -- 172.21.15.88:0/2420681674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce78141950 msgr2=0x7fce780ae6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.148+0000 7fce77e00640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce78141950 0x7fce780ae6c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fce6000c420 tx=0x7fce6000c8e0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.148+0000 7fce77e00640 1 -- 172.21.15.88:0/2420681674 shutdown_connections 2024-04-24T08:26:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.148+0000 7fce77e00640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fce54068380 0x7fce5406a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.148+0000 7fce77e00640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce78147ed0 0x7fce781e4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.148+0000 7fce77e00640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce78141950 0x7fce780ae6c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.148+0000 7fce77e00640 1 --2- 172.21.15.88:0/2420681674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce78071560 0x7fce780adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.148+0000 7fce77e00640 1 -- 172.21.15.88:0/2420681674 >> 172.21.15.88:0/2420681674 conn(0x7fce7806bad0 msgr2=0x7fce7806e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.148+0000 7fce77e00640 1 -- 172.21.15.88:0/2420681674 shutdown_connections 2024-04-24T08:26:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.148+0000 7fce77e00640 1 -- 172.21.15.88:0/2420681674 wait complete. 2024-04-24T08:26:26.169 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T08:25:15.012217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T08:26:08.022146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T08:26:09.337841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T08:26:26.170 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T08:26:26.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.304+0000 7fa8c1800640 1 Processor -- start 2024-04-24T08:26:26.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.304+0000 7fa8c1800640 1 -- start start 2024-04-24T08:26:26.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.304+0000 7fa8c1800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8bc0ae4e0 0x7fa8bc13e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.304+0000 7fa8c1800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8bc0b0580 con 0x7fa8bc0b01a0 2024-04-24T08:26:26.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.304+0000 7fa8c1800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8bc0b59d0 con 0x7fa8bc0737c0 2024-04-24T08:26:26.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.304+0000 7fa8c1800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa8bc0ae970 con 0x7fa8bc0ae4e0 2024-04-24T08:26:26.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.304+0000 7fa8baa00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa8bc0b01a0 0x7fa8bc06d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51100/0 (socket says 172.21.15.88:51100) 2024-04-24T08:26:26.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.304+0000 7fa8baa00640 1 -- 172.21.15.88:0/1688280855 learned_addr learned my addr 172.21.15.88:0/1688280855 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:26.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.304+0000 7fa8ba000640 1 --2- 172.21.15.88:0/1688280855 >> v2:172.21.15.142:3300/0 conn(0x7fa8bc0ae4e0 0x7fa8bc13e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.304+0000 7fa8b9600640 1 -- 172.21.15.88:0/1688280855 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 635657358 0 0) 0x7fa8bc0b0580 con 0x7fa8bc0b01a0 2024-04-24T08:26:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.304+0000 7fa8b9600640 1 -- 172.21.15.88:0/1688280855 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8a0003530 con 0x7fa8bc0b01a0 2024-04-24T08:26:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.308+0000 7fa8b9600640 1 -- 172.21.15.88:0/1688280855 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441291852 0 0) 0x7fa8bc0b59d0 con 0x7fa8bc0737c0 2024-04-24T08:26:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.308+0000 7fa8b9600640 1 -- 172.21.15.88:0/1688280855 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8bc0b0580 con 0x7fa8bc0737c0 2024-04-24T08:26:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.308+0000 7fa8ba000640 1 -- 172.21.15.88:0/1688280855 >> v1:172.21.15.142:6789/0 conn(0x7fa8bc0737c0 legacy=0x7fa8bc14f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.308+0000 7fa8ba000640 1 -- 172.21.15.88:0/1688280855 >> v1:172.21.15.88:6789/0 conn(0x7fa8bc0b01a0 legacy=0x7fa8bc06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.308+0000 7fa8ba000640 1 -- 172.21.15.88:0/1688280855 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc0b53a0 con 0x7fa8bc0ae4e0 2024-04-24T08:26:26.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.308+0000 7fa8ba000640 1 --2- 172.21.15.88:0/1688280855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8bc0ae4e0 0x7fa8bc13e980 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80097c0 tx=0x7fa8a801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=408413c4bc4c8d13 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.308+0000 7fa8b9600640 1 -- 172.21.15.88:0/1688280855 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80b0070 con 0x7fa8bc0ae4e0 2024-04-24T08:26:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.308+0000 7fa8b9600640 1 -- 172.21.15.88:0/1688280855 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a80ab600 con 0x7fa8bc0ae4e0 2024-04-24T08:26:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.308+0000 7fa8b9600640 1 -- 172.21.15.88:0/1688280855 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80ab9d0 con 0x7fa8bc0ae4e0 2024-04-24T08:26:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.308+0000 7fa8c1800640 1 -- 172.21.15.88:0/1688280855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8bc0ae4e0 msgr2=0x7fa8bc13e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.308+0000 7fa8c1800640 1 --2- 172.21.15.88:0/1688280855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8bc0ae4e0 0x7fa8bc13e980 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80097c0 tx=0x7fa8a801c380 comp rx=0 tx=0).stop 2024-04-24T08:26:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 -- 172.21.15.88:0/1688280855 shutdown_connections 2024-04-24T08:26:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 --2- 172.21.15.88:0/1688280855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8bc0ae4e0 0x7fa8bc13e980 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 -- 172.21.15.88:0/1688280855 >> 172.21.15.88:0/1688280855 conn(0x7fa8bc0b9690 msgr2=0x7fa8bc0b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 -- 172.21.15.88:0/1688280855 shutdown_connections 2024-04-24T08:26:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 -- 172.21.15.88:0/1688280855 wait complete. 2024-04-24T08:26:26.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 Processor -- start 2024-04-24T08:26:26.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 -- start start 2024-04-24T08:26:26.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8bc0737c0 0x7fa8bc0b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8bc0b01a0 0x7fa8bc070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8bc072f10 0x7fa8bc1e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc153780 con 0x7fa8bc0737c0 2024-04-24T08:26:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc06e470 con 0x7fa8bc072f10 2024-04-24T08:26:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa8bc153900 con 0x7fa8bc0b01a0 2024-04-24T08:26:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8baa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8bc0737c0 0x7fa8bc0b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8baa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8bc0737c0 0x7fa8bc0b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33652/0 (socket says 172.21.15.88:33652) 2024-04-24T08:26:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8baa00640 1 -- 172.21.15.88:0/233525788 learned_addr learned my addr 172.21.15.88:0/233525788 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8ba000640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8bc0b01a0 0x7fa8bc070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8bb400640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8bc072f10 0x7fa8bc1e3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8baa00640 1 -- 172.21.15.88:0/233525788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8bc0b01a0 msgr2=0x7fa8bc070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8baa00640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8bc0b01a0 0x7fa8bc070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8baa00640 1 -- 172.21.15.88:0/233525788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8bc072f10 msgr2=0x7fa8bc1e3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8baa00640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8bc072f10 0x7fa8bc1e3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8baa00640 1 -- 172.21.15.88:0/233525788 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc070580 con 0x7fa8bc0737c0 2024-04-24T08:26:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8bb400640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8bc072f10 0x7fa8bc1e3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8baa00640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8bc0737c0 0x7fa8bc0b34f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00cb50 tx=0x7fa8ac00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8b2a00640 1 -- 172.21.15.88:0/233525788 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac017070 con 0x7fa8bc0737c0 2024-04-24T08:26:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8b2a00640 1 -- 172.21.15.88:0/233525788 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ac00ad40 con 0x7fa8bc0737c0 2024-04-24T08:26:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8b2a00640 1 -- 172.21.15.88:0/233525788 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac012620 con 0x7fa8bc0737c0 2024-04-24T08:26:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 -- 172.21.15.88:0/233525788 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8bc072790 con 0x7fa8bc0737c0 2024-04-24T08:26:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.312+0000 7fa8c1800640 1 -- 172.21.15.88:0/233525788 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8bc0b22b0 con 0x7fa8bc0737c0 2024-04-24T08:26:26.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.316+0000 7fa8c1800640 1 -- 172.21.15.88:0/233525788 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8bc068c00 con 0x7fa8bc0737c0 2024-04-24T08:26:26.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.316+0000 7fa8b2a00640 1 -- 172.21.15.88:0/233525788 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8ac01a070 con 0x7fa8bc0737c0 2024-04-24T08:26:26.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.316+0000 7fa8b2a00640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa89c068380 0x7fa89c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.316+0000 7fa8b2a00640 1 -- 172.21.15.88:0/233525788 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fa8ac086720 con 0x7fa8bc0737c0 2024-04-24T08:26:26.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.316+0000 7fa8ba000640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa89c068380 0x7fa89c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:26.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.316+0000 7fa8ba000640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa89c068380 0x7fa89c06a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80ad000 tx=0x7fa8a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:26.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.320+0000 7fa8b2a00640 1 -- 172.21.15.88:0/233525788 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa8ac056680 con 0x7fa8bc0737c0 2024-04-24T08:26:26.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T08:26:26.467 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T08:26:26.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 -- 172.21.15.88:0/233525788 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa8bc13cba0 con 0x7fa8bc0737c0 2024-04-24T08:26:26.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8b2a00640 1 -- 172.21.15.88:0/233525788 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fa8ac05a980 con 0x7fa8bc0737c0 2024-04-24T08:26:26.482 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-24T08:26:26.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 -- 172.21.15.88:0/233525788 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa89c068380 msgr2=0x7fa89c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa89c068380 0x7fa89c06a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80ad000 tx=0x7fa8a8008040 comp rx=0 tx=0).stop 2024-04-24T08:26:26.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 -- 172.21.15.88:0/233525788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8bc0737c0 msgr2=0x7fa8bc0b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8bc0737c0 0x7fa8bc0b34f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00cb50 tx=0x7fa8ac00a430 comp rx=0 tx=0).stop 2024-04-24T08:26:26.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 -- 172.21.15.88:0/233525788 shutdown_connections 2024-04-24T08:26:26.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa89c068380 0x7fa89c06a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8bc072f10 0x7fa8bc1e3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8bc0b01a0 0x7fa8bc070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 --2- 172.21.15.88:0/233525788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8bc0737c0 0x7fa8bc0b34f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 -- 172.21.15.88:0/233525788 >> 172.21.15.88:0/233525788 conn(0x7fa8bc0b9690 msgr2=0x7fa8bc145350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 -- 172.21.15.88:0/233525788 shutdown_connections 2024-04-24T08:26:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.480+0000 7fa8c1800640 1 -- 172.21.15.88:0/233525788 wait complete. 2024-04-24T08:26:26.504 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T08:26:26.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.692+0000 7ff71a800640 1 Processor -- start 2024-04-24T08:26:26.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff71a800640 1 -- start start 2024-04-24T08:26:26.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff71a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7140ae4e0 0x7ff71413e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff71a800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7140737c0 0x7ff71413eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff71a800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7140b0580 con 0x7ff7140b01a0 2024-04-24T08:26:26.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff71a800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff7140b59d0 con 0x7ff7140737c0 2024-04-24T08:26:26.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff71a800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff7140ae970 con 0x7ff7140ae4e0 2024-04-24T08:26:26.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff713400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff7140b01a0 0x7ff71406d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51110/0 (socket says 172.21.15.88:51110) 2024-04-24T08:26:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff713400640 1 -- 172.21.15.88:0/3829378598 learned_addr learned my addr 172.21.15.88:0/3829378598 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff713e00640 1 --2- 172.21.15.88:0/3829378598 >> v2:172.21.15.142:3300/0 conn(0x7ff7140737c0 0x7ff71413eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712a00640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7140ae4e0 0x7ff71413e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624540793 0 0) 0x7ff7140b0580 con 0x7ff7140b01a0 2024-04-24T08:26:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6f8003530 con 0x7ff7140b01a0 2024-04-24T08:26:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 80391062 0 0) 0x7ff6f8003530 con 0x7ff7140b01a0 2024-04-24T08:26:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7140ae4e0 msgr2=0x7ff71413e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7140ae4e0 0x7ff71413e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 >> v2:172.21.15.142:3300/0 conn(0x7ff7140737c0 msgr2=0x7ff71413eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 --2- 172.21.15.88:0/3829378598 >> v2:172.21.15.142:3300/0 conn(0x7ff7140737c0 0x7ff71413eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7140b53a0 con 0x7ff7140b01a0 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7ff704001a00 con 0x7ff7140b01a0 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 >> v1:172.21.15.88:6789/0 conn(0x7ff7140b01a0 legacy=0x7ff71406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f80039c0 0x7ff6f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6f8004320 0x7ff6f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6f8004f00 0x7ff6f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff7140b59d0 con 0x7ff6f8004f00 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff7140ae970 con 0x7ff6f8004320 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f800bf10 con 0x7ff6f80039c0 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff713e00640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6f8004f00 0x7ff6f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712a00640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6f8004320 0x7ff6f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff713400640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f80039c0 0x7ff6f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff713e00640 1 -- 172.21.15.88:0/3829378598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f80039c0 msgr2=0x7ff6f8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff713e00640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f80039c0 0x7ff6f8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff713e00640 1 -- 172.21.15.88:0/3829378598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6f8004320 msgr2=0x7ff6f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:26.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff713e00640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6f8004320 0x7ff6f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff713e00640 1 -- 172.21.15.88:0/3829378598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f8003530 con 0x7ff6f8004f00 2024-04-24T08:26:26.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.696+0000 7ff712a00640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6f8004320 0x7ff6f8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:26.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.700+0000 7ff713e00640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6f8004f00 0x7ff6f800b9d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009ae0 tx=0x7ff70c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45856c685f0bdbf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:26.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.700+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0b2070 con 0x7ff6f8004f00 2024-04-24T08:26:26.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.700+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70c0a5590 con 0x7ff6f8004f00 2024-04-24T08:26:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.700+0000 7ff712000640 1 -- 172.21.15.88:0/3829378598 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0096b0 con 0x7ff6f8004f00 2024-04-24T08:26:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.700+0000 7ff71a800640 1 -- 172.21.15.88:0/3829378598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6f8004f00 msgr2=0x7ff6f800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.700+0000 7ff71a800640 1 --2- 172.21.15.88:0/3829378598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6f8004f00 0x7ff6f800b9d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009ae0 tx=0x7ff70c01cab0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.700+0000 7ff713e00640 1 -- 172.21.15.88:0/3829378598 reap_dead start 2024-04-24T08:26:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.700+0000 7ff71a800640 1 -- 172.21.15.88:0/3829378598 shutdown_connections 2024-04-24T08:26:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.700+0000 7ff71a800640 1 -- 172.21.15.88:0/3829378598 >> 172.21.15.88:0/3829378598 conn(0x7ff7140b9690 msgr2=0x7ff7140b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.700+0000 7ff71a800640 1 -- 172.21.15.88:0/3829378598 shutdown_connections 2024-04-24T08:26:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.700+0000 7ff71a800640 1 -- 172.21.15.88:0/3829378598 wait complete. 2024-04-24T08:26:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.700+0000 7ff71a800640 1 Processor -- start 2024-04-24T08:26:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff71a800640 1 -- start start 2024-04-24T08:26:26.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff71a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6f8004f00 0x7ff7140b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff71a800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7141427f0 0x7ff71413f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff71a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff71413fa40 0x7ff714134520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff71a800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff71414fe50 con 0x7ff7141427f0 2024-04-24T08:26:26.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff71a800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff71406e470 con 0x7ff6f8004f00 2024-04-24T08:26:26.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff71a800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff71414ffd0 con 0x7ff71413fa40 2024-04-24T08:26:26.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff712a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7141427f0 0x7ff71413f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:26.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff712a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7141427f0 0x7ff71413f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33658/0 (socket says 172.21.15.88:33658) 2024-04-24T08:26:26.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff712a00640 1 -- 172.21.15.88:0/127383076 learned_addr learned my addr 172.21.15.88:0/127383076 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:26.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff712a00640 1 -- 172.21.15.88:0/127383076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff71413fa40 msgr2=0x7ff714134520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff712a00640 1 --2- 172.21.15.88:0/127383076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff71413fa40 0x7ff714134520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff712a00640 1 -- 172.21.15.88:0/127383076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6f8004f00 msgr2=0x7ff7140b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff712a00640 1 --2- 172.21.15.88:0/127383076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6f8004f00 0x7ff7140b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff712a00640 1 -- 172.21.15.88:0/127383076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff714143ad0 con 0x7ff7141427f0 2024-04-24T08:26:26.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff712a00640 1 --2- 172.21.15.88:0/127383076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7141427f0 0x7ff71413f500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff7000115f0 tx=0x7ff700011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:26.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff70b400640 1 -- 172.21.15.88:0/127383076 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700004220 con 0x7ff7141427f0 2024-04-24T08:26:26.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff70b400640 1 -- 172.21.15.88:0/127383076 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7000043c0 con 0x7ff7141427f0 2024-04-24T08:26:26.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff70b400640 1 -- 172.21.15.88:0/127383076 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700015870 con 0x7ff7141427f0 2024-04-24T08:26:26.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff71a800640 1 -- 172.21.15.88:0/127383076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7141435d0 con 0x7ff7141427f0 2024-04-24T08:26:26.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff71a800640 1 -- 172.21.15.88:0/127383076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7141444c0 con 0x7ff7141427f0 2024-04-24T08:26:26.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff71a800640 1 -- 172.21.15.88:0/127383076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff714068c00 con 0x7ff7141427f0 2024-04-24T08:26:26.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.704+0000 7ff70b400640 1 -- 172.21.15.88:0/127383076 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff700015a10 con 0x7ff7141427f0 2024-04-24T08:26:26.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.708+0000 7ff70b400640 1 --2- 172.21.15.88:0/127383076 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff6f4068380 0x7ff6f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:26.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.708+0000 7ff70b400640 1 -- 172.21.15.88:0/127383076 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7ff700086c70 con 0x7ff7141427f0 2024-04-24T08:26:26.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.708+0000 7ff713400640 1 --2- 172.21.15.88:0/127383076 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff6f4068380 0x7ff6f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:26.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.708+0000 7ff713400640 1 --2- 172.21.15.88:0/127383076 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff6f4068380 0x7ff6f406a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff7040012f0 tx=0x7ff704001370 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:26.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.712+0000 7ff70b400640 1 -- 172.21.15.88:0/127383076 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff700019030 con 0x7ff7141427f0 2024-04-24T08:26:26.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.868+0000 7ff71a800640 1 -- 172.21.15.88:0/127383076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff7140b0580 con 0x7ff7141427f0 2024-04-24T08:26:26.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.868+0000 7ff70b400640 1 -- 172.21.15.88:0/127383076 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7ff700057220 con 0x7ff7141427f0 2024-04-24T08:26:26.873 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-24T08:26:26.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.872+0000 7ff71a800640 1 -- 172.21.15.88:0/127383076 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff6f4068380 msgr2=0x7ff6f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.872+0000 7ff71a800640 1 --2- 172.21.15.88:0/127383076 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff6f4068380 0x7ff6f406a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff7040012f0 tx=0x7ff704001370 comp rx=0 tx=0).stop 2024-04-24T08:26:26.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.872+0000 7ff71a800640 1 -- 172.21.15.88:0/127383076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7141427f0 msgr2=0x7ff71413f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:26.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.872+0000 7ff71a800640 1 --2- 172.21.15.88:0/127383076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7141427f0 0x7ff71413f500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff7000115f0 tx=0x7ff700011ab0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.872+0000 7ff71a800640 1 -- 172.21.15.88:0/127383076 shutdown_connections 2024-04-24T08:26:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.872+0000 7ff71a800640 1 --2- 172.21.15.88:0/127383076 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff6f4068380 0x7ff6f406a840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.872+0000 7ff71a800640 1 --2- 172.21.15.88:0/127383076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff71413fa40 0x7ff714134520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.872+0000 7ff71a800640 1 --2- 172.21.15.88:0/127383076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7141427f0 0x7ff71413f500 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.872+0000 7ff71a800640 1 --2- 172.21.15.88:0/127383076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6f8004f00 0x7ff7140b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.872+0000 7ff71a800640 1 -- 172.21.15.88:0/127383076 >> 172.21.15.88:0/127383076 conn(0x7ff7140b9690 msgr2=0x7ff7140b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.872+0000 7ff71a800640 1 -- 172.21.15.88:0/127383076 shutdown_connections 2024-04-24T08:26:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:26.872+0000 7ff71a800640 1 -- 172.21.15.88:0/127383076 wait complete. 2024-04-24T08:26:26.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T08:26:27.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.032+0000 7f1e05400640 1 Processor -- start 2024-04-24T08:26:27.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.032+0000 7f1e05400640 1 -- start start 2024-04-24T08:26:27.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.032+0000 7f1e05400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e000bbe40 0x7f1e00148f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.032+0000 7f1e05400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1e0013fc40 0x7f1e00149440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.032+0000 7f1e05400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e000bc220 con 0x7f1e000b6de0 2024-04-24T08:26:27.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.032+0000 7f1e05400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f1e000b6290 con 0x7f1e0013fc40 2024-04-24T08:26:27.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.032+0000 7f1e05400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1e000b3810 con 0x7f1e000bbe40 2024-04-24T08:26:27.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.032+0000 7f1e04a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1e0013fc40 0x7f1e00149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.032+0000 7f1dff400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1e000b6de0 0x7f1e0013f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51118/0 (socket says 172.21.15.88:51118) 2024-04-24T08:26:27.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.032+0000 7f1dff400640 1 -- 172.21.15.88:0/1868757521 learned_addr learned my addr 172.21.15.88:0/1868757521 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.032+0000 7f1dffe00640 1 --2- 172.21.15.88:0/1868757521 >> v2:172.21.15.142:3300/0 conn(0x7f1e000bbe40 0x7f1e00148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1e04a00640 1 -- 172.21.15.88:0/1868757521 >> v2:172.21.15.142:3300/0 conn(0x7f1e000bbe40 msgr2=0x7f1e00148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1e04a00640 1 --2- 172.21.15.88:0/1868757521 >> v2:172.21.15.142:3300/0 conn(0x7f1e000bbe40 0x7f1e00148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1e04a00640 1 -- 172.21.15.88:0/1868757521 >> v1:172.21.15.88:6789/0 conn(0x7f1e000b6de0 legacy=0x7f1e0013f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1e04a00640 1 -- 172.21.15.88:0/1868757521 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e000b64e0 con 0x7f1e0013fc40 2024-04-24T08:26:27.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1dfea00640 1 -- 172.21.15.88:0/1868757521 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262957050 0 0) 0x7f1e000bc220 con 0x7f1e000b6de0 2024-04-24T08:26:27.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1e04a00640 1 --2- 172.21.15.88:0/1868757521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e0013fc40 0x7f1e00149440 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1e000b7f30 tx=0x7f1df801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759aba7bac291cb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1dfea00640 1 -- 172.21.15.88:0/1868757521 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df80b2070 con 0x7f1e0013fc40 2024-04-24T08:26:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1dfea00640 1 -- 172.21.15.88:0/1868757521 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df80a5870 con 0x7f1e0013fc40 2024-04-24T08:26:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1dfea00640 1 -- 172.21.15.88:0/1868757521 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df80a5c40 con 0x7f1e0013fc40 2024-04-24T08:26:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1e05400640 1 -- 172.21.15.88:0/1868757521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e0013fc40 msgr2=0x7f1e00149440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1e05400640 1 --2- 172.21.15.88:0/1868757521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e0013fc40 0x7f1e00149440 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1e000b7f30 tx=0x7f1df801c8a0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1e05400640 1 -- 172.21.15.88:0/1868757521 shutdown_connections 2024-04-24T08:26:27.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1e05400640 1 --2- 172.21.15.88:0/1868757521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e0013fc40 0x7f1e00149440 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1e05400640 1 --2- 172.21.15.88:0/1868757521 >> v2:172.21.15.142:3300/0 conn(0x7f1e000bbe40 0x7f1e00148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.036+0000 7f1e05400640 1 -- 172.21.15.88:0/1868757521 >> 172.21.15.88:0/1868757521 conn(0x7f1e00067e70 msgr2=0x7f1e000bb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:27.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1e05400640 1 -- 172.21.15.88:0/1868757521 shutdown_connections 2024-04-24T08:26:27.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1e05400640 1 -- 172.21.15.88:0/1868757521 wait complete. 2024-04-24T08:26:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1e05400640 1 Processor -- start 2024-04-24T08:26:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1e05400640 1 -- start start 2024-04-24T08:26:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1e05400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e000b6de0 0x7f1e001469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1e05400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e000bbe40 0x7f1e001417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1e05400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e0013fc40 0x7f1e00141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1e05400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1e00152d40 con 0x7f1e000bbe40 2024-04-24T08:26:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1e05400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1e00152bc0 con 0x7f1e000b6de0 2024-04-24T08:26:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1e05400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1e00152ec0 con 0x7f1e0013fc40 2024-04-24T08:26:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1dff400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e000bbe40 0x7f1e001417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1dff400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e000bbe40 0x7f1e001417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33664/0 (socket says 172.21.15.88:33664) 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1dff400640 1 -- 172.21.15.88:0/961939603 learned_addr learned my addr 172.21.15.88:0/961939603 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1dff400640 1 -- 172.21.15.88:0/961939603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e0013fc40 msgr2=0x7f1e00141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1dff400640 1 --2- 172.21.15.88:0/961939603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e0013fc40 0x7f1e00141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1dff400640 1 -- 172.21.15.88:0/961939603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e000b6de0 msgr2=0x7f1e001469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1dff400640 1 --2- 172.21.15.88:0/961939603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e000b6de0 0x7f1e001469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1dff400640 1 -- 172.21.15.88:0/961939603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e00142c20 con 0x7f1e000bbe40 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1dff400640 1 --2- 172.21.15.88:0/961939603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e000bbe40 0x7f1e001417a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00c520 tx=0x7f1dec00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1df7e00640 1 -- 172.21.15.88:0/961939603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec018070 con 0x7f1e000bbe40 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1df7e00640 1 -- 172.21.15.88:0/961939603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dec0074e0 con 0x7f1e000bbe40 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1e05400640 1 -- 172.21.15.88:0/961939603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e001e3560 con 0x7f1e000bbe40 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1df7e00640 1 -- 172.21.15.88:0/961939603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec0049f0 con 0x7f1e000bbe40 2024-04-24T08:26:27.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.040+0000 7f1e05400640 1 -- 172.21.15.88:0/961939603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e001e4040 con 0x7f1e000bbe40 2024-04-24T08:26:27.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.044+0000 7f1e05400640 1 -- 172.21.15.88:0/961939603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e00069230 con 0x7f1e000bbe40 2024-04-24T08:26:27.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.044+0000 7f1df7e00640 1 -- 172.21.15.88:0/961939603 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1dec01b070 con 0x7f1e000bbe40 2024-04-24T08:26:27.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.044+0000 7f1df7e00640 1 --2- 172.21.15.88:0/961939603 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1de00683b0 0x7f1de006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.044+0000 7f1df7e00640 1 -- 172.21.15.88:0/961939603 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f1dec085db0 con 0x7f1e000bbe40 2024-04-24T08:26:27.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.044+0000 7f1dffe00640 1 --2- 172.21.15.88:0/961939603 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1de00683b0 0x7f1de006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.044+0000 7f1dffe00640 1 --2- 172.21.15.88:0/961939603 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1de00683b0 0x7f1de006a870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1e000b6cc0 tx=0x7f1df0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:27.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.048+0000 7f1df7e00640 1 -- 172.21.15.88:0/961939603 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1dec08a070 con 0x7f1e000bbe40 2024-04-24T08:26:27.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.212+0000 7f1e05400640 1 -- 172.21.15.88:0/961939603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1e00143230 con 0x7f1e000bbe40 2024-04-24T08:26:27.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.212+0000 7f1df7e00640 1 -- 172.21.15.88:0/961939603 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f1dec056360 con 0x7f1e000bbe40 2024-04-24T08:26:27.217 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-24T08:26:27.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.216+0000 7f1e05400640 1 -- 172.21.15.88:0/961939603 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1de00683b0 msgr2=0x7f1de006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.216+0000 7f1e05400640 1 --2- 172.21.15.88:0/961939603 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1de00683b0 0x7f1de006a870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1e000b6cc0 tx=0x7f1df0008040 comp rx=0 tx=0).stop 2024-04-24T08:26:27.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.216+0000 7f1e05400640 1 -- 172.21.15.88:0/961939603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e000bbe40 msgr2=0x7f1e001417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.216+0000 7f1e05400640 1 --2- 172.21.15.88:0/961939603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e000bbe40 0x7f1e001417a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00c520 tx=0x7f1dec00c9e0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.216+0000 7f1e05400640 1 -- 172.21.15.88:0/961939603 shutdown_connections 2024-04-24T08:26:27.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.216+0000 7f1e05400640 1 --2- 172.21.15.88:0/961939603 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1de00683b0 0x7f1de006a870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.216+0000 7f1e05400640 1 --2- 172.21.15.88:0/961939603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e0013fc40 0x7f1e00141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.216+0000 7f1e05400640 1 --2- 172.21.15.88:0/961939603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e000bbe40 0x7f1e001417a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.216+0000 7f1e05400640 1 --2- 172.21.15.88:0/961939603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e000b6de0 0x7f1e001469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.216+0000 7f1e05400640 1 -- 172.21.15.88:0/961939603 >> 172.21.15.88:0/961939603 conn(0x7f1e00067e70 msgr2=0x7f1e000ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:27.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.216+0000 7f1e05400640 1 -- 172.21.15.88:0/961939603 shutdown_connections 2024-04-24T08:26:27.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.216+0000 7f1e05400640 1 -- 172.21.15.88:0/961939603 wait complete. 2024-04-24T08:26:27.238 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:26:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4f600640 1 Processor -- start 2024-04-24T08:26:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4f600640 1 -- start start 2024-04-24T08:26:27.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4f600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a4806e720 0x7f8a480b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4f600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a4814c2c0 0x7f8a48152a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4f600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4806eb00 con 0x7f8a4806cbe0 2024-04-24T08:26:27.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4f600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8a4814be30 con 0x7f8a4806e720 2024-04-24T08:26:27.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4f600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8a4814b7e0 con 0x7f8a4814c2c0 2024-04-24T08:26:27.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4cc00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a4806e720 0x7f8a480b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4cc00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a4806e720 0x7f8a480b7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33678/0 (socket says 172.21.15.88:33678) 2024-04-24T08:26:27.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4cc00640 1 -- 172.21.15.88:0/1289069668 learned_addr learned my addr 172.21.15.88:0/1289069668 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:27.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4d600640 1 --2- 172.21.15.88:0/1289069668 >> v2:172.21.15.142:3300/0 conn(0x7f8a4814c2c0 0x7f8a48152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4cc00640 1 -- 172.21.15.88:0/1289069668 >> v2:172.21.15.142:3300/0 conn(0x7f8a4814c2c0 msgr2=0x7f8a48152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:27.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4cc00640 1 --2- 172.21.15.88:0/1289069668 >> v2:172.21.15.142:3300/0 conn(0x7f8a4814c2c0 0x7f8a48152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4cc00640 1 -- 172.21.15.88:0/1289069668 >> v1:172.21.15.142:6789/0 conn(0x7f8a4806cbe0 legacy=0x7f8a480b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:27.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.372+0000 7f8a4cc00640 1 -- 172.21.15.88:0/1289069668 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4814bac0 con 0x7f8a4806e720 2024-04-24T08:26:27.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.376+0000 7f8a4cc00640 1 --2- 172.21.15.88:0/1289069668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4806e720 0x7f8a480b7010 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8a480725b0 tx=0x7f8a3801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f1d7fbcd70daa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:27.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.376+0000 7f8a47e00640 1 -- 172.21.15.88:0/1289069668 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a380b0070 con 0x7f8a4806e720 2024-04-24T08:26:27.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.376+0000 7f8a47e00640 1 -- 172.21.15.88:0/1289069668 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a380ab600 con 0x7f8a4806e720 2024-04-24T08:26:27.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.376+0000 7f8a47e00640 1 -- 172.21.15.88:0/1289069668 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a380ab9d0 con 0x7f8a4806e720 2024-04-24T08:26:27.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.376+0000 7f8a4f600640 1 -- 172.21.15.88:0/1289069668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4806e720 msgr2=0x7f8a480b7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.376+0000 7f8a4f600640 1 --2- 172.21.15.88:0/1289069668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4806e720 0x7f8a480b7010 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8a480725b0 tx=0x7f8a3801c3c0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.376+0000 7f8a4f600640 1 -- 172.21.15.88:0/1289069668 shutdown_connections 2024-04-24T08:26:27.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.376+0000 7f8a4f600640 1 --2- 172.21.15.88:0/1289069668 >> v2:172.21.15.142:3300/0 conn(0x7f8a4814c2c0 0x7f8a48152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.376+0000 7f8a4f600640 1 --2- 172.21.15.88:0/1289069668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4806e720 0x7f8a480b7010 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.376+0000 7f8a4f600640 1 -- 172.21.15.88:0/1289069668 >> 172.21.15.88:0/1289069668 conn(0x7f8a48067810 msgr2=0x7f8a48067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:27.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.376+0000 7f8a4f600640 1 -- 172.21.15.88:0/1289069668 shutdown_connections 2024-04-24T08:26:27.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.376+0000 7f8a4f600640 1 -- 172.21.15.88:0/1289069668 wait complete. 2024-04-24T08:26:27.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4f600640 1 Processor -- start 2024-04-24T08:26:27.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4f600640 1 -- start start 2024-04-24T08:26:27.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4f600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4806cbe0 0x7f8a48148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4f600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a4806e720 0x7f8a48143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4f600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a4814c2c0 0x7f8a481e4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4f600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8a48155970 con 0x7f8a4806cbe0 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4f600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8a480b7e70 con 0x7f8a4814c2c0 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4f600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8a48155af0 con 0x7f8a4806e720 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4cc00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4806cbe0 0x7f8a48148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4cc00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4806cbe0 0x7f8a48148210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33682/0 (socket says 172.21.15.88:33682) 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4cc00640 1 -- 172.21.15.88:0/140400754 learned_addr learned my addr 172.21.15.88:0/140400754 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4d600640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a4814c2c0 0x7f8a481e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a3fe00640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a4806e720 0x7f8a48143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4cc00640 1 -- 172.21.15.88:0/140400754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a4806e720 msgr2=0x7f8a48143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4cc00640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a4806e720 0x7f8a48143300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4cc00640 1 -- 172.21.15.88:0/140400754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a4814c2c0 msgr2=0x7f8a481e4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4cc00640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a4814c2c0 0x7f8a481e4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4cc00640 1 -- 172.21.15.88:0/140400754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a480adf80 con 0x7f8a4806cbe0 2024-04-24T08:26:27.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a3fe00640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a4806e720 0x7f8a48143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:27.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4cc00640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4806cbe0 0x7f8a48148210 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8a380ae040 tx=0x7f8a38019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:27.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a45600640 1 -- 172.21.15.88:0/140400754 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a380b0040 con 0x7f8a4806cbe0 2024-04-24T08:26:27.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a45600640 1 -- 172.21.15.88:0/140400754 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a380b4420 con 0x7f8a4806cbe0 2024-04-24T08:26:27.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a45600640 1 -- 172.21.15.88:0/140400754 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a380b4810 con 0x7f8a4806cbe0 2024-04-24T08:26:27.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4f600640 1 -- 172.21.15.88:0/140400754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a48143d60 con 0x7f8a4806cbe0 2024-04-24T08:26:27.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4f600640 1 -- 172.21.15.88:0/140400754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a480adca0 con 0x7f8a4806cbe0 2024-04-24T08:26:27.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.380+0000 7f8a4f600640 1 -- 172.21.15.88:0/140400754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a48068b90 con 0x7f8a4806cbe0 2024-04-24T08:26:27.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.384+0000 7f8a45600640 1 -- 172.21.15.88:0/140400754 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a380b49b0 con 0x7f8a4806cbe0 2024-04-24T08:26:27.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.384+0000 7f8a45600640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8a24068380 0x7f8a2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.384+0000 7f8a45600640 1 -- 172.21.15.88:0/140400754 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f8a38120440 con 0x7f8a4806cbe0 2024-04-24T08:26:27.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.384+0000 7f8a3fe00640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8a24068380 0x7f8a2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.384+0000 7f8a3fe00640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8a24068380 0x7f8a2406a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8a480ad950 tx=0x7f8a30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:27.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.388+0000 7f8a45600640 1 -- 172.21.15.88:0/140400754 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8a380160d0 con 0x7f8a4806cbe0 2024-04-24T08:26:27.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.576+0000 7f8a4f600640 1 -- 172.21.15.88:0/140400754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a480b8b90 con 0x7f8a4806cbe0 2024-04-24T08:26:27.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.576+0000 7f8a45600640 1 -- 172.21.15.88:0/140400754 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3534 (secure 0 0 0) 0x7f8a380f0b10 con 0x7f8a4806cbe0 2024-04-24T08:26:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:27.582 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1471179990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1471179990},{"type":"v1","addr":"172.21.15.142:6833","nonce":1471179990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:26:10.368031+0000","modified":"2024-04-24T08:26:13.385291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3724486177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3724486177},{"type":"v1","addr":"172.21.15.88:6835","nonce":3724486177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4962,"qdb_cluster":[4962]},"id":2}]} 2024-04-24T08:26:27.582 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 16 2024-04-24T08:26:27.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.580+0000 7f8a4f600640 1 -- 172.21.15.88:0/140400754 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8a24068380 msgr2=0x7f8a2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.580+0000 7f8a4f600640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8a24068380 0x7f8a2406a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8a480ad950 tx=0x7f8a30009040 comp rx=0 tx=0).stop 2024-04-24T08:26:27.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.580+0000 7f8a4f600640 1 -- 172.21.15.88:0/140400754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4806cbe0 msgr2=0x7f8a48148210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.580+0000 7f8a4f600640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4806cbe0 0x7f8a48148210 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8a380ae040 tx=0x7f8a38019160 comp rx=0 tx=0).stop 2024-04-24T08:26:27.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.580+0000 7f8a4f600640 1 -- 172.21.15.88:0/140400754 shutdown_connections 2024-04-24T08:26:27.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.580+0000 7f8a4f600640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8a24068380 0x7f8a2406a840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.580+0000 7f8a4f600640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a4814c2c0 0x7f8a481e4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.580+0000 7f8a4f600640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a4806e720 0x7f8a48143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.580+0000 7f8a4f600640 1 --2- 172.21.15.88:0/140400754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4806cbe0 0x7f8a48148210 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.580+0000 7f8a4f600640 1 -- 172.21.15.88:0/140400754 >> 172.21.15.88:0/140400754 conn(0x7f8a48067810 msgr2=0x7f8a480a94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:27.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.580+0000 7f8a4f600640 1 -- 172.21.15.88:0/140400754 shutdown_connections 2024-04-24T08:26:27.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.580+0000 7f8a4f600640 1 -- 172.21.15.88:0/140400754 wait complete. 2024-04-24T08:26:27.603 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:26:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f631e000640 1 Processor -- start 2024-04-24T08:26:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f631e000640 1 -- start start 2024-04-24T08:26:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f631e000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f631806bd30 0x7f631809c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f631e000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f63180b6a50 0x7f631813f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f631e000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f631809bd90 con 0x7f631813fdd0 2024-04-24T08:26:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f631e000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f631809aed0 con 0x7f631806bd30 2024-04-24T08:26:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f631e000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f631806c110 con 0x7f63180b6a50 2024-04-24T08:26:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f6317400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f631806bd30 0x7f631809c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f6317e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f631813fdd0 0x7f6318149180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51122/0 (socket says 172.21.15.88:51122) 2024-04-24T08:26:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f6317e00640 1 -- 172.21.15.88:0/2131134547 learned_addr learned my addr 172.21.15.88:0/2131134547 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f6316a00640 1 --2- 172.21.15.88:0/2131134547 >> v2:172.21.15.142:3300/0 conn(0x7f63180b6a50 0x7f631813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f6317400640 1 -- 172.21.15.88:0/2131134547 >> v2:172.21.15.142:3300/0 conn(0x7f63180b6a50 msgr2=0x7f631813f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:27.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f6317400640 1 --2- 172.21.15.88:0/2131134547 >> v2:172.21.15.142:3300/0 conn(0x7f63180b6a50 0x7f631813f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f6317400640 1 -- 172.21.15.88:0/2131134547 >> v1:172.21.15.88:6789/0 conn(0x7f631813fdd0 legacy=0x7f6318149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f6317400640 1 -- 172.21.15.88:0/2131134547 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631809abf0 con 0x7f631806bd30 2024-04-24T08:26:27.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.736+0000 7f6316000640 1 -- 172.21.15.88:0/2131134547 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3883893445 0 0) 0x7f631809bd90 con 0x7f631813fdd0 2024-04-24T08:26:27.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f6317400640 1 --2- 172.21.15.88:0/2131134547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631806bd30 0x7f631809c490 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f63180b6f30 tx=0x7f630801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f6c4d1ec0f728e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:27.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f6316000640 1 -- 172.21.15.88:0/2131134547 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63080b2070 con 0x7f631806bd30 2024-04-24T08:26:27.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f6316000640 1 -- 172.21.15.88:0/2131134547 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63080a5710 con 0x7f631806bd30 2024-04-24T08:26:27.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f6316000640 1 -- 172.21.15.88:0/2131134547 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63080a5ae0 con 0x7f631806bd30 2024-04-24T08:26:27.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f631e000640 1 -- 172.21.15.88:0/2131134547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631806bd30 msgr2=0x7f631809c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f631e000640 1 --2- 172.21.15.88:0/2131134547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631806bd30 0x7f631809c490 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f63180b6f30 tx=0x7f630801c930 comp rx=0 tx=0).stop 2024-04-24T08:26:27.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f631e000640 1 -- 172.21.15.88:0/2131134547 shutdown_connections 2024-04-24T08:26:27.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f631e000640 1 --2- 172.21.15.88:0/2131134547 >> v2:172.21.15.142:3300/0 conn(0x7f63180b6a50 0x7f631813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f631e000640 1 --2- 172.21.15.88:0/2131134547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631806bd30 0x7f631809c490 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f631e000640 1 -- 172.21.15.88:0/2131134547 >> 172.21.15.88:0/2131134547 conn(0x7f63180b6fd0 msgr2=0x7f63180b73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:27.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f631e000640 1 -- 172.21.15.88:0/2131134547 shutdown_connections 2024-04-24T08:26:27.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f631e000640 1 -- 172.21.15.88:0/2131134547 wait complete. 2024-04-24T08:26:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f631e000640 1 Processor -- start 2024-04-24T08:26:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.740+0000 7f631e000640 1 -- start start 2024-04-24T08:26:27.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f631e000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631806bd30 0x7f6318072710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f631e000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63180b6a50 0x7f631814fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f631e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f631813fdd0 0x7f6318150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f631e000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f63181403a0 con 0x7f631806bd30 2024-04-24T08:26:27.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f631e000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6318140220 con 0x7f63180b6a50 2024-04-24T08:26:27.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f631e000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6318073cf0 con 0x7f631813fdd0 2024-04-24T08:26:27.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f6317400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631806bd30 0x7f6318072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f6317400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631806bd30 0x7f6318072710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33696/0 (socket says 172.21.15.88:33696) 2024-04-24T08:26:27.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f6317400640 1 -- 172.21.15.88:0/3779754226 learned_addr learned my addr 172.21.15.88:0/3779754226 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:27.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f6316a00640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63180b6a50 0x7f631814fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f6317e00640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f631813fdd0 0x7f6318150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f6317400640 1 -- 172.21.15.88:0/3779754226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f631813fdd0 msgr2=0x7f6318150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f6317400640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f631813fdd0 0x7f6318150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f6317400640 1 -- 172.21.15.88:0/3779754226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63180b6a50 msgr2=0x7f631814fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f6317400640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63180b6a50 0x7f631814fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f6317400640 1 -- 172.21.15.88:0/3779754226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63180b2850 con 0x7f631806bd30 2024-04-24T08:26:27.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f6317400640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631806bd30 0x7f6318072710 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f63080b0040 tx=0x7f63080196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f630f400640 1 -- 172.21.15.88:0/3779754226 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63080bd070 con 0x7f631806bd30 2024-04-24T08:26:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f630f400640 1 -- 172.21.15.88:0/3779754226 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63080039a0 con 0x7f631806bd30 2024-04-24T08:26:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f631e000640 1 -- 172.21.15.88:0/3779754226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6318150d80 con 0x7f631806bd30 2024-04-24T08:26:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f630f400640 1 -- 172.21.15.88:0/3779754226 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63080b2040 con 0x7f631806bd30 2024-04-24T08:26:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f631e000640 1 -- 172.21.15.88:0/3779754226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6318072ec0 con 0x7f631806bd30 2024-04-24T08:26:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.744+0000 7f631e000640 1 -- 172.21.15.88:0/3779754226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6318150b70 con 0x7f631806bd30 2024-04-24T08:26:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.748+0000 7f630f400640 1 -- 172.21.15.88:0/3779754226 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63080b8470 con 0x7f631806bd30 2024-04-24T08:26:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.748+0000 7f630f400640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f62f80683b0 0x7f62f806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.748+0000 7f630f400640 1 -- 172.21.15.88:0/3779754226 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f6308121690 con 0x7f631806bd30 2024-04-24T08:26:27.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.748+0000 7f6316a00640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f62f80683b0 0x7f62f806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:27.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.748+0000 7f6316a00640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f62f80683b0 0x7f62f806a870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6318143b50 tx=0x7f6304008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.752+0000 7f630f400640 1 -- 172.21.15.88:0/3779754226 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6308016520 con 0x7f631806bd30 2024-04-24T08:26:27.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.908+0000 7f631e000640 1 -- 172.21.15.88:0/3779754226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6318068b90 con 0x7f631806bd30 2024-04-24T08:26:27.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.908+0000 7f630f400640 1 -- 172.21.15.88:0/3779754226 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+16669 (secure 0 0 0) 0x7f63080f1690 con 0x7f631806bd30 2024-04-24T08:26:27.912 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:27.912 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:26:11.996420+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:26:08.022146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T08:26:09.337841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:26:27.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.912+0000 7f631e000640 1 -- 172.21.15.88:0/3779754226 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f62f80683b0 msgr2=0x7f62f806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.912+0000 7f631e000640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f62f80683b0 0x7f62f806a870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6318143b50 tx=0x7f6304008040 comp rx=0 tx=0).stop 2024-04-24T08:26:27.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.912+0000 7f631e000640 1 -- 172.21.15.88:0/3779754226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631806bd30 msgr2=0x7f6318072710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:27.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.912+0000 7f631e000640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631806bd30 0x7f6318072710 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f63080b0040 tx=0x7f63080196d0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.912+0000 7f631e000640 1 -- 172.21.15.88:0/3779754226 shutdown_connections 2024-04-24T08:26:27.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.912+0000 7f631e000640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f62f80683b0 0x7f62f806a870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.912+0000 7f631e000640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f631813fdd0 0x7f6318150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.912+0000 7f631e000640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63180b6a50 0x7f631814fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.912+0000 7f631e000640 1 --2- 172.21.15.88:0/3779754226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631806bd30 0x7f6318072710 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:27.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.912+0000 7f631e000640 1 -- 172.21.15.88:0/3779754226 >> 172.21.15.88:0/3779754226 conn(0x7f63180b6fd0 msgr2=0x7f6318144870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:27.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.912+0000 7f631e000640 1 -- 172.21.15.88:0/3779754226 shutdown_connections 2024-04-24T08:26:27.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:27.912+0000 7f631e000640 1 -- 172.21.15.88:0/3779754226 wait complete. 2024-04-24T08:26:27.933 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T08:26:27.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:26:28.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.064+0000 7f149fc00640 1 Processor -- start 2024-04-24T08:26:28.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.064+0000 7f149fc00640 1 -- start start 2024-04-24T08:26:28.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f149fc00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f14980afe00 0x7f149809e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f149fc00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149809cb10 con 0x7f149814b370 2024-04-24T08:26:28.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f149fc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14980b02e0 con 0x7f149809c730 2024-04-24T08:26:28.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f149fc00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f14980b9ea0 con 0x7f14980afe00 2024-04-24T08:26:28.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f149dc00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f149814b370 0x7f14981526a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52920/0 (socket says 172.21.15.88:52920) 2024-04-24T08:26:28.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f149dc00640 1 -- 172.21.15.88:0/1407075434 learned_addr learned my addr 172.21.15.88:0/1407075434 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:28.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f148fe00640 1 --2- 172.21.15.88:0/1407075434 >> v2:172.21.15.88:3300/0 conn(0x7f14980afe00 0x7f149809e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f1497e00640 1 -- 172.21.15.88:0/1407075434 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226107762 0 0) 0x7f149809cb10 con 0x7f149814b370 2024-04-24T08:26:28.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f1497e00640 1 -- 172.21.15.88:0/1407075434 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f147c003530 con 0x7f149814b370 2024-04-24T08:26:28.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f148fe00640 1 -- 172.21.15.88:0/1407075434 >> v1:172.21.15.142:6789/0 conn(0x7f149809c730 legacy=0x7f14980986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f1497e00640 1 -- 172.21.15.88:0/1407075434 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 209279736 0 0) 0x7f14980b02e0 con 0x7f149809c730 2024-04-24T08:26:28.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f148fe00640 1 -- 172.21.15.88:0/1407075434 >> v1:172.21.15.88:6789/0 conn(0x7f149814b370 legacy=0x7f14981526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.068+0000 7f148fe00640 1 -- 172.21.15.88:0/1407075434 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14980b9b30 con 0x7f14980afe00 2024-04-24T08:26:28.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f148fe00640 1 --2- 172.21.15.88:0/1407075434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14980afe00 0x7f149809e0f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f14800097c0 tx=0x7f148001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d24fe0d9ab462a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:28.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f1497e00640 1 -- 172.21.15.88:0/1407075434 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14800b0070 con 0x7f14980afe00 2024-04-24T08:26:28.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f1497e00640 1 -- 172.21.15.88:0/1407075434 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14800ab600 con 0x7f14980afe00 2024-04-24T08:26:28.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f1497e00640 1 -- 172.21.15.88:0/1407075434 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14800ab9b0 con 0x7f14980afe00 2024-04-24T08:26:28.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 -- 172.21.15.88:0/1407075434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14980afe00 msgr2=0x7f149809e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 --2- 172.21.15.88:0/1407075434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14980afe00 0x7f149809e0f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f14800097c0 tx=0x7f148001c4a0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 -- 172.21.15.88:0/1407075434 shutdown_connections 2024-04-24T08:26:28.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 --2- 172.21.15.88:0/1407075434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14980afe00 0x7f149809e0f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 -- 172.21.15.88:0/1407075434 >> 172.21.15.88:0/1407075434 conn(0x7f149806c0d0 msgr2=0x7f14980b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:28.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 -- 172.21.15.88:0/1407075434 shutdown_connections 2024-04-24T08:26:28.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 -- 172.21.15.88:0/1407075434 wait complete. 2024-04-24T08:26:28.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 Processor -- start 2024-04-24T08:26:28.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 -- start start 2024-04-24T08:26:28.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f149809c730 0x7f14981471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14980afe00 0x7f14980b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f149814b370 0x7f14980b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1498156760 con 0x7f149809c730 2024-04-24T08:26:28.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f14981565e0 con 0x7f149814b370 2024-04-24T08:26:28.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149fc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f14981568e0 con 0x7f14980afe00 2024-04-24T08:26:28.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149d200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f149809c730 0x7f14981471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149d200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f149809c730 0x7f14981471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54128/0 (socket says 172.21.15.88:54128) 2024-04-24T08:26:28.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149d200640 1 -- 172.21.15.88:0/1846488727 learned_addr learned my addr 172.21.15.88:0/1846488727 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:28.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149d200640 1 -- 172.21.15.88:0/1846488727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14980afe00 msgr2=0x7f14980b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149d200640 1 --2- 172.21.15.88:0/1846488727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14980afe00 0x7f14980b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149d200640 1 -- 172.21.15.88:0/1846488727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f149814b370 msgr2=0x7f14980b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149d200640 1 --2- 172.21.15.88:0/1846488727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f149814b370 0x7f14980b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.072+0000 7f149d200640 1 -- 172.21.15.88:0/1846488727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14981486a0 con 0x7f149809c730 2024-04-24T08:26:28.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.076+0000 7f149d200640 1 --2- 172.21.15.88:0/1846488727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f149809c730 0x7f14981471f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f148800c4d0 tx=0x7f148800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:28.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.076+0000 7f1495600640 1 -- 172.21.15.88:0/1846488727 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1488017070 con 0x7f149809c730 2024-04-24T08:26:28.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.076+0000 7f1495600640 1 -- 172.21.15.88:0/1846488727 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1488003600 con 0x7f149809c730 2024-04-24T08:26:28.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.076+0000 7f1495600640 1 -- 172.21.15.88:0/1846488727 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14880054a0 con 0x7f149809c730 2024-04-24T08:26:28.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.076+0000 7f149fc00640 1 -- 172.21.15.88:0/1846488727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1498148980 con 0x7f149809c730 2024-04-24T08:26:28.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.076+0000 7f149fc00640 1 -- 172.21.15.88:0/1846488727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1498147730 con 0x7f149809c730 2024-04-24T08:26:28.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.076+0000 7f149fc00640 1 -- 172.21.15.88:0/1846488727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1498068b90 con 0x7f149809c730 2024-04-24T08:26:28.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.076+0000 7f1495600640 1 -- 172.21.15.88:0/1846488727 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f148801a070 con 0x7f149809c730 2024-04-24T08:26:28.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.076+0000 7f1495600640 1 --2- 172.21.15.88:0/1846488727 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1474068380 0x7f147406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.076+0000 7f1495600640 1 -- 172.21.15.88:0/1846488727 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f1488085d90 con 0x7f149809c730 2024-04-24T08:26:28.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.076+0000 7f148fe00640 1 --2- 172.21.15.88:0/1846488727 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1474068380 0x7f147406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.080+0000 7f148fe00640 1 --2- 172.21.15.88:0/1846488727 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1474068380 0x7f147406a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f14800ad000 tx=0x7f1480004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:28.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.080+0000 7f1495600640 1 -- 172.21.15.88:0/1846488727 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1488056400 con 0x7f149809c730 2024-04-24T08:26:28.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.272+0000 7f149fc00640 1 -- 172.21.15.88:0/1846488727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f149809cb10 con 0x7f149809c730 2024-04-24T08:26:28.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.272+0000 7f1495600640 1 -- 172.21.15.88:0/1846488727 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3534 (secure 0 0 0) 0x7f1488055d00 con 0x7f149809c730 2024-04-24T08:26:28.277 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:28.277 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1471179990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1471179990},{"type":"v1","addr":"172.21.15.142:6833","nonce":1471179990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:26:10.368031+0000","modified":"2024-04-24T08:26:13.385291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3724486177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3724486177},{"type":"v1","addr":"172.21.15.88:6835","nonce":3724486177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4962,"qdb_cluster":[4962]},"id":2}]} 2024-04-24T08:26:28.278 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 16 2024-04-24T08:26:28.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.276+0000 7f149fc00640 1 -- 172.21.15.88:0/1846488727 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1474068380 msgr2=0x7f147406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.276+0000 7f149fc00640 1 --2- 172.21.15.88:0/1846488727 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1474068380 0x7f147406a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f14800ad000 tx=0x7f1480004740 comp rx=0 tx=0).stop 2024-04-24T08:26:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.276+0000 7f149fc00640 1 -- 172.21.15.88:0/1846488727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f149809c730 msgr2=0x7f14981471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.276+0000 7f149fc00640 1 --2- 172.21.15.88:0/1846488727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f149809c730 0x7f14981471f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f148800c4d0 tx=0x7f148800c990 comp rx=0 tx=0).stop 2024-04-24T08:26:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.276+0000 7f149fc00640 1 -- 172.21.15.88:0/1846488727 shutdown_connections 2024-04-24T08:26:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.276+0000 7f149fc00640 1 --2- 172.21.15.88:0/1846488727 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f1474068380 0x7f147406a840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.276+0000 7f149fc00640 1 --2- 172.21.15.88:0/1846488727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f149814b370 0x7f14980b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.276+0000 7f149fc00640 1 --2- 172.21.15.88:0/1846488727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14980afe00 0x7f14980b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.276+0000 7f149fc00640 1 --2- 172.21.15.88:0/1846488727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f149809c730 0x7f14981471f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.276+0000 7f149fc00640 1 -- 172.21.15.88:0/1846488727 >> 172.21.15.88:0/1846488727 conn(0x7f149806c0d0 msgr2=0x7f1498074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.276+0000 7f149fc00640 1 -- 172.21.15.88:0/1846488727 shutdown_connections 2024-04-24T08:26:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.276+0000 7f149fc00640 1 -- 172.21.15.88:0/1846488727 wait complete. 2024-04-24T08:26:28.298 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:26:28.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.428+0000 7fd74cc00640 1 Processor -- start 2024-04-24T08:26:28.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.428+0000 7fd74cc00640 1 -- start start 2024-04-24T08:26:28.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd74cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b5900 0x7fd748144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd74cc00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd748067e50 con 0x7fd748067a70 2024-04-24T08:26:28.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd74cc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7480af500 con 0x7fd748145420 2024-04-24T08:26:28.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd74cc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd7480b54b0 con 0x7fd7480b5900 2024-04-24T08:26:28.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd745e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd748067a70 0x7fd748147db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52932/0 (socket says 172.21.15.88:52932) 2024-04-24T08:26:28.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd745e00640 1 -- 172.21.15.88:0/1404059421 learned_addr learned my addr 172.21.15.88:0/1404059421 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:28.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd745400640 1 --2- 172.21.15.88:0/1404059421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b5900 0x7fd748144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd744a00640 1 -- 172.21.15.88:0/1404059421 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1070740266 0 0) 0x7fd748067e50 con 0x7fd748067a70 2024-04-24T08:26:28.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd744a00640 1 -- 172.21.15.88:0/1404059421 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd72c003530 con 0x7fd748067a70 2024-04-24T08:26:28.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd744a00640 1 -- 172.21.15.88:0/1404059421 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2323518268 0 0) 0x7fd7480af500 con 0x7fd748145420 2024-04-24T08:26:28.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd744a00640 1 -- 172.21.15.88:0/1404059421 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd748067e50 con 0x7fd748145420 2024-04-24T08:26:28.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd745400640 1 -- 172.21.15.88:0/1404059421 >> v1:172.21.15.142:6789/0 conn(0x7fd748145420 legacy=0x7fd748152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd745400640 1 -- 172.21.15.88:0/1404059421 >> v1:172.21.15.88:6789/0 conn(0x7fd748067a70 legacy=0x7fd748147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.432+0000 7fd745400640 1 -- 172.21.15.88:0/1404059421 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7480b5ee0 con 0x7fd7480b5900 2024-04-24T08:26:28.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd745400640 1 --2- 172.21.15.88:0/1404059421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b5900 0x7fd748144ee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd7340097d0 tx=0x7fd73401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b95845163ee14750 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:28.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd744a00640 1 -- 172.21.15.88:0/1404059421 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7340b0070 con 0x7fd7480b5900 2024-04-24T08:26:28.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd744a00640 1 -- 172.21.15.88:0/1404059421 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7340ab600 con 0x7fd7480b5900 2024-04-24T08:26:28.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd744a00640 1 -- 172.21.15.88:0/1404059421 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7340ab9d0 con 0x7fd7480b5900 2024-04-24T08:26:28.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd74cc00640 1 -- 172.21.15.88:0/1404059421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b5900 msgr2=0x7fd748144ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd74cc00640 1 --2- 172.21.15.88:0/1404059421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b5900 0x7fd748144ee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd7340097d0 tx=0x7fd73401c430 comp rx=0 tx=0).stop 2024-04-24T08:26:28.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd74cc00640 1 -- 172.21.15.88:0/1404059421 shutdown_connections 2024-04-24T08:26:28.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd74cc00640 1 --2- 172.21.15.88:0/1404059421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b5900 0x7fd748144ee0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd74cc00640 1 -- 172.21.15.88:0/1404059421 >> 172.21.15.88:0/1404059421 conn(0x7fd74806c380 msgr2=0x7fd7480b9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:28.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd74cc00640 1 -- 172.21.15.88:0/1404059421 shutdown_connections 2024-04-24T08:26:28.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd74cc00640 1 -- 172.21.15.88:0/1404059421 wait complete. 2024-04-24T08:26:28.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd74cc00640 1 Processor -- start 2024-04-24T08:26:28.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd74cc00640 1 -- start start 2024-04-24T08:26:28.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd74cc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd748067a70 0x7fd74814ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd74cc00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7480b5900 0x7fd7481e09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.436+0000 7fd74cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd748145420 0x7fd7481e0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd74cc00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd748145830 con 0x7fd7480b5900 2024-04-24T08:26:28.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd74cc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd7481484c0 con 0x7fd748067a70 2024-04-24T08:26:28.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd74cc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd748156590 con 0x7fd748145420 2024-04-24T08:26:28.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd745400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7480b5900 0x7fd7481e09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd745400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7480b5900 0x7fd7481e09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54134/0 (socket says 172.21.15.88:54134) 2024-04-24T08:26:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd745400640 1 -- 172.21.15.88:0/3915217850 learned_addr learned my addr 172.21.15.88:0/3915217850 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd745e00640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd748067a70 0x7fd74814ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd746800640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd748145420 0x7fd7481e0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd745400640 1 -- 172.21.15.88:0/3915217850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd748145420 msgr2=0x7fd7481e0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd745400640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd748145420 0x7fd7481e0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd745400640 1 -- 172.21.15.88:0/3915217850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd748067a70 msgr2=0x7fd74814ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd745400640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd748067a70 0x7fd74814ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd745400640 1 -- 172.21.15.88:0/3915217850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7480b1580 con 0x7fd7480b5900 2024-04-24T08:26:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd745400640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7480b5900 0x7fd7481e09c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd734019040 tx=0x7fd7340191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd73e000640 1 -- 172.21.15.88:0/3915217850 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7340b0040 con 0x7fd7480b5900 2024-04-24T08:26:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd73e000640 1 -- 172.21.15.88:0/3915217850 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7340b9070 con 0x7fd7480b5900 2024-04-24T08:26:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd73e000640 1 -- 172.21.15.88:0/3915217850 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7340b4690 con 0x7fd7480b5900 2024-04-24T08:26:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd74cc00640 1 -- 172.21.15.88:0/3915217850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74814ba90 con 0x7fd7480b5900 2024-04-24T08:26:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd74cc00640 1 -- 172.21.15.88:0/3915217850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7480b17f0 con 0x7fd7480b5900 2024-04-24T08:26:28.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd74cc00640 1 -- 172.21.15.88:0/3915217850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74814b510 con 0x7fd7480b5900 2024-04-24T08:26:28.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.440+0000 7fd73e000640 1 -- 172.21.15.88:0/3915217850 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd7340b4830 con 0x7fd7480b5900 2024-04-24T08:26:28.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.444+0000 7fd73e000640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd7280683b0 0x7fd72806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.444+0000 7fd73e000640 1 -- 172.21.15.88:0/3915217850 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fd734120430 con 0x7fd7480b5900 2024-04-24T08:26:28.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.444+0000 7fd745e00640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd7280683b0 0x7fd72806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.444+0000 7fd745e00640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd7280683b0 0x7fd72806a870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd738007fd0 tx=0x7fd738007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:28.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.448+0000 7fd73e000640 1 -- 172.21.15.88:0/3915217850 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd7340160b0 con 0x7fd7480b5900 2024-04-24T08:26:28.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.636+0000 7fd74cc00640 1 -- 172.21.15.88:0/3915217850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd748068b90 con 0x7fd7480b5900 2024-04-24T08:26:28.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.636+0000 7fd73e000640 1 -- 172.21.15.88:0/3915217850 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3534 (secure 0 0 0) 0x7fd7340f0390 con 0x7fd7480b5900 2024-04-24T08:26:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:28.641 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1471179990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1471179990},{"type":"v1","addr":"172.21.15.142:6833","nonce":1471179990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T08:26:10.368031+0000","modified":"2024-04-24T08:26:13.385291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3724486177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3724486177},{"type":"v1","addr":"172.21.15.88:6835","nonce":3724486177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4962,"qdb_cluster":[4962]},"id":2}]} 2024-04-24T08:26:28.641 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 16 2024-04-24T08:26:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.640+0000 7fd74cc00640 1 -- 172.21.15.88:0/3915217850 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd7280683b0 msgr2=0x7fd72806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.640+0000 7fd74cc00640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd7280683b0 0x7fd72806a870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd738007fd0 tx=0x7fd738007d80 comp rx=0 tx=0).stop 2024-04-24T08:26:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.640+0000 7fd74cc00640 1 -- 172.21.15.88:0/3915217850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7480b5900 msgr2=0x7fd7481e09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.640+0000 7fd74cc00640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7480b5900 0x7fd7481e09c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd734019040 tx=0x7fd7340191d0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.640+0000 7fd74cc00640 1 -- 172.21.15.88:0/3915217850 shutdown_connections 2024-04-24T08:26:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.640+0000 7fd74cc00640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd7280683b0 0x7fd72806a870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.640+0000 7fd74cc00640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd748145420 0x7fd7481e0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.640+0000 7fd74cc00640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7480b5900 0x7fd7481e09c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.640+0000 7fd74cc00640 1 --2- 172.21.15.88:0/3915217850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd748067a70 0x7fd74814ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.640+0000 7fd74cc00640 1 -- 172.21.15.88:0/3915217850 >> 172.21.15.88:0/3915217850 conn(0x7fd74806c380 msgr2=0x7fd7480b7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.640+0000 7fd74cc00640 1 -- 172.21.15.88:0/3915217850 shutdown_connections 2024-04-24T08:26:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.640+0000 7fd74cc00640 1 -- 172.21.15.88:0/3915217850 wait complete. 2024-04-24T08:26:28.661 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:26:28.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.792+0000 7f4266c00640 1 Processor -- start 2024-04-24T08:26:28.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.792+0000 7f4266c00640 1 -- start start 2024-04-24T08:26:28.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.792+0000 7f4266c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f42600b7b50 0x7f4260141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.792+0000 7f4266c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4260141fe0 0x7f4260152640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.792+0000 7f4266c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42600bc220 con 0x7f42600bbe40 2024-04-24T08:26:28.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.792+0000 7f4266c00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f4260142450 con 0x7f4260141fe0 2024-04-24T08:26:28.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.792+0000 7f4266c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f42600b6220 con 0x7f42600b7b50 2024-04-24T08:26:28.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.792+0000 7f4264c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4260141fe0 0x7f4260152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.792+0000 7f4264c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4260141fe0 0x7f4260152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54148/0 (socket says 172.21.15.88:54148) 2024-04-24T08:26:28.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.792+0000 7f4264c00640 1 -- 172.21.15.88:0/4100557305 learned_addr learned my addr 172.21.15.88:0/4100557305 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:28.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4257400640 1 --2- 172.21.15.88:0/4100557305 >> v2:172.21.15.142:3300/0 conn(0x7f42600b7b50 0x7f4260141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4264c00640 1 -- 172.21.15.88:0/4100557305 >> v2:172.21.15.142:3300/0 conn(0x7f42600b7b50 msgr2=0x7f4260141aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:28.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4264c00640 1 --2- 172.21.15.88:0/4100557305 >> v2:172.21.15.142:3300/0 conn(0x7f42600b7b50 0x7f4260141aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4264c00640 1 -- 172.21.15.88:0/4100557305 >> v1:172.21.15.142:6789/0 conn(0x7f42600bbe40 legacy=0x7f426014b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:28.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4264c00640 1 -- 172.21.15.88:0/4100557305 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42600b6500 con 0x7f4260141fe0 2024-04-24T08:26:28.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4264c00640 1 --2- 172.21.15.88:0/4100557305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4260141fe0 0x7f4260152640 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f42600aefd0 tx=0x7f425801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa388d1424bdfc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:28.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f425f400640 1 -- 172.21.15.88:0/4100557305 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580a5770 con 0x7f4260141fe0 2024-04-24T08:26:28.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f425f400640 1 -- 172.21.15.88:0/4100557305 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42580a5910 con 0x7f4260141fe0 2024-04-24T08:26:28.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f425f400640 1 -- 172.21.15.88:0/4100557305 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580a5ce0 con 0x7f4260141fe0 2024-04-24T08:26:28.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4266c00640 1 -- 172.21.15.88:0/4100557305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4260141fe0 msgr2=0x7f4260152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4266c00640 1 --2- 172.21.15.88:0/4100557305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4260141fe0 0x7f4260152640 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f42600aefd0 tx=0x7f425801c8f0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4266c00640 1 -- 172.21.15.88:0/4100557305 shutdown_connections 2024-04-24T08:26:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4266c00640 1 --2- 172.21.15.88:0/4100557305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4260141fe0 0x7f4260152640 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4266c00640 1 --2- 172.21.15.88:0/4100557305 >> v2:172.21.15.142:3300/0 conn(0x7f42600b7b50 0x7f4260141aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4266c00640 1 -- 172.21.15.88:0/4100557305 >> 172.21.15.88:0/4100557305 conn(0x7f4260067e10 msgr2=0x7f42600bb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.796+0000 7f4266c00640 1 -- 172.21.15.88:0/4100557305 shutdown_connections 2024-04-24T08:26:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4266c00640 1 -- 172.21.15.88:0/4100557305 wait complete. 2024-04-24T08:26:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4266c00640 1 Processor -- start 2024-04-24T08:26:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4266c00640 1 -- start start 2024-04-24T08:26:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4266c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42600b7b50 0x7f4260138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4266c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42600bbe40 0x7f42601e0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4266c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4260141fe0 0x7f42601e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4266c00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f426014c100 con 0x7f42600b7b50 2024-04-24T08:26:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4266c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f426014bf80 con 0x7f4260141fe0 2024-04-24T08:26:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4266c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f42600b5dd0 con 0x7f42600bbe40 2024-04-24T08:26:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f425fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42600b7b50 0x7f4260138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f425fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42600b7b50 0x7f4260138fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54162/0 (socket says 172.21.15.88:54162) 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f425fe00640 1 -- 172.21.15.88:0/2865784462 learned_addr learned my addr 172.21.15.88:0/2865784462 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4257400640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42600bbe40 0x7f42601e0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4264c00640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4260141fe0 0x7f42601e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f425fe00640 1 -- 172.21.15.88:0/2865784462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42600bbe40 msgr2=0x7f42601e0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f425fe00640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42600bbe40 0x7f42601e0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f425fe00640 1 -- 172.21.15.88:0/2865784462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4260141fe0 msgr2=0x7f42601e09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f425fe00640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4260141fe0 0x7f42601e09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f425fe00640 1 -- 172.21.15.88:0/2865784462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42601e3f20 con 0x7f42600b7b50 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f425fe00640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42600b7b50 0x7f4260138fa0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f425000c450 tx=0x7f425000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f425cc00640 1 -- 172.21.15.88:0/2865784462 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4250011790 con 0x7f42600b7b50 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f425cc00640 1 -- 172.21.15.88:0/2865784462 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4250017070 con 0x7f42600b7b50 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f425cc00640 1 -- 172.21.15.88:0/2865784462 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4250011b90 con 0x7f42600b7b50 2024-04-24T08:26:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4266c00640 1 -- 172.21.15.88:0/2865784462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42601e4200 con 0x7f42600b7b50 2024-04-24T08:26:28.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.800+0000 7f4266c00640 1 -- 172.21.15.88:0/2865784462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4260148e80 con 0x7f42600b7b50 2024-04-24T08:26:28.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.804+0000 7f4266c00640 1 -- 172.21.15.88:0/2865784462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4260068b90 con 0x7f42600b7b50 2024-04-24T08:26:28.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.804+0000 7f425cc00640 1 -- 172.21.15.88:0/2865784462 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4250011d30 con 0x7f42600b7b50 2024-04-24T08:26:28.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.804+0000 7f425cc00640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f423c068380 0x7f423c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:28.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.804+0000 7f425cc00640 1 -- 172.21.15.88:0/2865784462 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f42500868d0 con 0x7f42600b7b50 2024-04-24T08:26:28.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.804+0000 7f4257400640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f423c068380 0x7f423c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:28.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.804+0000 7f4257400640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f423c068380 0x7f423c06a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f426014b320 tx=0x7f4248008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:28.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.808+0000 7f425cc00640 1 -- 172.21.15.88:0/2865784462 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4250056df0 con 0x7f42600b7b50 2024-04-24T08:26:28.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.964+0000 7f4266c00640 1 -- 172.21.15.88:0/2865784462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f426013f9b0 con 0x7f42600b7b50 2024-04-24T08:26:28.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f425cc00640 1 -- 172.21.15.88:0/2865784462 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+16669 (secure 0 0 0) 0x7f42500566f0 con 0x7f42600b7b50 2024-04-24T08:26:28.970 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:28.971 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:26:11.996420+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-24T08:26:08.022146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-24T08:26:09.337841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:26:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f4266c00640 1 -- 172.21.15.88:0/2865784462 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f423c068380 msgr2=0x7f423c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f4266c00640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f423c068380 0x7f423c06a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f426014b320 tx=0x7f4248008040 comp rx=0 tx=0).stop 2024-04-24T08:26:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f4266c00640 1 -- 172.21.15.88:0/2865784462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42600b7b50 msgr2=0x7f4260138fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f4266c00640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42600b7b50 0x7f4260138fa0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f425000c450 tx=0x7f425000c910 comp rx=0 tx=0).stop 2024-04-24T08:26:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f4266c00640 1 -- 172.21.15.88:0/2865784462 shutdown_connections 2024-04-24T08:26:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f4266c00640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f423c068380 0x7f423c06a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f4266c00640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4260141fe0 0x7f42601e09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f4266c00640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42600bbe40 0x7f42601e0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f4266c00640 1 --2- 172.21.15.88:0/2865784462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42600b7b50 0x7f4260138fa0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f4266c00640 1 -- 172.21.15.88:0/2865784462 >> 172.21.15.88:0/2865784462 conn(0x7f4260067e10 msgr2=0x7f426013fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f4266c00640 1 -- 172.21.15.88:0/2865784462 shutdown_connections 2024-04-24T08:26:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:28.968+0000 7f4266c00640 1 -- 172.21.15.88:0/2865784462 wait complete. 2024-04-24T08:26:28.993 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T08:26:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.124+0000 7ff6f8400640 1 Processor -- start 2024-04-24T08:26:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.124+0000 7ff6f8400640 1 -- start start 2024-04-24T08:26:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f8400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f00b5760 0x7ff6f0143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f8400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6f00b4fd0 con 0x7ff6f01440f0 2024-04-24T08:26:29.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f8400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6f009cb10 con 0x7ff6f009c730 2024-04-24T08:26:29.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f8400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f00b52d0 con 0x7ff6f00b5760 2024-04-24T08:26:29.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f6400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff6f01440f0 0x7ff6f014f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52936/0 (socket says 172.21.15.88:52936) 2024-04-24T08:26:29.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f6400640 1 -- 172.21.15.88:0/1558991257 learned_addr learned my addr 172.21.15.88:0/1558991257 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:29.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f5000640 1 --2- 172.21.15.88:0/1558991257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f00b5760 0x7ff6f0143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3367046981 0 0) 0x7ff6f00b4fd0 con 0x7ff6f01440f0 2024-04-24T08:26:29.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6d8005740 con 0x7ff6f01440f0 2024-04-24T08:26:29.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786788472 0 0) 0x7ff6f009cb10 con 0x7ff6f009c730 2024-04-24T08:26:29.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6f00b4fd0 con 0x7ff6f009c730 2024-04-24T08:26:29.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1033144488 0 0) 0x7ff6d8005740 con 0x7ff6f01440f0 2024-04-24T08:26:29.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f00b5760 msgr2=0x7ff6f0143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:29.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 --2- 172.21.15.88:0/1558991257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f00b5760 0x7ff6f0143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 >> v1:172.21.15.142:6789/0 conn(0x7ff6f009c730 legacy=0x7ff6f0148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:29.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f006ea50 con 0x7ff6f01440f0 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7ff6e8001a00 con 0x7ff6f01440f0 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 >> v1:172.21.15.88:6789/0 conn(0x7ff6f01440f0 legacy=0x7ff6f014f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 --2- 172.21.15.88:0/1558991257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6d8005d90 0x7ff6d8006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 --2- 172.21.15.88:0/1558991257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f00b5760 0x7ff6d8006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 --2- 172.21.15.88:0/1558991257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8006f60 0x7ff6d80073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f00b52d0 con 0x7ff6d8005d90 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d800dce0 con 0x7ff6d8006f60 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d800dee0 con 0x7ff6f00b5760 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f5a00640 1 --2- 172.21.15.88:0/1558991257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6d8005d90 0x7ff6d8006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f5000640 1 --2- 172.21.15.88:0/1558991257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f00b5760 0x7ff6d8006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f6400640 1 --2- 172.21.15.88:0/1558991257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8006f60 0x7ff6d80073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f5a00640 1 -- 172.21.15.88:0/1558991257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f00b5760 msgr2=0x7ff6d8006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f5a00640 1 --2- 172.21.15.88:0/1558991257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f00b5760 0x7ff6d8006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f5a00640 1 -- 172.21.15.88:0/1558991257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8006f60 msgr2=0x7ff6d80073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:29.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f5a00640 1 --2- 172.21.15.88:0/1558991257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8006f60 0x7ff6d80073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.128+0000 7ff6f5a00640 1 -- 172.21.15.88:0/1558991257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d8005740 con 0x7ff6d8005d90 2024-04-24T08:26:29.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6f5a00640 1 --2- 172.21.15.88:0/1558991257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6d8005d90 0x7ff6d8006190 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40018d0 tx=0x7ff6e401c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf68cf64967a496 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4001520 con 0x7ff6d8005d90 2024-04-24T08:26:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e40052f0 con 0x7ff6d8005d90 2024-04-24T08:26:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6efe00640 1 -- 172.21.15.88:0/1558991257 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4003840 con 0x7ff6d8005d90 2024-04-24T08:26:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6f8400640 1 -- 172.21.15.88:0/1558991257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6d8005d90 msgr2=0x7ff6d8006190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6f8400640 1 --2- 172.21.15.88:0/1558991257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6d8005d90 0x7ff6d8006190 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40018d0 tx=0x7ff6e401c580 comp rx=0 tx=0).stop 2024-04-24T08:26:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6f6400640 1 -- 172.21.15.88:0/1558991257 reap_dead start 2024-04-24T08:26:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6f8400640 1 -- 172.21.15.88:0/1558991257 shutdown_connections 2024-04-24T08:26:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6f8400640 1 -- 172.21.15.88:0/1558991257 >> 172.21.15.88:0/1558991257 conn(0x7ff6f00b9420 msgr2=0x7ff6f00b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:29.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6f8400640 1 -- 172.21.15.88:0/1558991257 shutdown_connections 2024-04-24T08:26:29.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6f8400640 1 -- 172.21.15.88:0/1558991257 wait complete. 2024-04-24T08:26:29.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6f8400640 1 Processor -- start 2024-04-24T08:26:29.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.132+0000 7ff6f8400640 1 -- start start 2024-04-24T08:26:29.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f8400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8005d90 0x7ff6f01dc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f8400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6f0142fd0 0x7ff6f0149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f8400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f009b650 0x7ff6f009bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f8400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f0144a90 con 0x7ff6f0142fd0 2024-04-24T08:26:29.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f8400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f0144910 con 0x7ff6d8005d90 2024-04-24T08:26:29.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f8400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f00b4630 con 0x7ff6f009b650 2024-04-24T08:26:29.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f5000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6f0142fd0 0x7ff6f0149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f5000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6f0142fd0 0x7ff6f0149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54186/0 (socket says 172.21.15.88:54186) 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f5000640 1 -- 172.21.15.88:0/1670546616 learned_addr learned my addr 172.21.15.88:0/1670546616 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f5a00640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8005d90 0x7ff6f01dc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f6400640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f009b650 0x7ff6f009bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f5000640 1 -- 172.21.15.88:0/1670546616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f009b650 msgr2=0x7ff6f009bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f5000640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f009b650 0x7ff6f009bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f5000640 1 -- 172.21.15.88:0/1670546616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8005d90 msgr2=0x7ff6f01dc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f5000640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8005d90 0x7ff6f01dc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f5000640 1 -- 172.21.15.88:0/1670546616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f014aa20 con 0x7ff6f0142fd0 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f6400640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f009b650 0x7ff6f009bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f5000640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6f0142fd0 0x7ff6f0149a00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0119d0 tx=0x7ff6dc011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6ed600640 1 -- 172.21.15.88:0/1670546616 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc00fb50 con 0x7ff6f0142fd0 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6ed600640 1 -- 172.21.15.88:0/1670546616 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6dc00fcf0 con 0x7ff6f0142fd0 2024-04-24T08:26:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6ed600640 1 -- 172.21.15.88:0/1670546616 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc00fea0 con 0x7ff6f0142fd0 2024-04-24T08:26:29.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f8400640 1 -- 172.21.15.88:0/1670546616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f0149200 con 0x7ff6f0142fd0 2024-04-24T08:26:29.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f8400640 1 -- 172.21.15.88:0/1670546616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f00b0b00 con 0x7ff6f0142fd0 2024-04-24T08:26:29.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6f8400640 1 -- 172.21.15.88:0/1670546616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f0068b20 con 0x7ff6f0142fd0 2024-04-24T08:26:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.136+0000 7ff6ed600640 1 -- 172.21.15.88:0/1670546616 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff6dc012040 con 0x7ff6f0142fd0 2024-04-24T08:26:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.140+0000 7ff6ed600640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff6d00683b0 0x7ff6d006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.140+0000 7ff6ed600640 1 -- 172.21.15.88:0/1670546616 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7ff6dc086fa0 con 0x7ff6f0142fd0 2024-04-24T08:26:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.140+0000 7ff6f5a00640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff6d00683b0 0x7ff6d006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.140+0000 7ff6f5a00640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff6d00683b0 0x7ff6d006a870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40ac000 tx=0x7ff6e40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:29.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.144+0000 7ff6ed600640 1 -- 172.21.15.88:0/1670546616 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff6dc019030 con 0x7ff6f0142fd0 2024-04-24T08:26:29.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.328+0000 7ff6f8400640 1 -- 172.21.15.88:0/1670546616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff6f013ed90 con 0x7ff6f0142fd0 2024-04-24T08:26:29.333 INFO:tasks.ceph.mon.a.smithi088.stderr:2024-04-24T08:26:29.332+0000 7fc2ae200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T08:26:29.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.332+0000 7ff6ed600640 1 -- 172.21.15.88:0/1670546616 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7ff6dc057610 con 0x7ff6f0142fd0 2024-04-24T08:26:29.336 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T08:26:29.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.336+0000 7ff6f8400640 1 -- 172.21.15.88:0/1670546616 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff6d00683b0 msgr2=0x7ff6d006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:29.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.336+0000 7ff6f8400640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff6d00683b0 0x7ff6d006a870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40ac000 tx=0x7ff6e40a6000 comp rx=0 tx=0).stop 2024-04-24T08:26:29.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.336+0000 7ff6f8400640 1 -- 172.21.15.88:0/1670546616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6f0142fd0 msgr2=0x7ff6f0149a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:29.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.336+0000 7ff6f8400640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6f0142fd0 0x7ff6f0149a00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0119d0 tx=0x7ff6dc011e90 comp rx=0 tx=0).stop 2024-04-24T08:26:29.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.336+0000 7ff6f8400640 1 -- 172.21.15.88:0/1670546616 shutdown_connections 2024-04-24T08:26:29.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.336+0000 7ff6f8400640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff6d00683b0 0x7ff6d006a870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.336+0000 7ff6f8400640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6f009b650 0x7ff6f009bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.336+0000 7ff6f8400640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6f0142fd0 0x7ff6f0149a00 secure :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0119d0 tx=0x7ff6dc011e90 comp rx=0 tx=0).stop 2024-04-24T08:26:29.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.336+0000 7ff6f8400640 1 --2- 172.21.15.88:0/1670546616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8005d90 0x7ff6f01dc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.336+0000 7ff6f8400640 1 -- 172.21.15.88:0/1670546616 >> 172.21.15.88:0/1670546616 conn(0x7ff6f00b9420 msgr2=0x7ff6f0144c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:29.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.336+0000 7ff6f8400640 1 -- 172.21.15.88:0/1670546616 shutdown_connections 2024-04-24T08:26:29.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.336+0000 7ff6f8400640 1 -- 172.21.15.88:0/1670546616 wait complete. 2024-04-24T08:26:29.347 INFO:tasks.ceph.mds.a.smithi088.stderr: -2818> 2024-04-24T08:26:13.949+0000 7fdb31600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T08:26:29.366 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-24T08:26:29.402 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2024-04-24T08:26:29.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.504+0000 7faa0c800640 1 Processor -- start 2024-04-24T08:26:29.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.504+0000 7faa0c800640 1 -- start start 2024-04-24T08:26:29.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.504+0000 7faa0c800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa040b4c90 0x7faa04145f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.504+0000 7faa0c800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0409e7a0 0x7faa041464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.504+0000 7faa0c800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0406d4f0 con 0x7faa0406e490 2024-04-24T08:26:29.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.504+0000 7faa0c800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7faa0406d2a0 con 0x7faa040b4c90 2024-04-24T08:26:29.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.504+0000 7faa0c800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faa0406d7d0 con 0x7faa0409e7a0 2024-04-24T08:26:29.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa09e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa040b4c90 0x7faa04145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa09400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7faa0406e490 0x7faa0409e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:45490/0 (socket says 172.21.15.88:45490) 2024-04-24T08:26:29.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa09400640 1 -- 172.21.15.88:0/2366898279 learned_addr learned my addr 172.21.15.88:0/2366898279 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:29.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa0a800640 1 --2- 172.21.15.88:0/2366898279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0409e7a0 0x7faa041464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa09e00640 1 -- 172.21.15.88:0/2366898279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0409e7a0 msgr2=0x7faa041464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:29.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa09e00640 1 --2- 172.21.15.88:0/2366898279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0409e7a0 0x7faa041464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa09e00640 1 -- 172.21.15.88:0/2366898279 >> v1:172.21.15.142:6789/0 conn(0x7faa0406e490 legacy=0x7faa0409e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:29.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa09e00640 1 -- 172.21.15.88:0/2366898279 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0409c570 con 0x7faa040b4c90 2024-04-24T08:26:29.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa0a800640 1 --2- 172.21.15.88:0/2366898279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0409e7a0 0x7faa041464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:26:29.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa09e00640 1 --2- 172.21.15.88:0/2366898279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa040b4c90 0x7faa04145f80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80097c0 tx=0x7fa9f801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=573380330f7e87c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:29.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa08a00640 1 -- 172.21.15.88:0/2366898279 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80b0070 con 0x7faa040b4c90 2024-04-24T08:26:29.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa08a00640 1 -- 172.21.15.88:0/2366898279 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f80ab600 con 0x7faa040b4c90 2024-04-24T08:26:29.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.508+0000 7faa08a00640 1 -- 172.21.15.88:0/2366898279 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80ab9d0 con 0x7faa040b4c90 2024-04-24T08:26:29.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 -- 172.21.15.88:0/2366898279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa040b4c90 msgr2=0x7faa04145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:29.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 --2- 172.21.15.88:0/2366898279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa040b4c90 0x7faa04145f80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80097c0 tx=0x7fa9f801c410 comp rx=0 tx=0).stop 2024-04-24T08:26:29.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 -- 172.21.15.88:0/2366898279 shutdown_connections 2024-04-24T08:26:29.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 --2- 172.21.15.88:0/2366898279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa0409e7a0 0x7faa041464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 --2- 172.21.15.88:0/2366898279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa040b4c90 0x7faa04145f80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 -- 172.21.15.88:0/2366898279 >> 172.21.15.88:0/2366898279 conn(0x7faa040b9690 msgr2=0x7faa040b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:29.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 -- 172.21.15.88:0/2366898279 shutdown_connections 2024-04-24T08:26:29.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 -- 172.21.15.88:0/2366898279 wait complete. 2024-04-24T08:26:29.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 Processor -- start 2024-04-24T08:26:29.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 -- start start 2024-04-24T08:26:29.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0406e490 0x7faa040af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0409e7a0 0x7faa04140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa040b4c90 0x7faa041e0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faa04152fc0 con 0x7faa0409e7a0 2024-04-24T08:26:29.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faa04152e40 con 0x7faa0406e490 2024-04-24T08:26:29.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0c800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faa04153140 con 0x7faa040b4c90 2024-04-24T08:26:29.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa09400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0409e7a0 0x7faa04140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa09e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0406e490 0x7faa040af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa09400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0409e7a0 0x7faa04140820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54204/0 (socket says 172.21.15.88:54204) 2024-04-24T08:26:29.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa09400640 1 -- 172.21.15.88:0/419734283 learned_addr learned my addr 172.21.15.88:0/419734283 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:29.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa0a800640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa040b4c90 0x7faa041e0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa09400640 1 -- 172.21.15.88:0/419734283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa040b4c90 msgr2=0x7faa041e0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:29.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa09400640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa040b4c90 0x7faa041e0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa09400640 1 -- 172.21.15.88:0/419734283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0406e490 msgr2=0x7faa040af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:29.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa09400640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0406e490 0x7faa040af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:29.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.512+0000 7faa09400640 1 -- 172.21.15.88:0/419734283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa041417d0 con 0x7faa0409e7a0 2024-04-24T08:26:29.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.516+0000 7faa09400640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0409e7a0 0x7faa04140820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400c530 tx=0x7fa9f400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:29.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.516+0000 7fa9fe000640 1 -- 172.21.15.88:0/419734283 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4017070 con 0x7faa0409e7a0 2024-04-24T08:26:29.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.516+0000 7fa9fe000640 1 -- 172.21.15.88:0/419734283 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f4005cf0 con 0x7faa0409e7a0 2024-04-24T08:26:29.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.516+0000 7fa9fe000640 1 -- 172.21.15.88:0/419734283 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40072d0 con 0x7faa0409e7a0 2024-04-24T08:26:29.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.516+0000 7faa0c800640 1 -- 172.21.15.88:0/419734283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa040af770 con 0x7faa0409e7a0 2024-04-24T08:26:29.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.516+0000 7faa0c800640 1 -- 172.21.15.88:0/419734283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa04141a40 con 0x7faa0409e7a0 2024-04-24T08:26:29.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.516+0000 7faa0c800640 1 -- 172.21.15.88:0/419734283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa04068c00 con 0x7faa0409e7a0 2024-04-24T08:26:29.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.516+0000 7fa9fe000640 1 -- 172.21.15.88:0/419734283 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa9f401a070 con 0x7faa0409e7a0 2024-04-24T08:26:29.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.516+0000 7fa9fe000640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9e8068380 0x7fa9e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:29.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.516+0000 7fa9fe000640 1 -- 172.21.15.88:0/419734283 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5795+0+0 (secure 0 0 0) 0x7fa9f4085c60 con 0x7faa0409e7a0 2024-04-24T08:26:29.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.516+0000 7faa09e00640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9e8068380 0x7fa9e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:29.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.520+0000 7faa09e00640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9e8068380 0x7fa9e806a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80ad000 tx=0x7fa9f80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:29.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.520+0000 7fa9fe000640 1 -- 172.21.15.88:0/419734283 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa9f4055b60 con 0x7faa0409e7a0 2024-04-24T08:26:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:29.712+0000 7faa0c800640 1 -- 172.21.15.88:0/419734283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7faa040b44c0 con 0x7faa0409e7a0 2024-04-24T08:26:30.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.372+0000 7fa9fe000640 1 -- 172.21.15.88:0/419734283 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7fa9f4059e60 con 0x7faa0409e7a0 2024-04-24T08:26:30.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.376+0000 7faa0c800640 1 -- 172.21.15.88:0/419734283 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9e8068380 msgr2=0x7fa9e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:30.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.376+0000 7faa0c800640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9e8068380 0x7fa9e806a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80ad000 tx=0x7fa9f80a6000 comp rx=0 tx=0).stop 2024-04-24T08:26:30.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.376+0000 7faa0c800640 1 -- 172.21.15.88:0/419734283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0409e7a0 msgr2=0x7faa04140820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:30.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.376+0000 7faa0c800640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0409e7a0 0x7faa04140820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400c530 tx=0x7fa9f400c930 comp rx=0 tx=0).stop 2024-04-24T08:26:30.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.376+0000 7faa0c800640 1 -- 172.21.15.88:0/419734283 shutdown_connections 2024-04-24T08:26:30.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.376+0000 7faa0c800640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa9e8068380 0x7fa9e806a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:30.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.376+0000 7faa0c800640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa040b4c90 0x7faa041e0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:30.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.376+0000 7faa0c800640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa0409e7a0 0x7faa04140820 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:30.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.376+0000 7faa0c800640 1 --2- 172.21.15.88:0/419734283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0406e490 0x7faa040af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:30.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.376+0000 7faa0c800640 1 -- 172.21.15.88:0/419734283 >> 172.21.15.88:0/419734283 conn(0x7faa040b9690 msgr2=0x7faa04143aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:30.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.376+0000 7faa0c800640 1 -- 172.21.15.88:0/419734283 shutdown_connections 2024-04-24T08:26:30.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.376+0000 7faa0c800640 1 -- 172.21.15.88:0/419734283 wait complete. 2024-04-24T08:26:30.404 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-24T08:26:30.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc935400640 1 Processor -- start 2024-04-24T08:26:30.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc935400640 1 -- start start 2024-04-24T08:26:30.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc935400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9300b9d90 0x7fc9300b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:30.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc935400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc930148560 0x7fc930144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:30.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc935400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9300b5b00 con 0x7fc9301480e0 2024-04-24T08:26:30.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc935400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc9300ba170 con 0x7fc930148560 2024-04-24T08:26:30.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc935400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc93009dc10 con 0x7fc9300b9d90 2024-04-24T08:26:30.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc92f200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc930148560 0x7fc930144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:30.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc92f200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc930148560 0x7fc930144610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54212/0 (socket says 172.21.15.88:54212) 2024-04-24T08:26:30.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc92f200640 1 -- 172.21.15.88:0/1881468925 learned_addr learned my addr 172.21.15.88:0/1881468925 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc92e800640 1 --2- 172.21.15.88:0/1881468925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9300b9d90 0x7fc9300b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc92f200640 1 -- 172.21.15.88:0/1881468925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9300b9d90 msgr2=0x7fc9300b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc92f200640 1 --2- 172.21.15.88:0/1881468925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9300b9d90 0x7fc9300b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc92f200640 1 -- 172.21.15.88:0/1881468925 >> v1:172.21.15.142:6789/0 conn(0x7fc9301480e0 legacy=0x7fc930143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.588+0000 7fc92f200640 1 -- 172.21.15.88:0/1881468925 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93009d410 con 0x7fc930148560 2024-04-24T08:26:30.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc92f200640 1 --2- 172.21.15.88:0/1881468925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc930148560 0x7fc930144610 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc928009e50 tx=0x7fc92801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b707980dcb03e6fb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:30.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc92de00640 1 -- 172.21.15.88:0/1881468925 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9280a5660 con 0x7fc930148560 2024-04-24T08:26:30.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc92de00640 1 -- 172.21.15.88:0/1881468925 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9280a5800 con 0x7fc930148560 2024-04-24T08:26:30.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc92de00640 1 -- 172.21.15.88:0/1881468925 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9280a5bd0 con 0x7fc930148560 2024-04-24T08:26:30.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc935400640 1 -- 172.21.15.88:0/1881468925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc930148560 msgr2=0x7fc930144610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:30.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc935400640 1 --2- 172.21.15.88:0/1881468925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc930148560 0x7fc930144610 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc928009e50 tx=0x7fc92801c9a0 comp rx=0 tx=0).stop 2024-04-24T08:26:30.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc935400640 1 -- 172.21.15.88:0/1881468925 shutdown_connections 2024-04-24T08:26:30.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc935400640 1 --2- 172.21.15.88:0/1881468925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc930148560 0x7fc930144610 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:30.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc935400640 1 --2- 172.21.15.88:0/1881468925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9300b9d90 0x7fc9300b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:30.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc935400640 1 -- 172.21.15.88:0/1881468925 >> 172.21.15.88:0/1881468925 conn(0x7fc93006c0d0 msgr2=0x7fc9300b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:30.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc935400640 1 -- 172.21.15.88:0/1881468925 shutdown_connections 2024-04-24T08:26:30.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc935400640 1 -- 172.21.15.88:0/1881468925 wait complete. 2024-04-24T08:26:30.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc935400640 1 Processor -- start 2024-04-24T08:26:30.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.592+0000 7fc935400640 1 -- start start 2024-04-24T08:26:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc935400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9300b9d90 0x7fc9300705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc935400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9301480e0 0x7fc9300727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc935400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc930148560 0x7fc930070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc935400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc930152010 con 0x7fc9301480e0 2024-04-24T08:26:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc935400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc930151e90 con 0x7fc9300b9d90 2024-04-24T08:26:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc935400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc930152190 con 0x7fc930148560 2024-04-24T08:26:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc925e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9301480e0 0x7fc9300727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc925e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9301480e0 0x7fc9300727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54228/0 (socket says 172.21.15.88:54228) 2024-04-24T08:26:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc925e00640 1 -- 172.21.15.88:0/4263464900 learned_addr learned my addr 172.21.15.88:0/4263464900 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc92e800640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9300b9d90 0x7fc9300705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc92f200640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc930148560 0x7fc930070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc925e00640 1 -- 172.21.15.88:0/4263464900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc930148560 msgr2=0x7fc930070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc925e00640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc930148560 0x7fc930070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc925e00640 1 -- 172.21.15.88:0/4263464900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9300b9d90 msgr2=0x7fc9300705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc925e00640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9300b9d90 0x7fc9300705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc925e00640 1 -- 172.21.15.88:0/4263464900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc930072f00 con 0x7fc9301480e0 2024-04-24T08:26:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc925e00640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9301480e0 0x7fc9300727b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc91800c420 tx=0x7fc91800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc927400640 1 -- 172.21.15.88:0/4263464900 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9180052d0 con 0x7fc9301480e0 2024-04-24T08:26:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc927400640 1 -- 172.21.15.88:0/4263464900 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc918005470 con 0x7fc9301480e0 2024-04-24T08:26:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc927400640 1 -- 172.21.15.88:0/4263464900 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918007260 con 0x7fc9301480e0 2024-04-24T08:26:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc935400640 1 -- 172.21.15.88:0/4263464900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9300731e0 con 0x7fc9301480e0 2024-04-24T08:26:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc935400640 1 -- 172.21.15.88:0/4263464900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc930071c90 con 0x7fc9301480e0 2024-04-24T08:26:30.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.596+0000 7fc935400640 1 -- 172.21.15.88:0/4263464900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc930068ca0 con 0x7fc9301480e0 2024-04-24T08:26:30.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.600+0000 7fc927400640 1 -- 172.21.15.88:0/4263464900 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc918007400 con 0x7fc9301480e0 2024-04-24T08:26:30.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.600+0000 7fc927400640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc90c068380 0x7fc90c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:30.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.600+0000 7fc927400640 1 -- 172.21.15.88:0/4263464900 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5795+0+0 (secure 0 0 0) 0x7fc918085de0 con 0x7fc9301480e0 2024-04-24T08:26:30.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.600+0000 7fc92e800640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc90c068380 0x7fc90c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:30.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.600+0000 7fc92e800640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc90c068380 0x7fc90c06a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc920007a60 tx=0x7fc920008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:30.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.604+0000 7fc927400640 1 -- 172.21.15.88:0/4263464900 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc918055d80 con 0x7fc9301480e0 2024-04-24T08:26:30.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:30.760+0000 7fc935400640 1 -- 172.21.15.88:0/4263464900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc93006cae0 con 0x7fc9301480e0 2024-04-24T08:26:31.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.384+0000 7fc927400640 1 -- 172.21.15.88:0/4263464900 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7fc91805a080 con 0x7fc9301480e0 2024-04-24T08:26:31.388 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2024-04-24T08:26:31.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.388+0000 7fc935400640 1 -- 172.21.15.88:0/4263464900 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc90c068380 msgr2=0x7fc90c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:31.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.388+0000 7fc935400640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc90c068380 0x7fc90c06a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc920007a60 tx=0x7fc920008040 comp rx=0 tx=0).stop 2024-04-24T08:26:31.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.388+0000 7fc935400640 1 -- 172.21.15.88:0/4263464900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9301480e0 msgr2=0x7fc9300727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:31.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.388+0000 7fc935400640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9301480e0 0x7fc9300727b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc91800c420 tx=0x7fc91800c8e0 comp rx=0 tx=0).stop 2024-04-24T08:26:31.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.388+0000 7fc935400640 1 -- 172.21.15.88:0/4263464900 shutdown_connections 2024-04-24T08:26:31.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.388+0000 7fc935400640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc90c068380 0x7fc90c06a840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:31.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.388+0000 7fc935400640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc930148560 0x7fc930070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:31.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.388+0000 7fc935400640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9301480e0 0x7fc9300727b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:31.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.388+0000 7fc935400640 1 --2- 172.21.15.88:0/4263464900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9300b9d90 0x7fc9300705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:31.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.388+0000 7fc935400640 1 -- 172.21.15.88:0/4263464900 >> 172.21.15.88:0/4263464900 conn(0x7fc93006c0d0 msgr2=0x7fc9300b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:31.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.388+0000 7fc935400640 1 -- 172.21.15.88:0/4263464900 shutdown_connections 2024-04-24T08:26:31.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.388+0000 7fc935400640 1 -- 172.21.15.88:0/4263464900 wait complete. 2024-04-24T08:26:31.412 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-24T08:26:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5e1e00640 1 Processor -- start 2024-04-24T08:26:31.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5e1e00640 1 -- start start 2024-04-24T08:26:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5e1e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd5dc0b9d90 0x7fd5dc06d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5e1e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc1461e0 0x7fd5dc150470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5e1e00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc0ba170 con 0x7fd5dc0b3e20 2024-04-24T08:26:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5e1e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd5dc09cca0 con 0x7fd5dc0b9d90 2024-04-24T08:26:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5e1e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc149930 con 0x7fd5dc1461e0 2024-04-24T08:26:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5d2000640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd5dc0b3e20 0x7fd5dc06d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52948/0 (socket says 172.21.15.88:52948) 2024-04-24T08:26:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5d2000640 1 -- 172.21.15.88:0/1288998038 learned_addr learned my addr 172.21.15.88:0/1288998038 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5daa00640 1 --2- 172.21.15.88:0/1288998038 >> v2:172.21.15.142:3300/0 conn(0x7fd5dc0b9d90 0x7fd5dc06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5db400640 1 --2- 172.21.15.88:0/1288998038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc1461e0 0x7fd5dc150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3411074891 0 0) 0x7fd5dc0ba170 con 0x7fd5dc0b3e20 2024-04-24T08:26:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5c0003530 con 0x7fd5dc0b3e20 2024-04-24T08:26:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3632662382 0 0) 0x7fd5c0003530 con 0x7fd5dc0b3e20 2024-04-24T08:26:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc1461e0 msgr2=0x7fd5dc150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 --2- 172.21.15.88:0/1288998038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc1461e0 0x7fd5dc150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 >> v2:172.21.15.142:3300/0 conn(0x7fd5dc0b9d90 msgr2=0x7fd5dc06d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 --2- 172.21.15.88:0/1288998038 >> v2:172.21.15.142:3300/0 conn(0x7fd5dc0b9d90 0x7fd5dc06d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc149c10 con 0x7fd5dc0b3e20 2024-04-24T08:26:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7fd5c4001680 con 0x7fd5dc0b3e20 2024-04-24T08:26:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 >> v1:172.21.15.88:6789/0 conn(0x7fd5dc0b3e20 legacy=0x7fd5dc06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 --2- 172.21.15.88:0/1288998038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c00039c0 0x7fd5c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 --2- 172.21.15.88:0/1288998038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5c0004810 0x7fd5c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 --2- 172.21.15.88:0/1288998038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc1461e0 0x7fd5c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc09cca0 con 0x7fd5c00039c0 2024-04-24T08:26:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.548+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc149930 con 0x7fd5c0004810 2024-04-24T08:26:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c000b9d0 con 0x7fd5dc1461e0 2024-04-24T08:26:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5daa00640 1 --2- 172.21.15.88:0/1288998038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c00039c0 0x7fd5c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5d2000640 1 --2- 172.21.15.88:0/1288998038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5c0004810 0x7fd5c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5db400640 1 --2- 172.21.15.88:0/1288998038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc1461e0 0x7fd5c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5daa00640 1 -- 172.21.15.88:0/1288998038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc1461e0 msgr2=0x7fd5c00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5daa00640 1 --2- 172.21.15.88:0/1288998038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc1461e0 0x7fd5c00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5daa00640 1 -- 172.21.15.88:0/1288998038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5c0004810 msgr2=0x7fd5c0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5daa00640 1 --2- 172.21.15.88:0/1288998038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5c0004810 0x7fd5c0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5daa00640 1 -- 172.21.15.88:0/1288998038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c0003530 con 0x7fd5c00039c0 2024-04-24T08:26:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5daa00640 1 --2- 172.21.15.88:0/1288998038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c00039c0 0x7fd5c0003de0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00e170 tx=0x7fd5cc01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d31d645d10f1804 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0b2070 con 0x7fd5c00039c0 2024-04-24T08:26:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc0a59b0 con 0x7fd5c00039c0 2024-04-24T08:26:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.552+0000 7fd5da000640 1 -- 172.21.15.88:0/1288998038 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc009c10 con 0x7fd5c00039c0 2024-04-24T08:26:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 -- 172.21.15.88:0/1288998038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c00039c0 msgr2=0x7fd5c0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 --2- 172.21.15.88:0/1288998038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c00039c0 0x7fd5c0003de0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00e170 tx=0x7fd5cc01cca0 comp rx=0 tx=0).stop 2024-04-24T08:26:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5db400640 1 -- 172.21.15.88:0/1288998038 reap_dead start 2024-04-24T08:26:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 -- 172.21.15.88:0/1288998038 shutdown_connections 2024-04-24T08:26:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 -- 172.21.15.88:0/1288998038 >> 172.21.15.88:0/1288998038 conn(0x7fd5dc06c0d0 msgr2=0x7fd5dc0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 -- 172.21.15.88:0/1288998038 shutdown_connections 2024-04-24T08:26:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 -- 172.21.15.88:0/1288998038 wait complete. 2024-04-24T08:26:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 Processor -- start 2024-04-24T08:26:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 -- start start 2024-04-24T08:26:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c00039c0 0x7fd5dc072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc070cf0 0x7fd5dc1e3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5dc1e3970 0x7fd5dc143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc09c020 con 0x7fd5c00039c0 2024-04-24T08:26:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc06e070 con 0x7fd5dc1e3970 2024-04-24T08:26:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc150c80 con 0x7fd5dc070cf0 2024-04-24T08:26:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5daa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c00039c0 0x7fd5dc072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5daa00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c00039c0 0x7fd5dc072f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54242/0 (socket says 172.21.15.88:54242) 2024-04-24T08:26:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5daa00640 1 -- 172.21.15.88:0/2219916288 learned_addr learned my addr 172.21.15.88:0/2219916288 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5d2000640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc070cf0 0x7fd5dc1e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5db400640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5dc1e3970 0x7fd5dc143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5daa00640 1 -- 172.21.15.88:0/2219916288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc070cf0 msgr2=0x7fd5dc1e3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5daa00640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc070cf0 0x7fd5dc1e3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5daa00640 1 -- 172.21.15.88:0/2219916288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5dc1e3970 msgr2=0x7fd5dc143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5daa00640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5dc1e3970 0x7fd5dc143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5daa00640 1 -- 172.21.15.88:0/2219916288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc0735c0 con 0x7fd5c00039c0 2024-04-24T08:26:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5db400640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5dc1e3970 0x7fd5dc143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5daa00640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c00039c0 0x7fd5dc072f40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0b0040 tx=0x7fd5cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5d3e00640 1 -- 172.21.15.88:0/2219916288 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0b2040 con 0x7fd5c00039c0 2024-04-24T08:26:31.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5d3e00640 1 -- 172.21.15.88:0/2219916288 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc0a57b0 con 0x7fd5c00039c0 2024-04-24T08:26:31.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5d3e00640 1 -- 172.21.15.88:0/2219916288 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0ad660 con 0x7fd5c00039c0 2024-04-24T08:26:31.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.556+0000 7fd5e1e00640 1 -- 172.21.15.88:0/2219916288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc072630 con 0x7fd5c00039c0 2024-04-24T08:26:31.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.560+0000 7fd5e1e00640 1 -- 172.21.15.88:0/2219916288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5dc071ef0 con 0x7fd5c00039c0 2024-04-24T08:26:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.560+0000 7fd5e1e00640 1 -- 172.21.15.88:0/2219916288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc068ca0 con 0x7fd5c00039c0 2024-04-24T08:26:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.560+0000 7fd5d3e00640 1 -- 172.21.15.88:0/2219916288 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd5cc0ad800 con 0x7fd5c00039c0 2024-04-24T08:26:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.560+0000 7fd5d3e00640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd5b80683b0 0x7fd5b806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.560+0000 7fd5d3e00640 1 -- 172.21.15.88:0/2219916288 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5357+0+0 (secure 0 0 0) 0x7fd5cc120810 con 0x7fd5c00039c0 2024-04-24T08:26:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.560+0000 7fd5d2000640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd5b80683b0 0x7fd5b806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.560+0000 7fd5d2000640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd5b80683b0 0x7fd5b806a870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4001060 tx=0x7fd5c4007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.564+0000 7fd5d3e00640 1 -- 172.21.15.88:0/2219916288 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd5cc016a30 con 0x7fd5c00039c0 2024-04-24T08:26:31.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:31.720+0000 7fd5e1e00640 1 -- 172.21.15.88:0/2219916288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd5dc0aed80 con 0x7fd5c00039c0 2024-04-24T08:26:32.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.384+0000 7fd5d3e00640 1 -- 172.21.15.88:0/2219916288 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7fd5cc0f0e90 con 0x7fd5c00039c0 2024-04-24T08:26:32.389 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2024-04-24T08:26:32.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.388+0000 7fd5e1e00640 1 -- 172.21.15.88:0/2219916288 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd5b80683b0 msgr2=0x7fd5b806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:32.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.388+0000 7fd5e1e00640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd5b80683b0 0x7fd5b806a870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4001060 tx=0x7fd5c4007900 comp rx=0 tx=0).stop 2024-04-24T08:26:32.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.388+0000 7fd5e1e00640 1 -- 172.21.15.88:0/2219916288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c00039c0 msgr2=0x7fd5dc072f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:32.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.388+0000 7fd5e1e00640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c00039c0 0x7fd5dc072f40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0b0040 tx=0x7fd5cc009750 comp rx=0 tx=0).stop 2024-04-24T08:26:32.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.388+0000 7fd5e1e00640 1 -- 172.21.15.88:0/2219916288 shutdown_connections 2024-04-24T08:26:32.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.388+0000 7fd5e1e00640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd5b80683b0 0x7fd5b806a870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.388+0000 7fd5e1e00640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5dc1e3970 0x7fd5dc143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.388+0000 7fd5e1e00640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5dc070cf0 0x7fd5dc1e3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.388+0000 7fd5e1e00640 1 --2- 172.21.15.88:0/2219916288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c00039c0 0x7fd5dc072f40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.388+0000 7fd5e1e00640 1 -- 172.21.15.88:0/2219916288 >> 172.21.15.88:0/2219916288 conn(0x7fd5dc06c0d0 msgr2=0x7fd5dc144fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:32.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.388+0000 7fd5e1e00640 1 -- 172.21.15.88:0/2219916288 shutdown_connections 2024-04-24T08:26:32.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.388+0000 7fd5e1e00640 1 -- 172.21.15.88:0/2219916288 wait complete. 2024-04-24T08:26:32.419 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-24T08:26:32.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.552+0000 7f51cb200640 1 Processor -- start 2024-04-24T08:26:32.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.552+0000 7f51cb200640 1 -- start start 2024-04-24T08:26:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51cb200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51c40b01a0 0x7f51c406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51cb200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51c413f090 0x7f51c414f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51cb200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51c40b0580 con 0x7f51c40ae4e0 2024-04-24T08:26:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51cb200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f51c40b59d0 con 0x7f51c413f090 2024-04-24T08:26:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51cb200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f51c40ae970 con 0x7f51c40b01a0 2024-04-24T08:26:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51bb400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f51c40ae4e0 0x7f51c413e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52960/0 (socket says 172.21.15.88:52960) 2024-04-24T08:26:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51bb400640 1 -- 172.21.15.88:0/826712037 learned_addr learned my addr 172.21.15.88:0/826712037 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51c9200640 1 --2- 172.21.15.88:0/826712037 >> v2:172.21.15.142:3300/0 conn(0x7f51c413f090 0x7f51c414f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51c3e00640 1 --2- 172.21.15.88:0/826712037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51c40b01a0 0x7f51c406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51c3400640 1 -- 172.21.15.88:0/826712037 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1068398202 0 0) 0x7f51c40b0580 con 0x7f51c40ae4e0 2024-04-24T08:26:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51c3400640 1 -- 172.21.15.88:0/826712037 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51a8003530 con 0x7f51c40ae4e0 2024-04-24T08:26:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51c9200640 1 -- 172.21.15.88:0/826712037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51c40b01a0 msgr2=0x7f51c406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51c9200640 1 --2- 172.21.15.88:0/826712037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51c40b01a0 0x7f51c406d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51c9200640 1 -- 172.21.15.88:0/826712037 >> v1:172.21.15.88:6789/0 conn(0x7f51c40ae4e0 legacy=0x7f51c413e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51c9200640 1 -- 172.21.15.88:0/826712037 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c40b53a0 con 0x7f51c413f090 2024-04-24T08:26:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.556+0000 7f51c3e00640 1 --2- 172.21.15.88:0/826712037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51c40b01a0 0x7f51c406d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T08:26:32.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51c9200640 1 --2- 172.21.15.88:0/826712037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51c413f090 0x7f51c414f430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009d90 tx=0x7f51bc01c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cf6aed53ac639fd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:32.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51c3400640 1 -- 172.21.15.88:0/826712037 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0b2070 con 0x7f51c413f090 2024-04-24T08:26:32.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51c3400640 1 -- 172.21.15.88:0/826712037 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51bc0a5720 con 0x7f51c413f090 2024-04-24T08:26:32.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51c3400640 1 -- 172.21.15.88:0/826712037 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0a5af0 con 0x7f51c413f090 2024-04-24T08:26:32.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51cb200640 1 -- 172.21.15.88:0/826712037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51c413f090 msgr2=0x7f51c414f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:32.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51cb200640 1 --2- 172.21.15.88:0/826712037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51c413f090 0x7f51c414f430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009d90 tx=0x7f51bc01c850 comp rx=0 tx=0).stop 2024-04-24T08:26:32.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51cb200640 1 -- 172.21.15.88:0/826712037 shutdown_connections 2024-04-24T08:26:32.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51cb200640 1 --2- 172.21.15.88:0/826712037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51c413f090 0x7f51c414f430 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51cb200640 1 --2- 172.21.15.88:0/826712037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51c40b01a0 0x7f51c406d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51cb200640 1 -- 172.21.15.88:0/826712037 >> 172.21.15.88:0/826712037 conn(0x7f51c40b9690 msgr2=0x7f51c40b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:32.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51cb200640 1 -- 172.21.15.88:0/826712037 shutdown_connections 2024-04-24T08:26:32.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51cb200640 1 -- 172.21.15.88:0/826712037 wait complete. 2024-04-24T08:26:32.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51cb200640 1 Processor -- start 2024-04-24T08:26:32.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.560+0000 7f51cb200640 1 -- start start 2024-04-24T08:26:32.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51cb200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51c40b01a0 0x7f51c41dd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:32.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51cb200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c413f090 0x7f51c4145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51cb200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51c41dfdd0 0x7f51c41e0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51cb200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f51c409b260 con 0x7f51c413f090 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51cb200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f51c406e470 con 0x7f51c40b01a0 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51cb200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f51c409b3e0 con 0x7f51c41dfdd0 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51bb400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c413f090 0x7f51c4145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51bb400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c413f090 0x7f51c4145580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54246/0 (socket says 172.21.15.88:54246) 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51bb400640 1 -- 172.21.15.88:0/1124946444 learned_addr learned my addr 172.21.15.88:0/1124946444 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51c3e00640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51c40b01a0 0x7f51c41dd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51c9200640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51c41dfdd0 0x7f51c41e0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51bb400640 1 -- 172.21.15.88:0/1124946444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51c41dfdd0 msgr2=0x7f51c41e0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51bb400640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51c41dfdd0 0x7f51c41e0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51bb400640 1 -- 172.21.15.88:0/1124946444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51c40b01a0 msgr2=0x7f51c41dd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51bb400640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51c40b01a0 0x7f51c41dd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51bb400640 1 -- 172.21.15.88:0/1124946444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c40756b0 con 0x7f51c413f090 2024-04-24T08:26:32.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51bb400640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c413f090 0x7f51c4145580 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00c450 tx=0x7f51ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:32.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51c0c00640 1 -- 172.21.15.88:0/1124946444 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ac017070 con 0x7f51c413f090 2024-04-24T08:26:32.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51c0c00640 1 -- 172.21.15.88:0/1124946444 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51ac005cf0 con 0x7f51c413f090 2024-04-24T08:26:32.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51cb200640 1 -- 172.21.15.88:0/1124946444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c4141810 con 0x7f51c413f090 2024-04-24T08:26:32.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51c0c00640 1 -- 172.21.15.88:0/1124946444 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ac007290 con 0x7f51c413f090 2024-04-24T08:26:32.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51cb200640 1 -- 172.21.15.88:0/1124946444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c41dcbb0 con 0x7f51c413f090 2024-04-24T08:26:32.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51cb200640 1 -- 172.21.15.88:0/1124946444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c4068c00 con 0x7f51c413f090 2024-04-24T08:26:32.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.564+0000 7f51c0c00640 1 -- 172.21.15.88:0/1124946444 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f51ac01a070 con 0x7f51c413f090 2024-04-24T08:26:32.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.568+0000 7f51c0c00640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f51a0068380 0x7f51a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:32.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.568+0000 7f51c0c00640 1 -- 172.21.15.88:0/1124946444 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f51ac085920 con 0x7f51c413f090 2024-04-24T08:26:32.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.568+0000 7f51c3e00640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f51a0068380 0x7f51a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:32.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.568+0000 7f51c3e00640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f51a0068380 0x7f51a006a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f51b400b820 tx=0x7f51b400b3a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:32.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.572+0000 7f51c0c00640 1 -- 172.21.15.88:0/1124946444 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f51ac055c20 con 0x7f51c413f090 2024-04-24T08:26:32.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.728+0000 7f51cb200640 1 -- 172.21.15.88:0/1124946444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f51c40b7360 con 0x7f51c413f090 2024-04-24T08:26:32.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.732+0000 7f51c0c00640 1 -- 172.21.15.88:0/1124946444 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f51ac059f20 con 0x7f51c413f090 2024-04-24T08:26:32.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.736+0000 7f51cb200640 1 -- 172.21.15.88:0/1124946444 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f51a0068380 msgr2=0x7f51a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.736+0000 7f51cb200640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f51a0068380 0x7f51a006a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f51b400b820 tx=0x7f51b400b3a0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.736+0000 7f51cb200640 1 -- 172.21.15.88:0/1124946444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c413f090 msgr2=0x7f51c4145580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.736+0000 7f51cb200640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c413f090 0x7f51c4145580 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00c450 tx=0x7f51ac00c910 comp rx=0 tx=0).stop 2024-04-24T08:26:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.736+0000 7f51cb200640 1 -- 172.21.15.88:0/1124946444 shutdown_connections 2024-04-24T08:26:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.736+0000 7f51cb200640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f51a0068380 0x7f51a006a840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.736+0000 7f51cb200640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51c41dfdd0 0x7f51c41e0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.736+0000 7f51cb200640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c413f090 0x7f51c4145580 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.736+0000 7f51cb200640 1 --2- 172.21.15.88:0/1124946444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51c40b01a0 0x7f51c41dd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.736+0000 7f51cb200640 1 -- 172.21.15.88:0/1124946444 >> 172.21.15.88:0/1124946444 conn(0x7f51c40b9690 msgr2=0x7f51c40b8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.736+0000 7f51cb200640 1 -- 172.21.15.88:0/1124946444 shutdown_connections 2024-04-24T08:26:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.736+0000 7f51cb200640 1 -- 172.21.15.88:0/1124946444 wait complete. 2024-04-24T08:26:32.757 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args' 2024-04-24T08:26:32.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2478a00640 1 Processor -- start 2024-04-24T08:26:32.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2478a00640 1 -- start start 2024-04-24T08:26:32.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2478a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24740b9d90 0x7f247406d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:32.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2478a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2474145f20 0x7f24741504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:32.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2478a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24740ba170 con 0x7f247409be30 2024-04-24T08:26:32.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2478a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f247409cd30 con 0x7f2474145f20 2024-04-24T08:26:32.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2478a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f247414a060 con 0x7f24740b9d90 2024-04-24T08:26:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2472800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2474145f20 0x7f24741504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2471e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24740b9d90 0x7f247406d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f246be00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f247409be30 0x7f247406d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:45508/0 (socket says 172.21.15.88:45508) 2024-04-24T08:26:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f246be00640 1 -- 172.21.15.88:0/126632088 learned_addr learned my addr 172.21.15.88:0/126632088 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2472800640 1 -- 172.21.15.88:0/126632088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24740b9d90 msgr2=0x7f247406d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2472800640 1 --2- 172.21.15.88:0/126632088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24740b9d90 0x7f247406d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2472800640 1 -- 172.21.15.88:0/126632088 >> v1:172.21.15.142:6789/0 conn(0x7f247409be30 legacy=0x7f247406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.896+0000 7f2472800640 1 -- 172.21.15.88:0/126632088 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2474149860 con 0x7f2474145f20 2024-04-24T08:26:32.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.900+0000 7f2472800640 1 --2- 172.21.15.88:0/126632088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2474145f20 0x7f24741504e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f246c009d90 tx=0x7f246c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c33dfe22a8fa763b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:32.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.900+0000 7f2471400640 1 -- 172.21.15.88:0/126632088 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c0b1070 con 0x7f2474145f20 2024-04-24T08:26:32.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.900+0000 7f2471400640 1 -- 172.21.15.88:0/126632088 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246c0a4b50 con 0x7f2474145f20 2024-04-24T08:26:32.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.900+0000 7f2471400640 1 -- 172.21.15.88:0/126632088 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c0ac440 con 0x7f2474145f20 2024-04-24T08:26:32.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.900+0000 7f2478a00640 1 -- 172.21.15.88:0/126632088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2474145f20 msgr2=0x7f24741504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:32.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.900+0000 7f2478a00640 1 --2- 172.21.15.88:0/126632088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2474145f20 0x7f24741504e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f246c009d90 tx=0x7f246c01c450 comp rx=0 tx=0).stop 2024-04-24T08:26:32.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.900+0000 7f2478a00640 1 -- 172.21.15.88:0/126632088 shutdown_connections 2024-04-24T08:26:32.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.900+0000 7f2478a00640 1 --2- 172.21.15.88:0/126632088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2474145f20 0x7f24741504e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.900+0000 7f2478a00640 1 --2- 172.21.15.88:0/126632088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24740b9d90 0x7f247406d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.900+0000 7f2478a00640 1 -- 172.21.15.88:0/126632088 >> 172.21.15.88:0/126632088 conn(0x7f247406c0d0 msgr2=0x7f24740b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:32.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.900+0000 7f2478a00640 1 -- 172.21.15.88:0/126632088 shutdown_connections 2024-04-24T08:26:32.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.900+0000 7f2478a00640 1 -- 172.21.15.88:0/126632088 wait complete. 2024-04-24T08:26:32.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2478a00640 1 Processor -- start 2024-04-24T08:26:32.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2478a00640 1 -- start start 2024-04-24T08:26:32.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2478a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247409be30 0x7f24740b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:32.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2478a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24740b9d90 0x7f2474070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:32.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2478a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2474145f20 0x7f2474072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:32.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2478a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2474153a60 con 0x7f24740b9d90 2024-04-24T08:26:32.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2478a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f247406e070 con 0x7f2474145f20 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2478a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2474153be0 con 0x7f247409be30 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f246be00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24740b9d90 0x7f2474070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f246be00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24740b9d90 0x7f2474070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54252/0 (socket says 172.21.15.88:54252) 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f246be00640 1 -- 172.21.15.88:0/1925411442 learned_addr learned my addr 172.21.15.88:0/1925411442 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2472800640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2474145f20 0x7f2474072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2471e00640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247409be30 0x7f24740b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f246be00640 1 -- 172.21.15.88:0/1925411442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247409be30 msgr2=0x7f24740b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f246be00640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247409be30 0x7f24740b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f246be00640 1 -- 172.21.15.88:0/1925411442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2474145f20 msgr2=0x7f2474072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f246be00640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2474145f20 0x7f2474072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f246be00640 1 -- 172.21.15.88:0/1925411442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24740722f0 con 0x7f24740b9d90 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2472800640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2474145f20 0x7f2474072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f246be00640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24740b9d90 0x7f2474070a30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f245c00c7b0 tx=0x7f245c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f246a000640 1 -- 172.21.15.88:0/1925411442 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c018070 con 0x7f24740b9d90 2024-04-24T08:26:32.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f246a000640 1 -- 172.21.15.88:0/1925411442 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f245c0072d0 con 0x7f24740b9d90 2024-04-24T08:26:32.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2478a00640 1 -- 172.21.15.88:0/1925411442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24740725d0 con 0x7f24740b9d90 2024-04-24T08:26:32.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f246a000640 1 -- 172.21.15.88:0/1925411442 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c0047f0 con 0x7f24740b9d90 2024-04-24T08:26:32.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2478a00640 1 -- 172.21.15.88:0/1925411442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2474073290 con 0x7f24740b9d90 2024-04-24T08:26:32.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.904+0000 7f2478a00640 1 -- 172.21.15.88:0/1925411442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2474068b90 con 0x7f24740b9d90 2024-04-24T08:26:32.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.908+0000 7f246a000640 1 -- 172.21.15.88:0/1925411442 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f245c01b070 con 0x7f24740b9d90 2024-04-24T08:26:32.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.908+0000 7f246a000640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2450068380 0x7f245006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:32.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.908+0000 7f246a000640 1 -- 172.21.15.88:0/1925411442 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f245c085b90 con 0x7f24740b9d90 2024-04-24T08:26:32.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.908+0000 7f2471e00640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2450068380 0x7f245006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:32.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.908+0000 7f2471e00640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2450068380 0x7f245006a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f24740b82e0 tx=0x7f2464008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:32.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:32.912+0000 7f246a000640 1 -- 172.21.15.88:0/1925411442 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f245c056440 con 0x7f24740b9d90 2024-04-24T08:26:33.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.124+0000 7f2478a00640 1 -- 172.21.15.88:0/1925411442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]} v 0) -- 0x7f24740aedd0 con 0x7f24740b9d90 2024-04-24T08:26:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.396+0000 7f246a000640 1 -- 172.21.15.88:0/1925411442 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]}]=0 v90) ==== 134+0+0 (secure 0 0 0) 0x7f245c055d40 con 0x7f24740b9d90 2024-04-24T08:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.400+0000 7f2478a00640 1 -- 172.21.15.88:0/1925411442 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2450068380 msgr2=0x7f245006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.400+0000 7f2478a00640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2450068380 0x7f245006a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f24740b82e0 tx=0x7f2464008040 comp rx=0 tx=0).stop 2024-04-24T08:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.400+0000 7f2478a00640 1 -- 172.21.15.88:0/1925411442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24740b9d90 msgr2=0x7f2474070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.400+0000 7f2478a00640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24740b9d90 0x7f2474070a30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f245c00c7b0 tx=0x7f245c00cc70 comp rx=0 tx=0).stop 2024-04-24T08:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.400+0000 7f2478a00640 1 -- 172.21.15.88:0/1925411442 shutdown_connections 2024-04-24T08:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.400+0000 7f2478a00640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2450068380 0x7f245006a840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.400+0000 7f2478a00640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2474145f20 0x7f2474072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.400+0000 7f2478a00640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24740b9d90 0x7f2474070a30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.400+0000 7f2478a00640 1 --2- 172.21.15.88:0/1925411442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247409be30 0x7f24740b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.400+0000 7f2478a00640 1 -- 172.21.15.88:0/1925411442 >> 172.21.15.88:0/1925411442 conn(0x7f247406c0d0 msgr2=0x7f247409d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.400+0000 7f2478a00640 1 -- 172.21.15.88:0/1925411442 shutdown_connections 2024-04-24T08:26:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:33.400+0000 7f2478a00640 1 -- 172.21.15.88:0/1925411442 wait complete. 2024-04-24T08:26:33.425 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed ... ERROR 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner: 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner:ERROR: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1f81fb397ae98da7563d451a78c61574c8f4e6e0/qa/tasks/cephfs/test_cephfs_shell.py", line 602, in test_cd_with_args 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner: output = self.get_cephfs_shell_script_output(script) 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1f81fb397ae98da7563d451a78c61574c8f4e6e0/qa/tasks/cephfs/test_cephfs_shell.py", line 161, in get_cephfs_shell_script_output 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner: return ensure_str(self.run_cephfs_shell_script( 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1f81fb397ae98da7563d451a78c61574c8f4e6e0/qa/tasks/cephfs/test_cephfs_shell.py", line 153, in run_cephfs_shell_script 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner: return mount_x.client_remote.run(args=args, stdout=stdout, 2024-04-24T08:26:33.426 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 127: 'cephfs-shell -b /tmp/test-cephfshf3rsft9' 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner: 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner:Ran 1 test in 43.572s 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner: 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner: 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-24T08:26:33.427 INFO:tasks.cephfs_test_runner:ERROR: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1f81fb397ae98da7563d451a78c61574c8f4e6e0/qa/tasks/cephfs/test_cephfs_shell.py", line 602, in test_cd_with_args 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: output = self.get_cephfs_shell_script_output(script) 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1f81fb397ae98da7563d451a78c61574c8f4e6e0/qa/tasks/cephfs/test_cephfs_shell.py", line 161, in get_cephfs_shell_script_output 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: return ensure_str(self.run_cephfs_shell_script( 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1f81fb397ae98da7563d451a78c61574c8f4e6e0/qa/tasks/cephfs/test_cephfs_shell.py", line 153, in run_cephfs_shell_script 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: return mount_x.client_remote.run(args=args, stdout=stdout, 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-24T08:26:33.428 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-24T08:26:33.429 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-24T08:26:33.429 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 127: 'cephfs-shell -b /tmp/test-cephfshf3rsft9' 2024-04-24T08:26:33.429 INFO:tasks.cephfs_test_runner: 2024-04-24T08:26:33.429 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1f81fb397ae98da7563d451a78c61574c8f4e6e0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-24T08:26:33.670 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4622673fdcf64b2ab13246eda2aa0488 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1f81fb397ae98da7563d451a78c61574c8f4e6e0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-24T08:26:33.672 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-24T08:26:33.681 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-24T08:26:33.722 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-24T08:26:33.722 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T08:26:33.722 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T08:26:33.736 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350304k,nr_inodes=4087576,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=959 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-04-24T08:26:33.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:33.736 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-04-24T08:26:33.786 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T08:26:33.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:33.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T08:26:33.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T08:26:33.849 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2024-04-24T08:26:34.004 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-24T08:26:34.013 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T08:26:34.013 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:26:34.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.144+0000 7f93db800640 1 Processor -- start 2024-04-24T08:26:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.144+0000 7f93db800640 1 -- start start 2024-04-24T08:26:34.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.144+0000 7f93db800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93d4145f20 0x7f93d41514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.144+0000 7f93db800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93d406e030 con 0x7f93d40b9d90 2024-04-24T08:26:34.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.144+0000 7f93db800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93d40ba170 con 0x7f93d409be30 2024-04-24T08:26:34.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.144+0000 7f93db800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f93d409cd30 con 0x7f93d4145f20 2024-04-24T08:26:34.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d8e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f93d40b9d90 0x7f93d406d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52968/0 (socket says 172.21.15.88:52968) 2024-04-24T08:26:34.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d8e00640 1 -- 172.21.15.88:0/542846469 learned_addr learned my addr 172.21.15.88:0/542846469 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:34.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d9800640 1 --2- 172.21.15.88:0/542846469 >> v2:172.21.15.142:3300/0 conn(0x7f93d4145f20 0x7f93d41514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137931652 0 0) 0x7f93d406e030 con 0x7f93d40b9d90 2024-04-24T08:26:34.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93b8003530 con 0x7f93d40b9d90 2024-04-24T08:26:34.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3714282574 0 0) 0x7f93b8003530 con 0x7f93d40b9d90 2024-04-24T08:26:34.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 >> v2:172.21.15.142:3300/0 conn(0x7f93d4145f20 msgr2=0x7f93d41514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:34.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 --2- 172.21.15.88:0/542846469 >> v2:172.21.15.142:3300/0 conn(0x7f93d4145f20 0x7f93d41514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 >> v1:172.21.15.142:6789/0 conn(0x7f93d409be30 legacy=0x7f93d406d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d414a060 con 0x7f93d40b9d90 2024-04-24T08:26:34.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f93c4001680 con 0x7f93d40b9d90 2024-04-24T08:26:34.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 >> v1:172.21.15.88:6789/0 conn(0x7f93d40b9d90 legacy=0x7f93d406d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 --2- 172.21.15.88:0/542846469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b80039c0 0x7f93b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 --2- 172.21.15.88:0/542846469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b8004810 0x7f93b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 --2- 172.21.15.88:0/542846469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b80052f0 0x7f93b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f93d409cd30 con 0x7f93b80039c0 2024-04-24T08:26:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f93b800c1c0 con 0x7f93b80052f0 2024-04-24T08:26:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f93b800c3c0 con 0x7f93b8004810 2024-04-24T08:26:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d8e00640 1 --2- 172.21.15.88:0/542846469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b80039c0 0x7f93b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93cbe00640 1 --2- 172.21.15.88:0/542846469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b8004810 0x7f93b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d9800640 1 --2- 172.21.15.88:0/542846469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b80052f0 0x7f93b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d8e00640 1 -- 172.21.15.88:0/542846469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b8004810 msgr2=0x7f93b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:34.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d8e00640 1 --2- 172.21.15.88:0/542846469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b8004810 0x7f93b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d8e00640 1 -- 172.21.15.88:0/542846469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b80052f0 msgr2=0x7f93b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d8e00640 1 --2- 172.21.15.88:0/542846469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b80052f0 0x7f93b800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d8e00640 1 -- 172.21.15.88:0/542846469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b8003530 con 0x7f93b80039c0 2024-04-24T08:26:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.148+0000 7f93d9800640 1 -- 172.21.15.88:0/542846469 reap_dead start 2024-04-24T08:26:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93d8e00640 1 --2- 172.21.15.88:0/542846469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b80039c0 0x7f93b8003de0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f93c400c210 tx=0x7f93c401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc09a2fa8958f3c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c4007d20 con 0x7f93b80039c0 2024-04-24T08:26:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c40a9070 con 0x7f93b80039c0 2024-04-24T08:26:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93d3e00640 1 -- 172.21.15.88:0/542846469 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c4005d80 con 0x7f93b80039c0 2024-04-24T08:26:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 -- 172.21.15.88:0/542846469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b80039c0 msgr2=0x7f93b8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 --2- 172.21.15.88:0/542846469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b80039c0 0x7f93b8003de0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f93c400c210 tx=0x7f93c401cc20 comp rx=0 tx=0).stop 2024-04-24T08:26:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 -- 172.21.15.88:0/542846469 shutdown_connections 2024-04-24T08:26:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 --2- 172.21.15.88:0/542846469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b80039c0 0x7f93b8003de0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 -- 172.21.15.88:0/542846469 >> 172.21.15.88:0/542846469 conn(0x7f93d406c0d0 msgr2=0x7f93d40b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 -- 172.21.15.88:0/542846469 shutdown_connections 2024-04-24T08:26:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 -- 172.21.15.88:0/542846469 wait complete. 2024-04-24T08:26:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 Processor -- start 2024-04-24T08:26:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 -- start start 2024-04-24T08:26:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b80039c0 0x7f93d40b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d4071410 0x7f93d41e1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93d41e1960 0x7f93d4140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f93d40b3e20 con 0x7f93d41e1960 2024-04-24T08:26:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f93d4146330 con 0x7f93b80039c0 2024-04-24T08:26:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93db800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f93d40b3fa0 con 0x7f93d4071410 2024-04-24T08:26:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93d9800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93d41e1960 0x7f93d4140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93d9800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93d41e1960 0x7f93d4140fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54260/0 (socket says 172.21.15.88:54260) 2024-04-24T08:26:34.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.152+0000 7f93d9800640 1 -- 172.21.15.88:0/715443867 learned_addr learned my addr 172.21.15.88:0/715443867 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:34.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93cbe00640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d4071410 0x7f93d41e1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93d8e00640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b80039c0 0x7f93d40b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93d9800640 1 -- 172.21.15.88:0/715443867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d4071410 msgr2=0x7f93d41e1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93d9800640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d4071410 0x7f93d41e1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93d9800640 1 -- 172.21.15.88:0/715443867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b80039c0 msgr2=0x7f93d40b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93d9800640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b80039c0 0x7f93d40b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93d9800640 1 -- 172.21.15.88:0/715443867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d4070350 con 0x7f93d41e1960 2024-04-24T08:26:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93d9800640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93d41e1960 0x7f93d4140fd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f93cc007cd0 tx=0x7f93cc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93d1600640 1 -- 172.21.15.88:0/715443867 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc011e40 con 0x7f93d41e1960 2024-04-24T08:26:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93d1600640 1 -- 172.21.15.88:0/715443867 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93cc01b070 con 0x7f93d41e1960 2024-04-24T08:26:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93d1600640 1 -- 172.21.15.88:0/715443867 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0039a0 con 0x7f93d41e1960 2024-04-24T08:26:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93db800640 1 -- 172.21.15.88:0/715443867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d40718f0 con 0x7f93d41e1960 2024-04-24T08:26:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93db800640 1 -- 172.21.15.88:0/715443867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d4070b10 con 0x7f93d41e1960 2024-04-24T08:26:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93db800640 1 -- 172.21.15.88:0/715443867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93d4068b90 con 0x7f93d41e1960 2024-04-24T08:26:34.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.156+0000 7f93d1600640 1 -- 172.21.15.88:0/715443867 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f93cc003b40 con 0x7f93d41e1960 2024-04-24T08:26:34.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.160+0000 7f93d1600640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f93b00683b0 0x7f93b006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.160+0000 7f93d1600640 1 -- 172.21.15.88:0/715443867 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f93cc086dd0 con 0x7f93d41e1960 2024-04-24T08:26:34.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.160+0000 7f93d8e00640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f93b00683b0 0x7f93b006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.160+0000 7f93d8e00640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f93b00683b0 0x7f93b006a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f93c40ab000 tx=0x7f93c40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:34.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.164+0000 7f93d1600640 1 -- 172.21.15.88:0/715443867 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f93cc025020 con 0x7f93d41e1960 2024-04-24T08:26:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.328+0000 7f93db800640 1 -- 172.21.15.88:0/715443867 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93d40aefc0 con 0x7f93b00683b0 2024-04-24T08:26:34.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93d1600640 1 -- 172.21.15.88:0/715443867 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13446 (secure 0 0 0) 0x7f93d40aefc0 con 0x7f93b00683b0 2024-04-24T08:26:34.334 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:34.334 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:26:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93db800640 1 -- 172.21.15.88:0/715443867 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f93b00683b0 msgr2=0x7f93b006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93db800640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f93b00683b0 0x7f93b006a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f93c40ab000 tx=0x7f93c40a7070 comp rx=0 tx=0).stop 2024-04-24T08:26:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93db800640 1 -- 172.21.15.88:0/715443867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93d41e1960 msgr2=0x7f93d4140fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93db800640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93d41e1960 0x7f93d4140fd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f93cc007cd0 tx=0x7f93cc0115a0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93db800640 1 -- 172.21.15.88:0/715443867 shutdown_connections 2024-04-24T08:26:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93db800640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f93b00683b0 0x7f93b006a870 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93db800640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93d41e1960 0x7f93d4140fd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93db800640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d4071410 0x7f93d41e1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93db800640 1 --2- 172.21.15.88:0/715443867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b80039c0 0x7f93d40b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93db800640 1 -- 172.21.15.88:0/715443867 >> 172.21.15.88:0/715443867 conn(0x7f93d406c0d0 msgr2=0x7f93d41444c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93db800640 1 -- 172.21.15.88:0/715443867 shutdown_connections 2024-04-24T08:26:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.332+0000 7f93db800640 1 -- 172.21.15.88:0/715443867 wait complete. 2024-04-24T08:26:34.355 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-04-24T08:26:33.001201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219988,"kb_used_data":3824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754732,"statfs":{"total":773094113280,"available":772868845568,"internally_reserved":0,"allocated":3915776,"data_stored":2227312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10734,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-54,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001253"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.695902+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:26:12.695902+0000","last_peered":"2024-04-24T08:26:12.695902+0000","last_clean":"2024-04-24T08:26:12.695902+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:26:12.695902+0000","last_undegraded":"2024-04-24T08:26:12.695902+0000","last_fullsized":"2024-04-24T08:26:12.695902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":921600,"data_stored":714470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":124628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":130765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":130197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":144395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":124082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":138314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":720461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:26:34.356 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:26:34.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.488+0000 7f5271200640 1 Processor -- start 2024-04-24T08:26:34.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.488+0000 7f5271200640 1 -- start start 2024-04-24T08:26:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.488+0000 7f5271200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b01f0 0x7f526c14fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.488+0000 7f5271200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f526c144390 con 0x7f526c06d470 2024-04-24T08:26:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.488+0000 7f5271200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f526c09c4d0 con 0x7f526c0b3e20 2024-04-24T08:26:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.488+0000 7f5271200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f526c0b5b40 con 0x7f526c0b01f0 2024-04-24T08:26:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.488+0000 7f5269e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f526c06d470 0x7f526c144b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52980/0 (socket says 172.21.15.88:52980) 2024-04-24T08:26:34.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.488+0000 7f5269e00640 1 -- 172.21.15.88:0/1848920907 learned_addr learned my addr 172.21.15.88:0/1848920907 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:34.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f526a800640 1 --2- 172.21.15.88:0/1848920907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b01f0 0x7f526c14fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3714556649 0 0) 0x7f526c144390 con 0x7f526c06d470 2024-04-24T08:26:34.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5250003450 con 0x7f526c06d470 2024-04-24T08:26:34.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1993846414 0 0) 0x7f5250003450 con 0x7f526c06d470 2024-04-24T08:26:34.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b01f0 msgr2=0x7f526c14fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:34.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 --2- 172.21.15.88:0/1848920907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b01f0 0x7f526c14fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 >> v1:172.21.15.142:6789/0 conn(0x7f526c0b3e20 legacy=0x7f526c0afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c09cc40 con 0x7f526c06d470 2024-04-24T08:26:34.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f525c001680 con 0x7f526c06d470 2024-04-24T08:26:34.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 >> v1:172.21.15.88:6789/0 conn(0x7f526c06d470 legacy=0x7f526c144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 --2- 172.21.15.88:0/1848920907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b01f0 0x7f5250003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 --2- 172.21.15.88:0/1848920907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5250004020 0x7f525000a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 --2- 172.21.15.88:0/1848920907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f525000b000 0x7f525000d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f525000dd40 con 0x7f5250004020 2024-04-24T08:26:34.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f525000def0 con 0x7f525000b000 2024-04-24T08:26:34.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f525000e0f0 con 0x7f526c0b01f0 2024-04-24T08:26:34.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5269e00640 1 --2- 172.21.15.88:0/1848920907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b01f0 0x7f5250003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5261400640 1 --2- 172.21.15.88:0/1848920907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5250004020 0x7f525000a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f526a800640 1 --2- 172.21.15.88:0/1848920907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f525000b000 0x7f525000d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5261400640 1 -- 172.21.15.88:0/1848920907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b01f0 msgr2=0x7f5250003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:34.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5261400640 1 --2- 172.21.15.88:0/1848920907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b01f0 0x7f5250003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5261400640 1 -- 172.21.15.88:0/1848920907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f525000b000 msgr2=0x7f525000d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:34.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5261400640 1 --2- 172.21.15.88:0/1848920907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f525000b000 0x7f525000d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.492+0000 7f5261400640 1 -- 172.21.15.88:0/1848920907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5250003450 con 0x7f5250004020 2024-04-24T08:26:34.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5261400640 1 --2- 172.21.15.88:0/1848920907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5250004020 0x7f525000a870 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5254001910 tx=0x7f525401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fde292d654c9f2e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:34.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52540b0070 con 0x7f5250004020 2024-04-24T08:26:34.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52540ab620 con 0x7f5250004020 2024-04-24T08:26:34.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5269400640 1 -- 172.21.15.88:0/1848920907 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254001510 con 0x7f5250004020 2024-04-24T08:26:34.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 -- 172.21.15.88:0/1848920907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5250004020 msgr2=0x7f525000a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 --2- 172.21.15.88:0/1848920907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5250004020 0x7f525000a870 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5254001910 tx=0x7f525401c560 comp rx=0 tx=0).stop 2024-04-24T08:26:34.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f526a800640 1 -- 172.21.15.88:0/1848920907 reap_dead start 2024-04-24T08:26:34.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 -- 172.21.15.88:0/1848920907 shutdown_connections 2024-04-24T08:26:34.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 -- 172.21.15.88:0/1848920907 >> 172.21.15.88:0/1848920907 conn(0x7f526c06c0d0 msgr2=0x7f526c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:34.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 -- 172.21.15.88:0/1848920907 shutdown_connections 2024-04-24T08:26:34.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 -- 172.21.15.88:0/1848920907 wait complete. 2024-04-24T08:26:34.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 Processor -- start 2024-04-24T08:26:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 -- start start 2024-04-24T08:26:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5250004020 0x7f526c0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b0820 0x7f526c0b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f526c0b1850 0x7f526c140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f526c14fc40 con 0x7f5250004020 2024-04-24T08:26:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f526c09ced0 con 0x7f526c0b1850 2024-04-24T08:26:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5271200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f526c14fdc0 con 0x7f526c0b0820 2024-04-24T08:26:34.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5269e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5250004020 0x7f526c0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5269e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5250004020 0x7f526c0b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54272/0 (socket says 172.21.15.88:54272) 2024-04-24T08:26:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.496+0000 7f5269e00640 1 -- 172.21.15.88:0/816155673 learned_addr learned my addr 172.21.15.88:0/816155673 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f526a800640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f526c0b1850 0x7f526c140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5261400640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b0820 0x7f526c0b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5269e00640 1 -- 172.21.15.88:0/816155673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b0820 msgr2=0x7f526c0b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5269e00640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b0820 0x7f526c0b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5269e00640 1 -- 172.21.15.88:0/816155673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f526c0b1850 msgr2=0x7f526c140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5269e00640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f526c0b1850 0x7f526c140b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5269e00640 1 -- 172.21.15.88:0/816155673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c1e1050 con 0x7f5250004020 2024-04-24T08:26:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f526a800640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f526c0b1850 0x7f526c140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5261400640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b0820 0x7f526c0b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5269e00640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5250004020 0x7f526c0b2fa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f525c007fd0 tx=0x7f525c007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5262a00640 1 -- 172.21.15.88:0/816155673 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c001680 con 0x7f5250004020 2024-04-24T08:26:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5262a00640 1 -- 172.21.15.88:0/816155673 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c018070 con 0x7f5250004020 2024-04-24T08:26:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5262a00640 1 -- 172.21.15.88:0/816155673 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c00fbc0 con 0x7f5250004020 2024-04-24T08:26:34.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5271200640 1 -- 172.21.15.88:0/816155673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f526c0b2830 con 0x7f5250004020 2024-04-24T08:26:34.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5271200640 1 -- 172.21.15.88:0/816155673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f526c1d7630 con 0x7f5250004020 2024-04-24T08:26:34.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5271200640 1 -- 172.21.15.88:0/816155673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f526c068b90 con 0x7f5250004020 2024-04-24T08:26:34.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5262a00640 1 -- 172.21.15.88:0/816155673 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f525c01d460 con 0x7f5250004020 2024-04-24T08:26:34.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5262a00640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f52480683b0 0x7f524806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5262a00640 1 -- 172.21.15.88:0/816155673 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f525c0866b0 con 0x7f5250004020 2024-04-24T08:26:34.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.500+0000 7f5261400640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f52480683b0 0x7f524806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.504+0000 7f5261400640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f52480683b0 0x7f524806a870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f52540ad000 tx=0x7f5254005040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:34.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.504+0000 7f5262a00640 1 -- 172.21.15.88:0/816155673 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f525c056f70 con 0x7f5250004020 2024-04-24T08:26:34.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.660+0000 7f5271200640 1 -- 172.21.15.88:0/816155673 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f526c09d330 con 0x7f52480683b0 2024-04-24T08:26:34.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.660+0000 7f5262a00640 1 -- 172.21.15.88:0/816155673 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13446 (secure 0 0 0) 0x7f526c09d330 con 0x7f52480683b0 2024-04-24T08:26:34.665 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:34.665 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:26:34.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.664+0000 7f5271200640 1 -- 172.21.15.88:0/816155673 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f52480683b0 msgr2=0x7f524806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.664+0000 7f5271200640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f52480683b0 0x7f524806a870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f52540ad000 tx=0x7f5254005040 comp rx=0 tx=0).stop 2024-04-24T08:26:34.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.664+0000 7f5271200640 1 -- 172.21.15.88:0/816155673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5250004020 msgr2=0x7f526c0b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.664+0000 7f5271200640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5250004020 0x7f526c0b2fa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f525c007fd0 tx=0x7f525c007720 comp rx=0 tx=0).stop 2024-04-24T08:26:34.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.664+0000 7f5271200640 1 -- 172.21.15.88:0/816155673 shutdown_connections 2024-04-24T08:26:34.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.664+0000 7f5271200640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f52480683b0 0x7f524806a870 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.664+0000 7f5271200640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f526c0b1850 0x7f526c140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.664+0000 7f5271200640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526c0b0820 0x7f526c0b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.664+0000 7f5271200640 1 --2- 172.21.15.88:0/816155673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5250004020 0x7f526c0b2fa0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.664+0000 7f5271200640 1 -- 172.21.15.88:0/816155673 >> 172.21.15.88:0/816155673 conn(0x7f526c06c0d0 msgr2=0x7f526c1420f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:34.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.664+0000 7f5271200640 1 -- 172.21.15.88:0/816155673 shutdown_connections 2024-04-24T08:26:34.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.664+0000 7f5271200640 1 -- 172.21.15.88:0/816155673 wait complete. 2024-04-24T08:26:34.686 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-04-24T08:26:33.001201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219988,"kb_used_data":3824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754732,"statfs":{"total":773094113280,"available":772868845568,"internally_reserved":0,"allocated":3915776,"data_stored":2227312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10734,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-54,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001253"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.695902+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:26:12.695902+0000","last_peered":"2024-04-24T08:26:12.695902+0000","last_clean":"2024-04-24T08:26:12.695902+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:26:12.695902+0000","last_undegraded":"2024-04-24T08:26:12.695902+0000","last_fullsized":"2024-04-24T08:26:12.695902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":921600,"data_stored":714470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":124628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":130765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":130197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":144395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":124082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":138314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":720461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:26:34.686 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T08:26:34.687 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:26:34.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f0445e00640 1 Processor -- start 2024-04-24T08:26:34.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f0445e00640 1 -- start start 2024-04-24T08:26:34.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f0445e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f04400b44e0 0x7f04400b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f0445e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0440143bb0 0x7f0440144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f0445e00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04400ba170 con 0x7f04400b9d90 2024-04-24T08:26:34.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f0445e00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f0440145b80 con 0x7f04400b44e0 2024-04-24T08:26:34.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f0445e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f04401458a0 con 0x7f0440143bb0 2024-04-24T08:26:34.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f043ea00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f04400b9d90 0x7f04401450e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52994/0 (socket says 172.21.15.88:52994) 2024-04-24T08:26:34.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f043ea00640 1 -- 172.21.15.88:0/3036394081 learned_addr learned my addr 172.21.15.88:0/3036394081 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:34.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f043e000640 1 --2- 172.21.15.88:0/3036394081 >> v2:172.21.15.88:3300/0 conn(0x7f04400b44e0 0x7f04400b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f043f400640 1 --2- 172.21.15.88:0/3036394081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0440143bb0 0x7f0440144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f043d600640 1 -- 172.21.15.88:0/3036394081 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 732515776 0 0) 0x7f04400ba170 con 0x7f04400b9d90 2024-04-24T08:26:34.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f043d600640 1 -- 172.21.15.88:0/3036394081 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0424003530 con 0x7f04400b9d90 2024-04-24T08:26:34.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f043e000640 1 -- 172.21.15.88:0/3036394081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0440143bb0 msgr2=0x7f0440144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:34.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f043e000640 1 --2- 172.21.15.88:0/3036394081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0440143bb0 0x7f0440144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f043e000640 1 -- 172.21.15.88:0/3036394081 >> v1:172.21.15.88:6789/0 conn(0x7f04400b9d90 legacy=0x7f04401450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.820+0000 7f043e000640 1 -- 172.21.15.88:0/3036394081 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04400b3fc0 con 0x7f04400b44e0 2024-04-24T08:26:34.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f043e000640 1 --2- 172.21.15.88:0/3036394081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04400b44e0 0x7f04400b4970 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f042c0097c0 tx=0x7f042c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea2b9eb4030c5d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:34.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f043d600640 1 -- 172.21.15.88:0/3036394081 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0b0070 con 0x7f04400b44e0 2024-04-24T08:26:34.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f043d600640 1 -- 172.21.15.88:0/3036394081 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c0ab600 con 0x7f04400b44e0 2024-04-24T08:26:34.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f043d600640 1 -- 172.21.15.88:0/3036394081 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0ab9d0 con 0x7f04400b44e0 2024-04-24T08:26:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f0445e00640 1 -- 172.21.15.88:0/3036394081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04400b44e0 msgr2=0x7f04400b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f0445e00640 1 --2- 172.21.15.88:0/3036394081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04400b44e0 0x7f04400b4970 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f042c0097c0 tx=0x7f042c01c410 comp rx=0 tx=0).stop 2024-04-24T08:26:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f0445e00640 1 -- 172.21.15.88:0/3036394081 shutdown_connections 2024-04-24T08:26:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f0445e00640 1 --2- 172.21.15.88:0/3036394081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0440143bb0 0x7f0440144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f0445e00640 1 --2- 172.21.15.88:0/3036394081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04400b44e0 0x7f04400b4970 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f0445e00640 1 -- 172.21.15.88:0/3036394081 >> 172.21.15.88:0/3036394081 conn(0x7f044006c0d0 msgr2=0x7f04400b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:34.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f0445e00640 1 -- 172.21.15.88:0/3036394081 shutdown_connections 2024-04-24T08:26:34.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f0445e00640 1 -- 172.21.15.88:0/3036394081 wait complete. 2024-04-24T08:26:34.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f0445e00640 1 Processor -- start 2024-04-24T08:26:34.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.824+0000 7f0445e00640 1 -- start start 2024-04-24T08:26:34.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0445e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04400b44e0 0x7f0440097810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0445e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04400b9d90 0x7f04401e1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0445e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0440143bb0 0x7f0440096940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0445e00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0440150000 con 0x7f04400b9d90 2024-04-24T08:26:34.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0445e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f044014fe80 con 0x7f0440143bb0 2024-04-24T08:26:34.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0445e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0440150180 con 0x7f04400b44e0 2024-04-24T08:26:34.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043e000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04400b9d90 0x7f04401e1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043e000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04400b9d90 0x7f04401e1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54284/0 (socket says 172.21.15.88:54284) 2024-04-24T08:26:34.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043e000640 1 -- 172.21.15.88:0/3903766549 learned_addr learned my addr 172.21.15.88:0/3903766549 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:34.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043ea00640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04400b44e0 0x7f0440097810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043e000640 1 -- 172.21.15.88:0/3903766549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04400b44e0 msgr2=0x7f0440097810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043f400640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0440143bb0 0x7f0440096940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043e000640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04400b44e0 0x7f0440097810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043e000640 1 -- 172.21.15.88:0/3903766549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0440143bb0 msgr2=0x7f0440096940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043e000640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0440143bb0 0x7f0440096940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043e000640 1 -- 172.21.15.88:0/3903766549 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04400b1a10 con 0x7f04400b9d90 2024-04-24T08:26:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043ea00640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04400b44e0 0x7f0440097810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043f400640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0440143bb0 0x7f0440096940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f043e000640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04400b9d90 0x7f04401e1a20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f042c0ae040 tx=0x7f042c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0437400640 1 -- 172.21.15.88:0/3903766549 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0b0040 con 0x7f04400b9d90 2024-04-24T08:26:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0437400640 1 -- 172.21.15.88:0/3903766549 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c0b43f0 con 0x7f04400b9d90 2024-04-24T08:26:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0445e00640 1 -- 172.21.15.88:0/3903766549 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04401e24d0 con 0x7f04400b9d90 2024-04-24T08:26:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0437400640 1 -- 172.21.15.88:0/3903766549 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0b47c0 con 0x7f04400b9d90 2024-04-24T08:26:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0445e00640 1 -- 172.21.15.88:0/3903766549 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04400b1650 con 0x7f04400b9d90 2024-04-24T08:26:34.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0445e00640 1 -- 172.21.15.88:0/3903766549 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04401e28b0 con 0x7f04400b9d90 2024-04-24T08:26:34.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.828+0000 7f0437400640 1 -- 172.21.15.88:0/3903766549 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f042c0b4960 con 0x7f04400b9d90 2024-04-24T08:26:34.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.832+0000 7f0437400640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0420068380 0x7f042006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:34.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.832+0000 7f0437400640 1 -- 172.21.15.88:0/3903766549 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f042c120180 con 0x7f04400b9d90 2024-04-24T08:26:34.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.832+0000 7f043ea00640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0420068380 0x7f042006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:34.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.832+0000 7f043ea00640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0420068380 0x7f042006a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0430005890 tx=0x7f0430009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:34.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.836+0000 7f0437400640 1 -- 172.21.15.88:0/3903766549 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f04401e28b0 con 0x7f04400b9d90 2024-04-24T08:26:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.988+0000 7f0445e00640 1 -- 172.21.15.88:0/3903766549 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0440096790 con 0x7f0420068380 2024-04-24T08:26:34.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.988+0000 7f0437400640 1 -- 172.21.15.88:0/3903766549 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13446 (secure 0 0 0) 0x7f0440096790 con 0x7f0420068380 2024-04-24T08:26:34.993 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:34.993 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:26:34.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.992+0000 7f0445e00640 1 -- 172.21.15.88:0/3903766549 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0420068380 msgr2=0x7f042006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.992+0000 7f0445e00640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0420068380 0x7f042006a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0430005890 tx=0x7f0430009040 comp rx=0 tx=0).stop 2024-04-24T08:26:34.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.992+0000 7f0445e00640 1 -- 172.21.15.88:0/3903766549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04400b9d90 msgr2=0x7f04401e1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:34.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.992+0000 7f0445e00640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04400b9d90 0x7f04401e1a20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f042c0ae040 tx=0x7f042c0191b0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.992+0000 7f0445e00640 1 -- 172.21.15.88:0/3903766549 shutdown_connections 2024-04-24T08:26:34.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.992+0000 7f0445e00640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f0420068380 0x7f042006a840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.992+0000 7f0445e00640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0440143bb0 0x7f0440096940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.992+0000 7f0445e00640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04400b9d90 0x7f04401e1a20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.992+0000 7f0445e00640 1 --2- 172.21.15.88:0/3903766549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04400b44e0 0x7f0440097810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:34.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.992+0000 7f0445e00640 1 -- 172.21.15.88:0/3903766549 >> 172.21.15.88:0/3903766549 conn(0x7f044006c0d0 msgr2=0x7f04400b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:34.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.992+0000 7f0445e00640 1 -- 172.21.15.88:0/3903766549 shutdown_connections 2024-04-24T08:26:34.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:34.992+0000 7f0445e00640 1 -- 172.21.15.88:0/3903766549 wait complete. 2024-04-24T08:26:35.014 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-04-24T08:26:33.001201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219988,"kb_used_data":3824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754732,"statfs":{"total":773094113280,"available":772868845568,"internally_reserved":0,"allocated":3915776,"data_stored":2227312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10734,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-54,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001253"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-24T08:26:12.695902+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:26:12.695902+0000","last_peered":"2024-04-24T08:26:12.695902+0000","last_clean":"2024-04-24T08:26:12.695902+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:26:12.695902+0000","last_undegraded":"2024-04-24T08:26:12.695902+0000","last_fullsized":"2024-04-24T08:26:12.695902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":921600,"data_stored":714470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":124628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":130765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":130197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":144395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":124082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":138314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":720461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:26:35.014 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T08:26:35.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.144+0000 7fafde600640 1 Processor -- start 2024-04-24T08:26:35.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.144+0000 7fafde600640 1 -- start start 2024-04-24T08:26:35.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafde600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd80b9d90 0x7fafd806d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:35.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafde600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafd8145f20 0x7fafd81504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:35.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafde600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd80ba170 con 0x7fafd809be30 2024-04-24T08:26:35.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafde600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fafd809cd30 con 0x7fafd8145f20 2024-04-24T08:26:35.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafde600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fafd814a060 con 0x7fafd80b9d90 2024-04-24T08:26:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafd6a00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fafd809be30 0x7fafd806d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53010/0 (socket says 172.21.15.88:53010) 2024-04-24T08:26:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafd7e00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafd8145f20 0x7fafd81504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafd6a00640 1 -- 172.21.15.88:0/2190683848 learned_addr learned my addr 172.21.15.88:0/2190683848 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafd7400640 1 --2- 172.21.15.88:0/2190683848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd80b9d90 0x7fafd806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafd7e00640 1 -- 172.21.15.88:0/2190683848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd80b9d90 msgr2=0x7fafd806d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafd7e00640 1 --2- 172.21.15.88:0/2190683848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd80b9d90 0x7fafd806d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafd7e00640 1 -- 172.21.15.88:0/2190683848 >> v1:172.21.15.88:6789/0 conn(0x7fafd809be30 legacy=0x7fafd806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafd7e00640 1 -- 172.21.15.88:0/2190683848 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd8149860 con 0x7fafd8145f20 2024-04-24T08:26:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.148+0000 7fafd6000640 1 -- 172.21.15.88:0/2190683848 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4251322083 0 0) 0x7fafd80ba170 con 0x7fafd809be30 2024-04-24T08:26:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafd7e00640 1 --2- 172.21.15.88:0/2190683848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd8145f20 0x7fafd81504e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fafd00097c0 tx=0x7fafd001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13f08491d7916d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafd6000640 1 -- 172.21.15.88:0/2190683848 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd00b0070 con 0x7fafd8145f20 2024-04-24T08:26:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafd6000640 1 -- 172.21.15.88:0/2190683848 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd00ab600 con 0x7fafd8145f20 2024-04-24T08:26:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafd6000640 1 -- 172.21.15.88:0/2190683848 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd00ab9d0 con 0x7fafd8145f20 2024-04-24T08:26:35.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 -- 172.21.15.88:0/2190683848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd8145f20 msgr2=0x7fafd81504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:35.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 --2- 172.21.15.88:0/2190683848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd8145f20 0x7fafd81504e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fafd00097c0 tx=0x7fafd001c380 comp rx=0 tx=0).stop 2024-04-24T08:26:35.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 -- 172.21.15.88:0/2190683848 shutdown_connections 2024-04-24T08:26:35.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 --2- 172.21.15.88:0/2190683848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd8145f20 0x7fafd81504e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:35.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 --2- 172.21.15.88:0/2190683848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd80b9d90 0x7fafd806d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:35.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 -- 172.21.15.88:0/2190683848 >> 172.21.15.88:0/2190683848 conn(0x7fafd806c0d0 msgr2=0x7fafd80b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:35.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 -- 172.21.15.88:0/2190683848 shutdown_connections 2024-04-24T08:26:35.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 -- 172.21.15.88:0/2190683848 wait complete. 2024-04-24T08:26:35.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 Processor -- start 2024-04-24T08:26:35.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 -- start start 2024-04-24T08:26:35.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd809be30 0x7fafd8072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:35.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd80b9d90 0x7fafd8070a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:35.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd8145f20 0x7fafd81e37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:35.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fafd80b3fa0 con 0x7fafd8145f20 2024-04-24T08:26:35.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fafd80b3e20 con 0x7fafd80b9d90 2024-04-24T08:26:35.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafde600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fafd806de60 con 0x7fafd809be30 2024-04-24T08:26:35.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafd7e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd8145f20 0x7fafd81e37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:35.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafd7e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd8145f20 0x7fafd81e37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54314/0 (socket says 172.21.15.88:54314) 2024-04-24T08:26:35.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.152+0000 7fafd7e00640 1 -- 172.21.15.88:0/2757980090 learned_addr learned my addr 172.21.15.88:0/2757980090 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:35.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafd7400640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd809be30 0x7fafd8072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:35.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafd6a00640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd80b9d90 0x7fafd8070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:35.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafd7e00640 1 -- 172.21.15.88:0/2757980090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd809be30 msgr2=0x7fafd8072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:35.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafd7e00640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd809be30 0x7fafd8072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:35.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafd7e00640 1 -- 172.21.15.88:0/2757980090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd80b9d90 msgr2=0x7fafd8070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:35.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafd7e00640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd80b9d90 0x7fafd8070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:35.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafd7e00640 1 -- 172.21.15.88:0/2757980090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd80b3750 con 0x7fafd8145f20 2024-04-24T08:26:35.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafd7400640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd809be30 0x7fafd8072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:35.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafd6a00640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd80b9d90 0x7fafd8070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:35.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafd7e00640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd8145f20 0x7fafd81e37c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fafd0019fb0 tx=0x7fafd0019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:35.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafcf400640 1 -- 172.21.15.88:0/2757980090 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd00b0040 con 0x7fafd8145f20 2024-04-24T08:26:35.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafcf400640 1 -- 172.21.15.88:0/2757980090 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd00b9070 con 0x7fafd8145f20 2024-04-24T08:26:35.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafde600640 1 -- 172.21.15.88:0/2757980090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd80723e0 con 0x7fafd8145f20 2024-04-24T08:26:35.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafcf400640 1 -- 172.21.15.88:0/2757980090 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd00b4630 con 0x7fafd8145f20 2024-04-24T08:26:35.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafde600640 1 -- 172.21.15.88:0/2757980090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd80b2f50 con 0x7fafd8145f20 2024-04-24T08:26:35.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafde600640 1 -- 172.21.15.88:0/2757980090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd8068b90 con 0x7fafd8145f20 2024-04-24T08:26:35.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafcf400640 1 -- 172.21.15.88:0/2757980090 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fafd00b47d0 con 0x7fafd8145f20 2024-04-24T08:26:35.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafcf400640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fafb80683b0 0x7fafb806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:35.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafcf400640 1 -- 172.21.15.88:0/2757980090 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7fafd01202c0 con 0x7fafd8145f20 2024-04-24T08:26:35.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.156+0000 7fafd7400640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fafb80683b0 0x7fafb806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:35.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.160+0000 7fafd7400640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fafb80683b0 0x7fafb806a870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fafc8007330 tx=0x7fafc800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:35.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.160+0000 7fafcf400640 1 -- 172.21.15.88:0/2757980090 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fafd0016090 con 0x7fafd8145f20 2024-04-24T08:26:35.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.320+0000 7fafde600640 1 -- 172.21.15.88:0/2757980090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafd8073b90 con 0x7fafd8145f20 2024-04-24T08:26:35.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafcf400640 1 -- 172.21.15.88:0/2757980090 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+13020 (secure 0 0 0) 0x7fafd00f0b70 con 0x7fafd8145f20 2024-04-24T08:26:35.326 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:35.327 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":32,"fsid":"0c7f29ca-8828-476d-9ca3-111d6acc4dca","created":"2024-04-24T08:25:01.978751+0000","modified":"2024-04-24T08:26:32.388198+0000","last_up_change":"2024-04-24T08:25:14.199840+0000","last_in_change":"2024-04-24T08:25:04.482429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T08:25:15.012217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"db6d4591-0b1a-4c26-b77a-42643369737d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6801","nonce":3837730046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6803","nonce":3837730046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6807","nonce":3837730046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3837730046},{"type":"v1","addr":"172.21.15.88:6805","nonce":3837730046}]},"public_addr":"172.21.15.88:6801/3837730046","cluster_addr":"172.21.15.88:6803/3837730046","heartbeat_back_addr":"172.21.15.88:6807/3837730046","heartbeat_front_addr":"172.21.15.88:6805/3837730046","state":["exists","up"]},{"osd":1,"uuid":"54e7e964-31f5-4735-8a1a-43b825b4e5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6818","nonce":1351635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6821","nonce":1351635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6827","nonce":1351635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1351635476},{"type":"v1","addr":"172.21.15.88:6824","nonce":1351635476}]},"public_addr":"172.21.15.88:6818/1351635476","cluster_addr":"172.21.15.88:6821/1351635476","heartbeat_back_addr":"172.21.15.88:6827/1351635476","heartbeat_front_addr":"172.21.15.88:6824/1351635476","state":["exists","up"]},{"osd":2,"uuid":"37ba8bc8-a48e-46ea-b04d-463febc6c70b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6809","nonce":3194231011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6811","nonce":3194231011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6815","nonce":3194231011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3194231011},{"type":"v1","addr":"172.21.15.88:6813","nonce":3194231011}]},"public_addr":"172.21.15.88:6809/3194231011","cluster_addr":"172.21.15.88:6811/3194231011","heartbeat_back_addr":"172.21.15.88:6815/3194231011","heartbeat_front_addr":"172.21.15.88:6813/3194231011","state":["exists","up"]},{"osd":3,"uuid":"c624bd7f-f552-4943-a1a1-1fbe045affc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6820","nonce":3914165982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6825","nonce":3914165982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6831","nonce":3914165982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3914165982},{"type":"v1","addr":"172.21.15.88:6829","nonce":3914165982}]},"public_addr":"172.21.15.88:6820/3914165982","cluster_addr":"172.21.15.88:6825/3914165982","heartbeat_back_addr":"172.21.15.88:6831/3914165982","heartbeat_front_addr":"172.21.15.88:6829/3914165982","state":["exists","up"]},{"osd":4,"uuid":"4327e008-bbcf-4477-a5ba-a1694a21b0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6801","nonce":1785360205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6805","nonce":1785360205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6813","nonce":1785360205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":1785360205},{"type":"v1","addr":"172.21.15.142:6809","nonce":1785360205}]},"public_addr":"172.21.15.142:6801/1785360205","cluster_addr":"172.21.15.142:6805/1785360205","heartbeat_back_addr":"172.21.15.142:6813/1785360205","heartbeat_front_addr":"172.21.15.142:6809/1785360205","state":["exists","up"]},{"osd":5,"uuid":"cf6e019c-ef89-45cb-92bb-d0d1a2a0afcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6825","nonce":912007372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6827","nonce":912007372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6831","nonce":912007372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":912007372},{"type":"v1","addr":"172.21.15.142:6829","nonce":912007372}]},"public_addr":"172.21.15.142:6825/912007372","cluster_addr":"172.21.15.142:6827/912007372","heartbeat_back_addr":"172.21.15.142:6831/912007372","heartbeat_front_addr":"172.21.15.142:6829/912007372","state":["exists","up"]},{"osd":6,"uuid":"4b650749-a5d1-4411-8db9-c5d23627085a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6804","nonce":3754014946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6808","nonce":3754014946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6815","nonce":3754014946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3754014946},{"type":"v1","addr":"172.21.15.142:6812","nonce":3754014946}]},"public_addr":"172.21.15.142:6804/3754014946","cluster_addr":"172.21.15.142:6808/3754014946","heartbeat_back_addr":"172.21.15.142:6815/3754014946","heartbeat_front_addr":"172.21.15.142:6812/3754014946","state":["exists","up"]},{"osd":7,"uuid":"a4af5c37-6417-42b3-9b96-a3be33d77d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6817","nonce":1975061608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6819","nonce":1975061608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6823","nonce":1975061608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1975061608},{"type":"v1","addr":"172.21.15.142:6821","nonce":1975061608}]},"public_addr":"172.21.15.142:6817/1975061608","cluster_addr":"172.21.15.142:6819/1975061608","heartbeat_back_addr":"172.21.15.142:6823/1975061608","heartbeat_front_addr":"172.21.15.142:6821/1975061608","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.054295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.323755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283818+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.217707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.052893+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.283505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.125475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T08:25:10.230523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6835/3724486177":"2024-04-25T08:26:29.334373+0000","172.21.15.88:6834/3724486177":"2024-04-25T08:26:29.334373+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T08:26:35.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafde600640 1 -- 172.21.15.88:0/2757980090 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fafb80683b0 msgr2=0x7fafb806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:35.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafde600640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fafb80683b0 0x7fafb806a870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fafc8007330 tx=0x7fafc800b040 comp rx=0 tx=0).stop 2024-04-24T08:26:35.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafde600640 1 -- 172.21.15.88:0/2757980090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd8145f20 msgr2=0x7fafd81e37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:35.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafde600640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd8145f20 0x7fafd81e37c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fafd0019fb0 tx=0x7fafd0019120 comp rx=0 tx=0).stop 2024-04-24T08:26:35.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafde600640 1 -- 172.21.15.88:0/2757980090 shutdown_connections 2024-04-24T08:26:35.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafde600640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fafb80683b0 0x7fafb806a870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:35.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafde600640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd8145f20 0x7fafd81e37c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:35.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafde600640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd80b9d90 0x7fafd8070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:35.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafde600640 1 --2- 172.21.15.88:0/2757980090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd809be30 0x7fafd8072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:35.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafde600640 1 -- 172.21.15.88:0/2757980090 >> 172.21.15.88:0/2757980090 conn(0x7fafd806c0d0 msgr2=0x7fafd809d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafde600640 1 -- 172.21.15.88:0/2757980090 shutdown_connections 2024-04-24T08:26:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:35.324+0000 7fafde600640 1 -- 172.21.15.88:0/2757980090 wait complete. 2024-04-24T08:26:36.348 INFO:tasks.ceph:Scrubbing osd.0 2024-04-24T08:26:36.349 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-24T08:26:36.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff41a00640 1 Processor -- start 2024-04-24T08:26:36.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff41a00640 1 -- start start 2024-04-24T08:26:36.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff41a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff3c1480e0 0x7eff3c148560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:36.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff41a00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff3c0ba170 con 0x7eff3c143f00 2024-04-24T08:26:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff41a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff3c09dc10 con 0x7eff3c0b9d90 2024-04-24T08:26:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff41a00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7eff3c144aa0 con 0x7eff3c1480e0 2024-04-24T08:26:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff3a000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7eff3c1480e0 0x7eff3c148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff3b400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7eff3c143f00 0x7eff3c144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53022/0 (socket says 172.21.15.88:53022) 2024-04-24T08:26:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff3b400640 1 -- 172.21.15.88:0/3772042023 learned_addr learned my addr 172.21.15.88:0/3772042023 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:36.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff3a000640 1 -- 172.21.15.88:0/3772042023 >> v1:172.21.15.142:6789/0 conn(0x7eff3c0b9d90 legacy=0x7eff3c0b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff3a000640 1 -- 172.21.15.88:0/3772042023 >> v1:172.21.15.88:6789/0 conn(0x7eff3c143f00 legacy=0x7eff3c144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff39600640 1 -- 172.21.15.88:0/3772042023 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3813410894 0 0) 0x7eff3c0ba170 con 0x7eff3c143f00 2024-04-24T08:26:36.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.496+0000 7eff3a000640 1 -- 172.21.15.88:0/3772042023 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3c09d410 con 0x7eff3c1480e0 2024-04-24T08:26:36.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff3a000640 1 --2- 172.21.15.88:0/3772042023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c1480e0 0x7eff3c148560 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7eff280097c0 tx=0x7eff2801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e728992a99b5f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:36.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff39600640 1 -- 172.21.15.88:0/3772042023 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff280b0070 con 0x7eff3c1480e0 2024-04-24T08:26:36.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff39600640 1 -- 172.21.15.88:0/3772042023 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff280ab600 con 0x7eff3c1480e0 2024-04-24T08:26:36.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff39600640 1 -- 172.21.15.88:0/3772042023 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff280ab9d0 con 0x7eff3c1480e0 2024-04-24T08:26:36.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff41a00640 1 -- 172.21.15.88:0/3772042023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c1480e0 msgr2=0x7eff3c148560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff41a00640 1 --2- 172.21.15.88:0/3772042023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c1480e0 0x7eff3c148560 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7eff280097c0 tx=0x7eff2801c380 comp rx=0 tx=0).stop 2024-04-24T08:26:36.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff41a00640 1 -- 172.21.15.88:0/3772042023 shutdown_connections 2024-04-24T08:26:36.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff41a00640 1 --2- 172.21.15.88:0/3772042023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c1480e0 0x7eff3c148560 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff41a00640 1 -- 172.21.15.88:0/3772042023 >> 172.21.15.88:0/3772042023 conn(0x7eff3c06c0d0 msgr2=0x7eff3c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:36.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff41a00640 1 -- 172.21.15.88:0/3772042023 shutdown_connections 2024-04-24T08:26:36.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff41a00640 1 -- 172.21.15.88:0/3772042023 wait complete. 2024-04-24T08:26:36.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff41a00640 1 Processor -- start 2024-04-24T08:26:36.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.500+0000 7eff41a00640 1 -- start start 2024-04-24T08:26:36.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff41a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff3c0b9d90 0x7eff3c13f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:36.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff41a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c143f00 0x7eff3c13ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:36.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff41a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c1480e0 0x7eff3c0b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:36.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff41a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c153020 con 0x7eff3c143f00 2024-04-24T08:26:36.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff41a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c152ea0 con 0x7eff3c1480e0 2024-04-24T08:26:36.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff41a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7eff3c1531a0 con 0x7eff3c0b9d90 2024-04-24T08:26:36.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff3a000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c143f00 0x7eff3c13ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:36.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff3a000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c143f00 0x7eff3c13ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54334/0 (socket says 172.21.15.88:54334) 2024-04-24T08:26:36.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff3a000640 1 -- 172.21.15.88:0/1836751300 learned_addr learned my addr 172.21.15.88:0/1836751300 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:36.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff3b400640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c1480e0 0x7eff3c0b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:36.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff3aa00640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff3c0b9d90 0x7eff3c13f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:36.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff3a000640 1 -- 172.21.15.88:0/1836751300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff3c0b9d90 msgr2=0x7eff3c13f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff3a000640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff3c0b9d90 0x7eff3c13f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff3a000640 1 -- 172.21.15.88:0/1836751300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c1480e0 msgr2=0x7eff3c0b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff3a000640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c1480e0 0x7eff3c0b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff3a000640 1 -- 172.21.15.88:0/1836751300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3c0b8d60 con 0x7eff3c143f00 2024-04-24T08:26:36.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff3b400640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c1480e0 0x7eff3c0b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:36.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff3a000640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c143f00 0x7eff3c13ddf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7eff28018f90 tx=0x7eff2801abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:36.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff32a00640 1 -- 172.21.15.88:0/1836751300 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff280b0050 con 0x7eff3c143f00 2024-04-24T08:26:36.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff32a00640 1 -- 172.21.15.88:0/1836751300 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff280bc070 con 0x7eff3c143f00 2024-04-24T08:26:36.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff41a00640 1 -- 172.21.15.88:0/1836751300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3c0b9040 con 0x7eff3c143f00 2024-04-24T08:26:36.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff32a00640 1 -- 172.21.15.88:0/1836751300 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff280b5a30 con 0x7eff3c143f00 2024-04-24T08:26:36.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff41a00640 1 -- 172.21.15.88:0/1836751300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3c0b8a20 con 0x7eff3c143f00 2024-04-24T08:26:36.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff41a00640 1 -- 172.21.15.88:0/1836751300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff3c068ca0 con 0x7eff3c143f00 2024-04-24T08:26:36.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.504+0000 7eff32a00640 1 -- 172.21.15.88:0/1836751300 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff280ab4c0 con 0x7eff3c143f00 2024-04-24T08:26:36.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.508+0000 7eff32a00640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7eff1c068380 0x7eff1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:36.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.508+0000 7eff32a00640 1 -- 172.21.15.88:0/1836751300 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7eff28121970 con 0x7eff3c143f00 2024-04-24T08:26:36.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.508+0000 7eff3aa00640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7eff1c068380 0x7eff1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:36.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.508+0000 7eff32a00640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] conn(0x7eff1c06e240 0x7eff1c070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:36.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.508+0000 7eff32a00640 1 -- 172.21.15.88:0/1836751300 --> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff280adec0 con 0x7eff1c06e240 2024-04-24T08:26:36.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.508+0000 7eff32a00640 1 -- 172.21.15.88:0/1836751300 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7eff28121d20 con 0x7eff3c143f00 2024-04-24T08:26:36.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.508+0000 7eff3b400640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] conn(0x7eff1c06e240 0x7eff1c070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:36.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.508+0000 7eff3aa00640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7eff1c068380 0x7eff1c06a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7eff3c147a60 tx=0x7eff2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:36.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.508+0000 7eff3b400640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] conn(0x7eff1c06e240 0x7eff1c070660 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:36.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.508+0000 7eff32a00640 1 -- 172.21.15.88:0/1836751300 <== osd.0 v2:172.21.15.88:6800/3837730046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff280adec0 con 0x7eff1c06e240 2024-04-24T08:26:36.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.520+0000 7eff41a00640 1 -- 172.21.15.88:0/1836751300 --> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7eff3c13dad0 con 0x7eff1c06e240 2024-04-24T08:26:36.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.520+0000 7eff32a00640 1 -- 172.21.15.88:0/1836751300 <== osd.0 v2:172.21.15.88:6800/3837730046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7eff3c13dad0 con 0x7eff1c06e240 2024-04-24T08:26:36.525 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:26:36.526 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T08:26:36.526 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:26:36.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.524+0000 7eff41a00640 1 -- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] conn(0x7eff1c06e240 msgr2=0x7eff1c070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.524+0000 7eff41a00640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:6800/3837730046,v1:172.21.15.88:6801/3837730046] conn(0x7eff1c06e240 0x7eff1c070660 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.524+0000 7eff41a00640 1 -- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7eff1c068380 msgr2=0x7eff1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.524+0000 7eff41a00640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7eff1c068380 0x7eff1c06a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7eff3c147a60 tx=0x7eff2c009040 comp rx=0 tx=0).stop 2024-04-24T08:26:36.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.524+0000 7eff41a00640 1 -- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c143f00 msgr2=0x7eff3c13ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.524+0000 7eff41a00640 1 --2- 172.21.15.88:0/1836751300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff3c143f00 0x7eff3c13ddf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7eff28018f90 tx=0x7eff2801abc0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.524+0000 7eff3b400640 1 -- 172.21.15.88:0/1836751300 reap_dead start 2024-04-24T08:26:36.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.524+0000 7eff41a00640 1 -- 172.21.15.88:0/1836751300 shutdown_connections 2024-04-24T08:26:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.524+0000 7eff41a00640 1 -- 172.21.15.88:0/1836751300 >> 172.21.15.88:0/1836751300 conn(0x7eff3c06c0d0 msgr2=0x7eff3c074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.524+0000 7eff41a00640 1 -- 172.21.15.88:0/1836751300 shutdown_connections 2024-04-24T08:26:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.524+0000 7eff41a00640 1 -- 172.21.15.88:0/1836751300 wait complete. 2024-04-24T08:26:36.544 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-24T08:26:36.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f13a6200640 1 Processor -- start 2024-04-24T08:26:36.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f13a6200640 1 -- start start 2024-04-24T08:26:36.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f13a6200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13a00b6630 0x7f13a0142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:36.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f13a6200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13a00b4ae0 0x7f13a01503d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:36.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f13a6200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13a00b6a10 con 0x7f13a00b7c70 2024-04-24T08:26:36.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f13a6200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f13a00b72b0 con 0x7f13a00b4ae0 2024-04-24T08:26:36.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f13a6200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f13a00b7500 con 0x7f13a00b6630 2024-04-24T08:26:36.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f139fe00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13a00b4ae0 0x7f13a01503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:36.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f139fe00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13a00b4ae0 0x7f13a01503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54344/0 (socket says 172.21.15.88:54344) 2024-04-24T08:26:36.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f139fe00640 1 -- 172.21.15.88:0/3653514682 learned_addr learned my addr 172.21.15.88:0/3653514682 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:36.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f139f400640 1 --2- 172.21.15.88:0/3653514682 >> v2:172.21.15.142:3300/0 conn(0x7f13a00b6630 0x7f13a0142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:36.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f139fe00640 1 -- 172.21.15.88:0/3653514682 >> v2:172.21.15.142:3300/0 conn(0x7f13a00b6630 msgr2=0x7f13a0142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:36.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f139fe00640 1 --2- 172.21.15.88:0/3653514682 >> v2:172.21.15.142:3300/0 conn(0x7f13a00b6630 0x7f13a0142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f139fe00640 1 -- 172.21.15.88:0/3653514682 >> v1:172.21.15.142:6789/0 conn(0x7f13a00b7c70 legacy=0x7f13a00b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.676+0000 7f139fe00640 1 -- 172.21.15.88:0/3653514682 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a00bbe80 con 0x7f13a00b4ae0 2024-04-24T08:26:36.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.680+0000 7f139fe00640 1 --2- 172.21.15.88:0/3653514682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00b4ae0 0x7f13a01503d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f13a0073990 tx=0x7f139801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2aa429f0552078a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:36.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.680+0000 7f139ea00640 1 -- 172.21.15.88:0/3653514682 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13980b0070 con 0x7f13a00b4ae0 2024-04-24T08:26:36.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.680+0000 7f139ea00640 1 -- 172.21.15.88:0/3653514682 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13980ab600 con 0x7f13a00b4ae0 2024-04-24T08:26:36.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.680+0000 7f139ea00640 1 -- 172.21.15.88:0/3653514682 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13980ab9d0 con 0x7f13a00b4ae0 2024-04-24T08:26:36.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.680+0000 7f13a6200640 1 -- 172.21.15.88:0/3653514682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00b4ae0 msgr2=0x7f13a01503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.680+0000 7f13a6200640 1 --2- 172.21.15.88:0/3653514682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00b4ae0 0x7f13a01503d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f13a0073990 tx=0x7f139801c400 comp rx=0 tx=0).stop 2024-04-24T08:26:36.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.680+0000 7f13a6200640 1 -- 172.21.15.88:0/3653514682 shutdown_connections 2024-04-24T08:26:36.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.680+0000 7f13a6200640 1 --2- 172.21.15.88:0/3653514682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00b4ae0 0x7f13a01503d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.680+0000 7f13a6200640 1 --2- 172.21.15.88:0/3653514682 >> v2:172.21.15.142:3300/0 conn(0x7f13a00b6630 0x7f13a0142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.680+0000 7f13a6200640 1 -- 172.21.15.88:0/3653514682 >> 172.21.15.88:0/3653514682 conn(0x7f13a0067ea0 msgr2=0x7f13a00bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:36.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.680+0000 7f13a6200640 1 -- 172.21.15.88:0/3653514682 shutdown_connections 2024-04-24T08:26:36.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.680+0000 7f13a6200640 1 -- 172.21.15.88:0/3653514682 wait complete. 2024-04-24T08:26:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f13a6200640 1 Processor -- start 2024-04-24T08:26:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f13a6200640 1 -- start start 2024-04-24T08:26:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f13a6200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a00b4ae0 0x7f13a014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f13a6200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a00b6630 0x7f13a01e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f13a6200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00b7c70 0x7f13a01e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f13a6200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f13a0153340 con 0x7f13a00b7c70 2024-04-24T08:26:36.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f13a6200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f13a00b2d50 con 0x7f13a00b4ae0 2024-04-24T08:26:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f13a6200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f13a01534c0 con 0x7f13a00b6630 2024-04-24T08:26:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f139fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00b7c70 0x7f13a01e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f139f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a00b4ae0 0x7f13a014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f139fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00b7c70 0x7f13a01e3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54358/0 (socket says 172.21.15.88:54358) 2024-04-24T08:26:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f139f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a00b4ae0 0x7f13a014ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.88:55994/0 (socket says 172.21.15.88:55994) 2024-04-24T08:26:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f139fe00640 1 -- 172.21.15.88:0/2941259098 learned_addr learned my addr 172.21.15.88:0/2941259098 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f1396a00640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a00b6630 0x7f13a01e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:36.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f139fe00640 1 -- 172.21.15.88:0/2941259098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a00b6630 msgr2=0x7f13a01e4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f139fe00640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a00b6630 0x7f13a01e4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f139fe00640 1 -- 172.21.15.88:0/2941259098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a00b4ae0 msgr2=0x7f13a014ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f139fe00640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a00b4ae0 0x7f13a014ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f139fe00640 1 -- 172.21.15.88:0/2941259098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a00aa840 con 0x7f13a00b7c70 2024-04-24T08:26:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f139fe00640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00b7c70 0x7f13a01e3f80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f139801a030 tx=0x7f13980191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f1397e00640 1 -- 172.21.15.88:0/2941259098 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13980b0040 con 0x7f13a00b7c70 2024-04-24T08:26:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f1397e00640 1 -- 172.21.15.88:0/2941259098 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13980b4430 con 0x7f13a00b7c70 2024-04-24T08:26:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f13a6200640 1 -- 172.21.15.88:0/2941259098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a00aab20 con 0x7f13a00b7c70 2024-04-24T08:26:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f1397e00640 1 -- 172.21.15.88:0/2941259098 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13980b4820 con 0x7f13a00b7c70 2024-04-24T08:26:36.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f13a6200640 1 -- 172.21.15.88:0/2941259098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a00a9640 con 0x7f13a00b7c70 2024-04-24T08:26:36.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.684+0000 7f13a6200640 1 -- 172.21.15.88:0/2941259098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a006c530 con 0x7f13a00b7c70 2024-04-24T08:26:36.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.688+0000 7f1397e00640 1 -- 172.21.15.88:0/2941259098 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f13980b49c0 con 0x7f13a00b7c70 2024-04-24T08:26:36.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.688+0000 7f1397e00640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f137c068380 0x7f137c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:36.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.688+0000 7f1397e00640 1 -- 172.21.15.88:0/2941259098 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f1398120290 con 0x7f13a00b7c70 2024-04-24T08:26:36.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.688+0000 7f139f400640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f137c068380 0x7f137c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:36.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.688+0000 7f139f400640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f137c068380 0x7f137c06a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1390009b60 tx=0x7f1390009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:36.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.692+0000 7f1397e00640 1 -- 172.21.15.88:0/2941259098 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1398016110 con 0x7f13a00b7c70 2024-04-24T08:26:36.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.848+0000 7f13a6200640 1 -- 172.21.15.88:0/2941259098 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f13a0146990 con 0x7f137c068380 2024-04-24T08:26:36.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.848+0000 7f1397e00640 1 -- 172.21.15.88:0/2941259098 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1390011ac0 con 0x7f137c068380 2024-04-24T08:26:36.854 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 0 to deep-scrub 2024-04-24T08:26:36.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.852+0000 7f13a6200640 1 -- 172.21.15.88:0/2941259098 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f137c068380 msgr2=0x7f137c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.852+0000 7f13a6200640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f137c068380 0x7f137c06a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1390009b60 tx=0x7f1390009190 comp rx=0 tx=0).stop 2024-04-24T08:26:36.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.852+0000 7f13a6200640 1 -- 172.21.15.88:0/2941259098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00b7c70 msgr2=0x7f13a01e3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:36.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.852+0000 7f13a6200640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00b7c70 0x7f13a01e3f80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f139801a030 tx=0x7f13980191a0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.852+0000 7f13a6200640 1 -- 172.21.15.88:0/2941259098 shutdown_connections 2024-04-24T08:26:36.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.852+0000 7f13a6200640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f137c068380 0x7f137c06a840 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.852+0000 7f13a6200640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13a00b7c70 0x7f13a01e3f80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.852+0000 7f13a6200640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a00b6630 0x7f13a01e4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.852+0000 7f13a6200640 1 --2- 172.21.15.88:0/2941259098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a00b4ae0 0x7f13a014ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.852+0000 7f13a6200640 1 -- 172.21.15.88:0/2941259098 >> 172.21.15.88:0/2941259098 conn(0x7f13a0067ea0 msgr2=0x7f13a0143a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.852+0000 7f13a6200640 1 -- 172.21.15.88:0/2941259098 shutdown_connections 2024-04-24T08:26:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:36.852+0000 7f13a6200640 1 -- 172.21.15.88:0/2941259098 wait complete. 2024-04-24T08:26:36.875 INFO:tasks.ceph:Scrubbing osd.1 2024-04-24T08:26:36.875 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-24T08:26:37.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.012+0000 7ff583000640 1 Processor -- start 2024-04-24T08:26:37.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.012+0000 7ff583000640 1 -- start start 2024-04-24T08:26:37.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.012+0000 7ff583000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff57c0b6500 0x7ff57c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.012+0000 7ff583000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff57c0b29d0 0x7ff57c13fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff583000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff57c13ff50 0x7ff57c149090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff583000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ff57c0b44e0 con 0x7ff57c0b29d0 2024-04-24T08:26:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff583000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff57c0b3a00 con 0x7ff57c0b6500 2024-04-24T08:26:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff583000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff57c0b68e0 con 0x7ff57c13ff50 2024-04-24T08:26:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff573400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff57c0b29d0 0x7ff57c13fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff573400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff57c0b29d0 0x7ff57c13fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54374/0 (socket says 172.21.15.88:54374) 2024-04-24T08:26:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff573400640 1 -- 172.21.15.88:0/3026344670 learned_addr learned my addr 172.21.15.88:0/3026344670 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff581000640 1 --2- 172.21.15.88:0/3026344670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff57c13ff50 0x7ff57c149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff57be00640 1 --2- 172.21.15.88:0/3026344670 >> v2:172.21.15.142:3300/0 conn(0x7ff57c0b6500 0x7ff57c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff573400640 1 -- 172.21.15.88:0/3026344670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff57c13ff50 msgr2=0x7ff57c149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:37.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff573400640 1 --2- 172.21.15.88:0/3026344670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff57c13ff50 0x7ff57c149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff573400640 1 -- 172.21.15.88:0/3026344670 >> v2:172.21.15.142:3300/0 conn(0x7ff57c0b6500 msgr2=0x7ff57c0b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:37.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff573400640 1 --2- 172.21.15.88:0/3026344670 >> v2:172.21.15.142:3300/0 conn(0x7ff57c0b6500 0x7ff57c0b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff573400640 1 -- 172.21.15.88:0/3026344670 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c0b7c50 con 0x7ff57c0b29d0 2024-04-24T08:26:37.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.016+0000 7ff573400640 1 --2- 172.21.15.88:0/3026344670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff57c0b29d0 0x7ff57c13fa10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0705b0 tx=0x7ff56401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea16dc715d743a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff57b400640 1 -- 172.21.15.88:0/3026344670 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5640b0070 con 0x7ff57c0b29d0 2024-04-24T08:26:37.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff57b400640 1 -- 172.21.15.88:0/3026344670 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5640ab600 con 0x7ff57c0b29d0 2024-04-24T08:26:37.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff57b400640 1 -- 172.21.15.88:0/3026344670 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5640ab9d0 con 0x7ff57c0b29d0 2024-04-24T08:26:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 -- 172.21.15.88:0/3026344670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff57c0b29d0 msgr2=0x7ff57c13fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 --2- 172.21.15.88:0/3026344670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff57c0b29d0 0x7ff57c13fa10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0705b0 tx=0x7ff56401c260 comp rx=0 tx=0).stop 2024-04-24T08:26:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 -- 172.21.15.88:0/3026344670 shutdown_connections 2024-04-24T08:26:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 --2- 172.21.15.88:0/3026344670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff57c13ff50 0x7ff57c149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 --2- 172.21.15.88:0/3026344670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff57c0b29d0 0x7ff57c13fa10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 --2- 172.21.15.88:0/3026344670 >> v2:172.21.15.142:3300/0 conn(0x7ff57c0b6500 0x7ff57c0b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 -- 172.21.15.88:0/3026344670 >> 172.21.15.88:0/3026344670 conn(0x7ff57c0bb4d0 msgr2=0x7ff57c0bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:37.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 -- 172.21.15.88:0/3026344670 shutdown_connections 2024-04-24T08:26:37.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 -- 172.21.15.88:0/3026344670 wait complete. 2024-04-24T08:26:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 Processor -- start 2024-04-24T08:26:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 -- start start 2024-04-24T08:26:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c0b29d0 0x7ff57c14a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff57c0b6500 0x7ff57c1de640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff57c13ff50 0x7ff57c14ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c0b73a0 con 0x7ff57c0b6500 2024-04-24T08:26:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c0b7220 con 0x7ff57c0b29d0 2024-04-24T08:26:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff583000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff57c0b4950 con 0x7ff57c13ff50 2024-04-24T08:26:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff573400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff57c0b6500 0x7ff57c1de640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff573400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff57c0b6500 0x7ff57c1de640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54382/0 (socket says 172.21.15.88:54382) 2024-04-24T08:26:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff573400640 1 -- 172.21.15.88:0/3611053216 learned_addr learned my addr 172.21.15.88:0/3611053216 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff581000640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff57c13ff50 0x7ff57c14ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff57be00640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c0b29d0 0x7ff57c14a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff573400640 1 -- 172.21.15.88:0/3611053216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff57c13ff50 msgr2=0x7ff57c14ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff573400640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff57c13ff50 0x7ff57c14ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff573400640 1 -- 172.21.15.88:0/3611053216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c0b29d0 msgr2=0x7ff57c14a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff573400640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c0b29d0 0x7ff57c14a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff573400640 1 -- 172.21.15.88:0/3611053216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c14c340 con 0x7ff57c0b6500 2024-04-24T08:26:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.020+0000 7ff573400640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff57c0b6500 0x7ff57c1de640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff56401a910 tx=0x7ff564019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff578c00640 1 -- 172.21.15.88:0/3611053216 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5640b9070 con 0x7ff57c0b6500 2024-04-24T08:26:37.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff578c00640 1 -- 172.21.15.88:0/3611053216 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5640b4400 con 0x7ff57c0b6500 2024-04-24T08:26:37.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff583000640 1 -- 172.21.15.88:0/3611053216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57c14c620 con 0x7ff57c0b6500 2024-04-24T08:26:37.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff578c00640 1 -- 172.21.15.88:0/3611053216 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5640b0040 con 0x7ff57c0b6500 2024-04-24T08:26:37.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff583000640 1 -- 172.21.15.88:0/3611053216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57c142070 con 0x7ff57c0b6500 2024-04-24T08:26:37.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff583000640 1 -- 172.21.15.88:0/3611053216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff57c142f40 con 0x7ff57c0b6500 2024-04-24T08:26:37.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff578c00640 1 -- 172.21.15.88:0/3611053216 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff5640bc070 con 0x7ff57c0b6500 2024-04-24T08:26:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff578c00640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff5580683b0 0x7ff55806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff578c00640 1 -- 172.21.15.88:0/3611053216 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7ff56411fe10 con 0x7ff57c0b6500 2024-04-24T08:26:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff57be00640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff5580683b0 0x7ff55806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff578c00640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] conn(0x7ff55806e270 0x7ff558070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff578c00640 1 -- 172.21.15.88:0/3611053216 --> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff56400af30 con 0x7ff55806e270 2024-04-24T08:26:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff578c00640 1 -- 172.21.15.88:0/3611053216 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff5641201c0 con 0x7ff57c0b6500 2024-04-24T08:26:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff581000640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] conn(0x7ff55806e270 0x7ff558070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.024+0000 7ff57be00640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff5580683b0 0x7ff55806a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0694a0 tx=0x7ff56c009830 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.028+0000 7ff581000640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] conn(0x7ff55806e270 0x7ff558070690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.028+0000 7ff578c00640 1 -- 172.21.15.88:0/3611053216 <== osd.1 v2:172.21.15.88:6816/1351635476 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff56400af30 con 0x7ff55806e270 2024-04-24T08:26:37.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff583000640 1 -- 172.21.15.88:0/3611053216 --> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff57c142c30 con 0x7ff55806e270 2024-04-24T08:26:37.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff578c00640 1 -- 172.21.15.88:0/3611053216 <== osd.1 v2:172.21.15.88:6816/1351635476 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff57c142c30 con 0x7ff55806e270 2024-04-24T08:26:37.044 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:26:37.044 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T08:26:37.044 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:26:37.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff583000640 1 -- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] conn(0x7ff55806e270 msgr2=0x7ff558070690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff583000640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:6816/1351635476,v1:172.21.15.88:6818/1351635476] conn(0x7ff55806e270 0x7ff558070690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff583000640 1 -- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff5580683b0 msgr2=0x7ff55806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff583000640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7ff5580683b0 0x7ff55806a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0694a0 tx=0x7ff56c009830 comp rx=0 tx=0).stop 2024-04-24T08:26:37.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff583000640 1 -- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff57c0b6500 msgr2=0x7ff57c1de640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff583000640 1 --2- 172.21.15.88:0/3611053216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff57c0b6500 0x7ff57c1de640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff56401a910 tx=0x7ff564019000 comp rx=0 tx=0).stop 2024-04-24T08:26:37.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff581000640 1 -- 172.21.15.88:0/3611053216 reap_dead start 2024-04-24T08:26:37.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff583000640 1 -- 172.21.15.88:0/3611053216 shutdown_connections 2024-04-24T08:26:37.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff583000640 1 -- 172.21.15.88:0/3611053216 >> 172.21.15.88:0/3611053216 conn(0x7ff57c0bb4d0 msgr2=0x7ff57c074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:37.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff583000640 1 -- 172.21.15.88:0/3611053216 shutdown_connections 2024-04-24T08:26:37.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.040+0000 7ff583000640 1 -- 172.21.15.88:0/3611053216 wait complete. 2024-04-24T08:26:37.063 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-24T08:26:37.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f6187600640 1 Processor -- start 2024-04-24T08:26:37.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f6187600640 1 -- start start 2024-04-24T08:26:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f6187600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618006e750 0x7f61800b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f6187600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f61800b7b90 0x7f6180152650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f6187600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618006eb30 con 0x7f61800b2180 2024-04-24T08:26:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f6187600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f618006dfd0 con 0x7f61800b7b90 2024-04-24T08:26:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f6187600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6180147d90 con 0x7f618006e750 2024-04-24T08:26:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617fe00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f61800b2180 0x7f6180148290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53034/0 (socket says 172.21.15.88:53034) 2024-04-24T08:26:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617fe00640 1 -- 172.21.15.88:0/3638990965 learned_addr learned my addr 172.21.15.88:0/3638990965 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f6184c00640 1 --2- 172.21.15.88:0/3638990965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618006e750 0x7f61800b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f6185600640 1 --2- 172.21.15.88:0/3638990965 >> v2:172.21.15.142:3300/0 conn(0x7f61800b7b90 0x7f6180152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 730211600 0 0) 0x7f618006eb30 con 0x7f61800b2180 2024-04-24T08:26:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6164003530 con 0x7f61800b2180 2024-04-24T08:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 112841925 0 0) 0x7f6164003530 con 0x7f61800b2180 2024-04-24T08:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618006e750 msgr2=0x7f61800b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 --2- 172.21.15.88:0/3638990965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618006e750 0x7f61800b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 >> v2:172.21.15.142:3300/0 conn(0x7f61800b7b90 msgr2=0x7f6180152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 --2- 172.21.15.88:0/3638990965 >> v2:172.21.15.142:3300/0 conn(0x7f61800b7b90 0x7f6180152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618006cd80 con 0x7f61800b2180 2024-04-24T08:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f616c001680 con 0x7f61800b2180 2024-04-24T08:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f6185600640 1 --2- 172.21.15.88:0/3638990965 >> v2:172.21.15.142:3300/0 conn(0x7f61800b7b90 0x7f6180152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:37.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 >> v1:172.21.15.88:6789/0 conn(0x7f61800b2180 legacy=0x7f6180148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 --2- 172.21.15.88:0/3638990965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61640039c0 0x7f6164003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 --2- 172.21.15.88:0/3638990965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6164004810 0x7f6164004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 --2- 172.21.15.88:0/3638990965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618006e750 0x7f61640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f618006dfd0 con 0x7f6164004810 2024-04-24T08:26:37.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6180147d90 con 0x7f61640039c0 2024-04-24T08:26:37.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f616400bb30 con 0x7f618006e750 2024-04-24T08:26:37.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f617fe00640 1 --2- 172.21.15.88:0/3638990965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6164004810 0x7f6164004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f6184c00640 1 --2- 172.21.15.88:0/3638990965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61640039c0 0x7f6164003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.196+0000 7f6185600640 1 --2- 172.21.15.88:0/3638990965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618006e750 0x7f61640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f617fe00640 1 -- 172.21.15.88:0/3638990965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618006e750 msgr2=0x7f61640051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:37.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f617fe00640 1 --2- 172.21.15.88:0/3638990965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618006e750 0x7f61640051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f617fe00640 1 -- 172.21.15.88:0/3638990965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61640039c0 msgr2=0x7f6164003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:37.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f617fe00640 1 --2- 172.21.15.88:0/3638990965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61640039c0 0x7f6164003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f617fe00640 1 -- 172.21.15.88:0/3638990965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6164003530 con 0x7f6164004810 2024-04-24T08:26:37.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f617fe00640 1 --2- 172.21.15.88:0/3638990965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6164004810 0x7f6164004c90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f61800b2580 tx=0x7f616c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78742258bf273c87 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c007d40 con 0x7f6164004810 2024-04-24T08:26:37.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616c0a9020 con 0x7f6164004810 2024-04-24T08:26:37.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f617f400640 1 -- 172.21.15.88:0/3638990965 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c005ae0 con 0x7f6164004810 2024-04-24T08:26:37.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f6187600640 1 -- 172.21.15.88:0/3638990965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6164004810 msgr2=0x7f6164004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f6187600640 1 --2- 172.21.15.88:0/3638990965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6164004810 0x7f6164004c90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f61800b2580 tx=0x7f616c01cc20 comp rx=0 tx=0).stop 2024-04-24T08:26:37.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f6185600640 1 -- 172.21.15.88:0/3638990965 reap_dead start 2024-04-24T08:26:37.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f6187600640 1 -- 172.21.15.88:0/3638990965 shutdown_connections 2024-04-24T08:26:37.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f6187600640 1 -- 172.21.15.88:0/3638990965 >> 172.21.15.88:0/3638990965 conn(0x7f61800bb4d0 msgr2=0x7f61800bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:37.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f6187600640 1 -- 172.21.15.88:0/3638990965 shutdown_connections 2024-04-24T08:26:37.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.200+0000 7f6187600640 1 -- 172.21.15.88:0/3638990965 wait complete. 2024-04-24T08:26:37.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6187600640 1 Processor -- start 2024-04-24T08:26:37.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6187600640 1 -- start start 2024-04-24T08:26:37.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6187600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6164004810 0x7f6180142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6187600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61801e4700 0x7f61801e4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6187600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618013b5f0 0x7f618013ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6187600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6180153730 con 0x7f6164004810 2024-04-24T08:26:37.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6187600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f61801535b0 con 0x7f61801e4700 2024-04-24T08:26:37.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6187600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f61801538b0 con 0x7f618013b5f0 2024-04-24T08:26:37.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6184c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6164004810 0x7f6180142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6184c00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6164004810 0x7f6180142960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54404/0 (socket says 172.21.15.88:54404) 2024-04-24T08:26:37.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6184c00640 1 -- 172.21.15.88:0/2710084292 learned_addr learned my addr 172.21.15.88:0/2710084292 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:37.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f617fe00640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61801e4700 0x7f61801e4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6185600640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618013b5f0 0x7f618013ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6184c00640 1 -- 172.21.15.88:0/2710084292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618013b5f0 msgr2=0x7f618013ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6184c00640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618013b5f0 0x7f618013ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6184c00640 1 -- 172.21.15.88:0/2710084292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61801e4700 msgr2=0x7f61801e4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6184c00640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61801e4700 0x7f61801e4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6184c00640 1 -- 172.21.15.88:0/2710084292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61801e50c0 con 0x7f6164004810 2024-04-24T08:26:37.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6184c00640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6164004810 0x7f6180142960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f61700045c0 tx=0x7f6170007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f617cc00640 1 -- 172.21.15.88:0/2710084292 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170015420 con 0x7f6164004810 2024-04-24T08:26:37.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f617cc00640 1 -- 172.21.15.88:0/2710084292 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617001a070 con 0x7f6164004810 2024-04-24T08:26:37.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f617cc00640 1 -- 172.21.15.88:0/2710084292 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170015800 con 0x7f6164004810 2024-04-24T08:26:37.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6187600640 1 -- 172.21.15.88:0/2710084292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6180144ff0 con 0x7f6164004810 2024-04-24T08:26:37.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.204+0000 7f6187600640 1 -- 172.21.15.88:0/2710084292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6180143ce0 con 0x7f6164004810 2024-04-24T08:26:37.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.208+0000 7f6187600640 1 -- 172.21.15.88:0/2710084292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6180068b20 con 0x7f6164004810 2024-04-24T08:26:37.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.208+0000 7f617cc00640 1 -- 172.21.15.88:0/2710084292 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f61700159a0 con 0x7f6164004810 2024-04-24T08:26:37.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.208+0000 7f617cc00640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f61600683b0 0x7f616006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.208+0000 7f617cc00640 1 -- 172.21.15.88:0/2710084292 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f6170086f60 con 0x7f6164004810 2024-04-24T08:26:37.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.208+0000 7f617fe00640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f61600683b0 0x7f616006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.208+0000 7f617fe00640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f61600683b0 0x7f616006a870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f616c0aa000 tx=0x7f618006d220 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.212+0000 7f617cc00640 1 -- 172.21.15.88:0/2710084292 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f61801e50c0 con 0x7f6164004810 2024-04-24T08:26:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.368+0000 7f6187600640 1 -- 172.21.15.88:0/2710084292 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f61801e4320 con 0x7f61600683b0 2024-04-24T08:26:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.368+0000 7f617cc00640 1 -- 172.21.15.88:0/2710084292 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f61801e4320 con 0x7f61600683b0 2024-04-24T08:26:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 1 to deep-scrub 2024-04-24T08:26:37.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.372+0000 7f6187600640 1 -- 172.21.15.88:0/2710084292 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f61600683b0 msgr2=0x7f616006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.372+0000 7f6187600640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f61600683b0 0x7f616006a870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f616c0aa000 tx=0x7f618006d220 comp rx=0 tx=0).stop 2024-04-24T08:26:37.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.372+0000 7f6187600640 1 -- 172.21.15.88:0/2710084292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6164004810 msgr2=0x7f6180142960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.372+0000 7f6187600640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6164004810 0x7f6180142960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f61700045c0 tx=0x7f6170007700 comp rx=0 tx=0).stop 2024-04-24T08:26:37.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.372+0000 7f6187600640 1 -- 172.21.15.88:0/2710084292 shutdown_connections 2024-04-24T08:26:37.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.372+0000 7f6187600640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f61600683b0 0x7f616006a870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.372+0000 7f6187600640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f618013b5f0 0x7f618013ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.372+0000 7f6187600640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61801e4700 0x7f61801e4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.372+0000 7f6187600640 1 --2- 172.21.15.88:0/2710084292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6164004810 0x7f6180142960 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.372+0000 7f6187600640 1 -- 172.21.15.88:0/2710084292 >> 172.21.15.88:0/2710084292 conn(0x7f61800bb4d0 msgr2=0x7f6180146240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:37.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.372+0000 7f6187600640 1 -- 172.21.15.88:0/2710084292 shutdown_connections 2024-04-24T08:26:37.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.372+0000 7f6187600640 1 -- 172.21.15.88:0/2710084292 wait complete. 2024-04-24T08:26:37.393 INFO:tasks.ceph:Scrubbing osd.2 2024-04-24T08:26:37.393 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-24T08:26:37.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.528+0000 7f23ab800640 1 Processor -- start 2024-04-24T08:26:37.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.528+0000 7f23ab800640 1 -- start start 2024-04-24T08:26:37.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.528+0000 7f23ab800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23a406d210 0x7f23a40afa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.528+0000 7f23ab800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23a40affa0 0x7f23a414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.528+0000 7f23ab800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a409e200 con 0x7f23a409cf30 2024-04-24T08:26:37.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.528+0000 7f23ab800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f23a40b3e20 con 0x7f23a406d210 2024-04-24T08:26:37.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.528+0000 7f23ab800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f23a4144220 con 0x7f23a40affa0 2024-04-24T08:26:37.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a9800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23a40affa0 0x7f23a414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a3e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23a406d210 0x7f23a40afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a8e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f23a409cf30 0x7f23a41449c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.88:45554/0 (socket says 172.21.15.88:45554) 2024-04-24T08:26:37.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a8e00640 1 -- 172.21.15.88:0/1323462036 learned_addr learned my addr 172.21.15.88:0/1323462036 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:37.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a9800640 1 -- 172.21.15.88:0/1323462036 >> v2:172.21.15.142:3300/0 conn(0x7f23a406d210 msgr2=0x7f23a40afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:37.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a9800640 1 --2- 172.21.15.88:0/1323462036 >> v2:172.21.15.142:3300/0 conn(0x7f23a406d210 0x7f23a40afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a9800640 1 -- 172.21.15.88:0/1323462036 >> v1:172.21.15.142:6789/0 conn(0x7f23a409cf30 legacy=0x7f23a41449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a3400640 1 -- 172.21.15.88:0/1323462036 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2304089512 0 0) 0x7f23a409e200 con 0x7f23a409cf30 2024-04-24T08:26:37.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a9800640 1 -- 172.21.15.88:0/1323462036 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a409d310 con 0x7f23a40affa0 2024-04-24T08:26:37.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a9800640 1 --2- 172.21.15.88:0/1323462036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23a40affa0 0x7f23a414eac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f239c0097c0 tx=0x7f239c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9512730f083853ca server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a3400640 1 -- 172.21.15.88:0/1323462036 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c0b0070 con 0x7f23a40affa0 2024-04-24T08:26:37.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a3400640 1 -- 172.21.15.88:0/1323462036 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f239c0ab600 con 0x7f23a40affa0 2024-04-24T08:26:37.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.532+0000 7f23a3400640 1 -- 172.21.15.88:0/1323462036 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c0ab9d0 con 0x7f23a40affa0 2024-04-24T08:26:37.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 -- 172.21.15.88:0/1323462036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23a40affa0 msgr2=0x7f23a414eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 --2- 172.21.15.88:0/1323462036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23a40affa0 0x7f23a414eac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f239c0097c0 tx=0x7f239c01c4a0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 -- 172.21.15.88:0/1323462036 shutdown_connections 2024-04-24T08:26:37.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 --2- 172.21.15.88:0/1323462036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23a40affa0 0x7f23a414eac0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 --2- 172.21.15.88:0/1323462036 >> v2:172.21.15.142:3300/0 conn(0x7f23a406d210 0x7f23a40afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 -- 172.21.15.88:0/1323462036 >> 172.21.15.88:0/1323462036 conn(0x7f23a406c0d0 msgr2=0x7f23a40b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:37.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 -- 172.21.15.88:0/1323462036 shutdown_connections 2024-04-24T08:26:37.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 -- 172.21.15.88:0/1323462036 wait complete. 2024-04-24T08:26:37.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 Processor -- start 2024-04-24T08:26:37.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 -- start start 2024-04-24T08:26:37.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23a406d210 0x7f23a40b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23a409cf30 0x7f23a40b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23a40affa0 0x7f23a41475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f23a409c4d0 con 0x7f23a406d210 2024-04-24T08:26:37.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f23a40b5c60 con 0x7f23a409cf30 2024-04-24T08:26:37.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23ab800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f23a40b9b30 con 0x7f23a40affa0 2024-04-24T08:26:37.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23a8e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23a406d210 0x7f23a40b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23a8e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23a406d210 0x7f23a40b6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54418/0 (socket says 172.21.15.88:54418) 2024-04-24T08:26:37.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23a8e00640 1 -- 172.21.15.88:0/3893422480 learned_addr learned my addr 172.21.15.88:0/3893422480 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:37.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23a3e00640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23a409cf30 0x7f23a40b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23a9800640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23a40affa0 0x7f23a41475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23a8e00640 1 -- 172.21.15.88:0/3893422480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23a40affa0 msgr2=0x7f23a41475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23a8e00640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23a40affa0 0x7f23a41475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23a8e00640 1 -- 172.21.15.88:0/3893422480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23a409cf30 msgr2=0x7f23a40b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23a8e00640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23a409cf30 0x7f23a40b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23a8e00640 1 -- 172.21.15.88:0/3893422480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a409c270 con 0x7f23a406d210 2024-04-24T08:26:37.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.536+0000 7f23a8e00640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23a406d210 0x7f23a40b6460 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f239400c890 tx=0x7f239400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23a0c00640 1 -- 172.21.15.88:0/3893422480 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394018070 con 0x7f23a406d210 2024-04-24T08:26:37.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23a0c00640 1 -- 172.21.15.88:0/3893422480 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f239400a640 con 0x7f23a406d210 2024-04-24T08:26:37.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23ab800640 1 -- 172.21.15.88:0/3893422480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a40b14e0 con 0x7f23a406d210 2024-04-24T08:26:37.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23a0c00640 1 -- 172.21.15.88:0/3893422480 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239400aa30 con 0x7f23a406d210 2024-04-24T08:26:37.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23ab800640 1 -- 172.21.15.88:0/3893422480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a40b09c0 con 0x7f23a406d210 2024-04-24T08:26:37.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23ab800640 1 -- 172.21.15.88:0/3893422480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f23a4068ca0 con 0x7f23a406d210 2024-04-24T08:26:37.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23a0c00640 1 -- 172.21.15.88:0/3893422480 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f239401b070 con 0x7f23a406d210 2024-04-24T08:26:37.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23a0c00640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2384068380 0x7f238406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23a0c00640 1 -- 172.21.15.88:0/3893422480 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f2394086270 con 0x7f23a406d210 2024-04-24T08:26:37.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23a3e00640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2384068380 0x7f238406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23a0c00640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] conn(0x7f238406e240 0x7f2384070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23a0c00640 1 -- 172.21.15.88:0/3893422480 --> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2384070d10 con 0x7f238406e240 2024-04-24T08:26:37.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23a0c00640 1 -- 172.21.15.88:0/3893422480 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2394086700 con 0x7f23a406d210 2024-04-24T08:26:37.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.540+0000 7f23a9800640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] conn(0x7f238406e240 0x7f2384070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.544+0000 7f23a3e00640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2384068380 0x7f238406a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f23a40b99e0 tx=0x7f2390008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.544+0000 7f23a9800640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] conn(0x7f238406e240 0x7f2384070660 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.544+0000 7f23a0c00640 1 -- 172.21.15.88:0/3893422480 <== osd.2 v2:172.21.15.88:6808/3194231011 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2384070d10 con 0x7f238406e240 2024-04-24T08:26:37.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23ab800640 1 -- 172.21.15.88:0/3893422480 --> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f23a40b3150 con 0x7f238406e240 2024-04-24T08:26:37.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23a0c00640 1 -- 172.21.15.88:0/3893422480 <== osd.2 v2:172.21.15.88:6808/3194231011 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f23a40b3150 con 0x7f238406e240 2024-04-24T08:26:37.560 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:26:37.560 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T08:26:37.560 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:26:37.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23ab800640 1 -- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] conn(0x7f238406e240 msgr2=0x7f2384070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23ab800640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:6808/3194231011,v1:172.21.15.88:6809/3194231011] conn(0x7f238406e240 0x7f2384070660 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23ab800640 1 -- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2384068380 msgr2=0x7f238406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23ab800640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2384068380 0x7f238406a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f23a40b99e0 tx=0x7f2390008040 comp rx=0 tx=0).stop 2024-04-24T08:26:37.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23ab800640 1 -- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23a406d210 msgr2=0x7f23a40b6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23ab800640 1 --2- 172.21.15.88:0/3893422480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23a406d210 0x7f23a40b6460 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f239400c890 tx=0x7f239400cd50 comp rx=0 tx=0).stop 2024-04-24T08:26:37.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23a9800640 1 -- 172.21.15.88:0/3893422480 reap_dead start 2024-04-24T08:26:37.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23ab800640 1 -- 172.21.15.88:0/3893422480 shutdown_connections 2024-04-24T08:26:37.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23ab800640 1 -- 172.21.15.88:0/3893422480 >> 172.21.15.88:0/3893422480 conn(0x7f23a406c0d0 msgr2=0x7f23a4142340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:37.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23ab800640 1 -- 172.21.15.88:0/3893422480 shutdown_connections 2024-04-24T08:26:37.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.556+0000 7f23ab800640 1 -- 172.21.15.88:0/3893422480 wait complete. 2024-04-24T08:26:37.578 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-24T08:26:37.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcfe00640 1 Processor -- start 2024-04-24T08:26:37.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcfe00640 1 -- start start 2024-04-24T08:26:37.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcfe00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2dd0067a70 0x7f2dd0141af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2dd00712c0 0x7f2dd0147a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcfe00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd00b9550 con 0x7f2dd0147fd0 2024-04-24T08:26:37.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcfe00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd0067e50 con 0x7f2dd0067a70 2024-04-24T08:26:37.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcfe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd0072ef0 con 0x7f2dd00712c0 2024-04-24T08:26:37.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcea00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2dd0067a70 0x7f2dd0141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcea00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2dd0067a70 0x7f2dd0141af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54422/0 (socket says 172.21.15.88:54422) 2024-04-24T08:26:37.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcea00640 1 -- 172.21.15.88:0/1408353948 learned_addr learned my addr 172.21.15.88:0/1408353948 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:37.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dce000640 1 --2- 172.21.15.88:0/1408353948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2dd00712c0 0x7f2dd0147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcea00640 1 -- 172.21.15.88:0/1408353948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2dd00712c0 msgr2=0x7f2dd0147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:37.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcea00640 1 --2- 172.21.15.88:0/1408353948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2dd00712c0 0x7f2dd0147a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcea00640 1 -- 172.21.15.88:0/1408353948 >> v1:172.21.15.142:6789/0 conn(0x7f2dd0147fd0 legacy=0x7f2dd014b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:37.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dcea00640 1 -- 172.21.15.88:0/1408353948 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd00731d0 con 0x7f2dd0067a70 2024-04-24T08:26:37.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.712+0000 7f2dce000640 1 --2- 172.21.15.88:0/1408353948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2dd00712c0 0x7f2dd0147a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:37.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.716+0000 7f2dcea00640 1 --2- 172.21.15.88:0/1408353948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd0067a70 0x7f2dd0141af0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009e50 tx=0x7f2dc001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1307cc68fddb2686 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.716+0000 7f2dcd600640 1 -- 172.21.15.88:0/1408353948 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00a5590 con 0x7f2dd0067a70 2024-04-24T08:26:37.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.716+0000 7f2dcd600640 1 -- 172.21.15.88:0/1408353948 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc00a5730 con 0x7f2dd0067a70 2024-04-24T08:26:37.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.716+0000 7f2dcd600640 1 -- 172.21.15.88:0/1408353948 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00a5b00 con 0x7f2dd0067a70 2024-04-24T08:26:37.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.716+0000 7f2dcfe00640 1 -- 172.21.15.88:0/1408353948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd0067a70 msgr2=0x7f2dd0141af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.716+0000 7f2dcfe00640 1 --2- 172.21.15.88:0/1408353948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd0067a70 0x7f2dd0141af0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009e50 tx=0x7f2dc001c9f0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.716+0000 7f2dcfe00640 1 -- 172.21.15.88:0/1408353948 shutdown_connections 2024-04-24T08:26:37.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.716+0000 7f2dcfe00640 1 --2- 172.21.15.88:0/1408353948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2dd00712c0 0x7f2dd0147a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.716+0000 7f2dcfe00640 1 --2- 172.21.15.88:0/1408353948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd0067a70 0x7f2dd0141af0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.716+0000 7f2dcfe00640 1 -- 172.21.15.88:0/1408353948 >> 172.21.15.88:0/1408353948 conn(0x7f2dd00b79e0 msgr2=0x7f2dd00b7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:37.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.716+0000 7f2dcfe00640 1 -- 172.21.15.88:0/1408353948 shutdown_connections 2024-04-24T08:26:37.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.716+0000 7f2dcfe00640 1 -- 172.21.15.88:0/1408353948 wait complete. 2024-04-24T08:26:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcfe00640 1 Processor -- start 2024-04-24T08:26:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcfe00640 1 -- start start 2024-04-24T08:26:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcfe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd0067a70 0x7f2dd0149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2dd00712c0 0x7f2dd013a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcfe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dd0147fd0 0x7f2dd01e3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcfe00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd01421b0 con 0x7f2dd0067a70 2024-04-24T08:26:37.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcfe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd0142030 con 0x7f2dd0147fd0 2024-04-24T08:26:37.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcfe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd0155430 con 0x7f2dd00712c0 2024-04-24T08:26:37.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcea00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd0067a70 0x7f2dd0149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcea00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd0067a70 0x7f2dd0149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54428/0 (socket says 172.21.15.88:54428) 2024-04-24T08:26:37.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcea00640 1 -- 172.21.15.88:0/2811286398 learned_addr learned my addr 172.21.15.88:0/2811286398 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:37.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dce000640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2dd00712c0 0x7f2dd013a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcf400640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dd0147fd0 0x7f2dd01e3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcea00640 1 -- 172.21.15.88:0/2811286398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2dd00712c0 msgr2=0x7f2dd013a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcea00640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2dd00712c0 0x7f2dd013a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcea00640 1 -- 172.21.15.88:0/2811286398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dd0147fd0 msgr2=0x7f2dd01e3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcea00640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dd0147fd0 0x7f2dd01e3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcea00640 1 -- 172.21.15.88:0/2811286398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd00b13d0 con 0x7f2dd0067a70 2024-04-24T08:26:37.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcf400640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dd0147fd0 0x7f2dd01e3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:37.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcea00640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd0067a70 0x7f2dd0149180 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2dc001b0a0 tx=0x7f2dc0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dc6a00640 1 -- 172.21.15.88:0/2811286398 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0009510 con 0x7f2dd0067a70 2024-04-24T08:26:37.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dc6a00640 1 -- 172.21.15.88:0/2811286398 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc00be070 con 0x7f2dd0067a70 2024-04-24T08:26:37.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dc6a00640 1 -- 172.21.15.88:0/2811286398 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00b88d0 con 0x7f2dd0067a70 2024-04-24T08:26:37.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcfe00640 1 -- 172.21.15.88:0/2811286398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd014a850 con 0x7f2dd0067a70 2024-04-24T08:26:37.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcfe00640 1 -- 172.21.15.88:0/2811286398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd014a050 con 0x7f2dd0067a70 2024-04-24T08:26:37.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.720+0000 7f2dcfe00640 1 -- 172.21.15.88:0/2811286398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd004fe10 con 0x7f2dd0067a70 2024-04-24T08:26:37.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.724+0000 7f2dc6a00640 1 -- 172.21.15.88:0/2811286398 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2dc00b8a70 con 0x7f2dd0067a70 2024-04-24T08:26:37.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.724+0000 7f2dc6a00640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2db0068380 0x7f2db006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:37.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.724+0000 7f2dc6a00640 1 -- 172.21.15.88:0/2811286398 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f2dc01217e0 con 0x7f2dd0067a70 2024-04-24T08:26:37.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.724+0000 7f2dce000640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2db0068380 0x7f2db006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:37.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.724+0000 7f2dce000640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2db0068380 0x7f2db006a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0141230 tx=0x7f2dbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:37.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.728+0000 7f2dc6a00640 1 -- 172.21.15.88:0/2811286398 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2dc00165e0 con 0x7f2dd0067a70 2024-04-24T08:26:37.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.884+0000 7f2dcfe00640 1 -- 172.21.15.88:0/2811286398 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f2dd0146790 con 0x7f2db0068380 2024-04-24T08:26:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dc6a00640 1 -- 172.21.15.88:0/2811286398 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2dd0146790 con 0x7f2db0068380 2024-04-24T08:26:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 2 to deep-scrub 2024-04-24T08:26:37.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dcfe00640 1 -- 172.21.15.88:0/2811286398 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2db0068380 msgr2=0x7f2db006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dcfe00640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2db0068380 0x7f2db006a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0141230 tx=0x7f2dbc008040 comp rx=0 tx=0).stop 2024-04-24T08:26:37.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dcfe00640 1 -- 172.21.15.88:0/2811286398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd0067a70 msgr2=0x7f2dd0149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:37.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dcfe00640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd0067a70 0x7f2dd0149180 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2dc001b0a0 tx=0x7f2dc0019790 comp rx=0 tx=0).stop 2024-04-24T08:26:37.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dcfe00640 1 -- 172.21.15.88:0/2811286398 shutdown_connections 2024-04-24T08:26:37.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dcfe00640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2db0068380 0x7f2db006a840 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dcfe00640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dd0147fd0 0x7f2dd01e3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dcfe00640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2dd00712c0 0x7f2dd013a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dcfe00640 1 --2- 172.21.15.88:0/2811286398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dd0067a70 0x7f2dd0149180 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:37.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dcfe00640 1 -- 172.21.15.88:0/2811286398 >> 172.21.15.88:0/2811286398 conn(0x7f2dd00b79e0 msgr2=0x7f2dd00b8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:37.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dcfe00640 1 -- 172.21.15.88:0/2811286398 shutdown_connections 2024-04-24T08:26:37.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:37.888+0000 7f2dcfe00640 1 -- 172.21.15.88:0/2811286398 wait complete. 2024-04-24T08:26:37.911 INFO:tasks.ceph:Scrubbing osd.3 2024-04-24T08:26:37.911 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-24T08:26:38.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc6a000640 1 Processor -- start 2024-04-24T08:26:38.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc6a000640 1 -- start start 2024-04-24T08:26:38.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc6a000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc64073010 0x7fbc640b7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc6a000640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc6406df60 con 0x7fbc6406e670 2024-04-24T08:26:38.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc6a000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc6406ea50 con 0x7fbc6406cbe0 2024-04-24T08:26:38.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc6a000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbc64148740 con 0x7fbc64073010 2024-04-24T08:26:38.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc62a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc64073010 0x7fbc640b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc63400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbc6406e670 0x7fbc64072900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33372/0 (socket says 172.21.15.88:33372) 2024-04-24T08:26:38.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc63400640 1 -- 172.21.15.88:0/2046755892 learned_addr learned my addr 172.21.15.88:0/2046755892 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:38.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc62a00640 1 -- 172.21.15.88:0/2046755892 >> v1:172.21.15.142:6789/0 conn(0x7fbc6406cbe0 legacy=0x7fbc640b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:38.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc62a00640 1 -- 172.21.15.88:0/2046755892 >> v1:172.21.15.88:6789/0 conn(0x7fbc6406e670 legacy=0x7fbc64072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc62a00640 1 -- 172.21.15.88:0/2046755892 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc64148a20 con 0x7fbc64073010 2024-04-24T08:26:38.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.048+0000 7fbc62000640 1 -- 172.21.15.88:0/2046755892 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707552026 0 0) 0x7fbc6406df60 con 0x7fbc6406e670 2024-04-24T08:26:38.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.052+0000 7fbc62a00640 1 --2- 172.21.15.88:0/2046755892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc64073010 0x7fbc640b7240 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbc500097c0 tx=0x7fbc5001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df25015df068f48d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.052+0000 7fbc62000640 1 -- 172.21.15.88:0/2046755892 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc500b0070 con 0x7fbc64073010 2024-04-24T08:26:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.052+0000 7fbc62000640 1 -- 172.21.15.88:0/2046755892 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc500ab600 con 0x7fbc64073010 2024-04-24T08:26:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.052+0000 7fbc62000640 1 -- 172.21.15.88:0/2046755892 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc500ab9d0 con 0x7fbc64073010 2024-04-24T08:26:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.052+0000 7fbc6a000640 1 -- 172.21.15.88:0/2046755892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc64073010 msgr2=0x7fbc640b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.052+0000 7fbc6a000640 1 --2- 172.21.15.88:0/2046755892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc64073010 0x7fbc640b7240 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbc500097c0 tx=0x7fbc5001c340 comp rx=0 tx=0).stop 2024-04-24T08:26:38.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.052+0000 7fbc6a000640 1 -- 172.21.15.88:0/2046755892 shutdown_connections 2024-04-24T08:26:38.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.052+0000 7fbc6a000640 1 --2- 172.21.15.88:0/2046755892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc64073010 0x7fbc640b7240 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.052+0000 7fbc6a000640 1 -- 172.21.15.88:0/2046755892 >> 172.21.15.88:0/2046755892 conn(0x7fbc640bb4d0 msgr2=0x7fbc640bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:38.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.052+0000 7fbc6a000640 1 -- 172.21.15.88:0/2046755892 shutdown_connections 2024-04-24T08:26:38.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.052+0000 7fbc6a000640 1 -- 172.21.15.88:0/2046755892 wait complete. 2024-04-24T08:26:38.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc6a000640 1 Processor -- start 2024-04-24T08:26:38.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc6a000640 1 -- start start 2024-04-24T08:26:38.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc6a000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc6406cbe0 0x7fbc640ad980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc6a000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc6406e670 0x7fbc640ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc6a000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc64073010 0x7fbc640acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc6a000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbc64141ff0 con 0x7fbc64073010 2024-04-24T08:26:38.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc6a000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbc64141e70 con 0x7fbc6406e670 2024-04-24T08:26:38.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc6a000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbc64142170 con 0x7fbc6406cbe0 2024-04-24T08:26:38.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc63e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc64073010 0x7fbc640acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc63e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc64073010 0x7fbc640acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51004/0 (socket says 172.21.15.88:51004) 2024-04-24T08:26:38.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc63e00640 1 -- 172.21.15.88:0/1092101795 learned_addr learned my addr 172.21.15.88:0/1092101795 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:38.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc62a00640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc6406e670 0x7fbc640ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc63400640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc6406cbe0 0x7fbc640ad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc63e00640 1 -- 172.21.15.88:0/1092101795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc6406cbe0 msgr2=0x7fbc640ad980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc63e00640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc6406cbe0 0x7fbc640ad980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc63e00640 1 -- 172.21.15.88:0/1092101795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc6406e670 msgr2=0x7fbc640ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc63e00640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc6406e670 0x7fbc640ac6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc63e00640 1 -- 172.21.15.88:0/1092101795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc640b1af0 con 0x7fbc64073010 2024-04-24T08:26:38.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc63e00640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc64073010 0x7fbc640acbf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00b970 tx=0x7fbc5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc5b400640 1 -- 172.21.15.88:0/1092101795 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c019070 con 0x7fbc64073010 2024-04-24T08:26:38.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc5b400640 1 -- 172.21.15.88:0/1092101795 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5c00cb40 con 0x7fbc64073010 2024-04-24T08:26:38.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc5b400640 1 -- 172.21.15.88:0/1092101795 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c014440 con 0x7fbc64073010 2024-04-24T08:26:38.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc6a000640 1 -- 172.21.15.88:0/1092101795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc640b2700 con 0x7fbc64073010 2024-04-24T08:26:38.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc6a000640 1 -- 172.21.15.88:0/1092101795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc641e3e60 con 0x7fbc64073010 2024-04-24T08:26:38.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.056+0000 7fbc6a000640 1 -- 172.21.15.88:0/1092101795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc64068ca0 con 0x7fbc64073010 2024-04-24T08:26:38.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.060+0000 7fbc5b400640 1 -- 172.21.15.88:0/1092101795 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbc5c01c070 con 0x7fbc64073010 2024-04-24T08:26:38.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.060+0000 7fbc5b400640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc44068380 0x7fbc4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.060+0000 7fbc5b400640 1 -- 172.21.15.88:0/1092101795 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7fbc5c086590 con 0x7fbc64073010 2024-04-24T08:26:38.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.060+0000 7fbc63400640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc44068380 0x7fbc4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.060+0000 7fbc5b400640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] conn(0x7fbc4406e240 0x7fbc44070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.060+0000 7fbc5b400640 1 -- 172.21.15.88:0/1092101795 --> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc44070d10 con 0x7fbc4406e240 2024-04-24T08:26:38.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.060+0000 7fbc5b400640 1 -- 172.21.15.88:0/1092101795 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbc5c086940 con 0x7fbc64073010 2024-04-24T08:26:38.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.060+0000 7fbc62a00640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] conn(0x7fbc4406e240 0x7fbc44070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.060+0000 7fbc63400640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc44068380 0x7fbc4406a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbc54007fd0 tx=0x7fbc54007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.060+0000 7fbc62a00640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] conn(0x7fbc4406e240 0x7fbc44070660 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.060+0000 7fbc5b400640 1 -- 172.21.15.88:0/1092101795 <== osd.3 v2:172.21.15.88:6817/3914165982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc44070d10 con 0x7fbc4406e240 2024-04-24T08:26:38.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc6a000640 1 -- 172.21.15.88:0/1092101795 --> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbc641e4640 con 0x7fbc4406e240 2024-04-24T08:26:38.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc5b400640 1 -- 172.21.15.88:0/1092101795 <== osd.3 v2:172.21.15.88:6817/3914165982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbc500b1040 con 0x7fbc4406e240 2024-04-24T08:26:38.079 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:26:38.079 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T08:26:38.079 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:26:38.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc6a000640 1 -- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] conn(0x7fbc4406e240 msgr2=0x7fbc44070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc6a000640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:6817/3914165982,v1:172.21.15.88:6820/3914165982] conn(0x7fbc4406e240 0x7fbc44070660 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc6a000640 1 -- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc44068380 msgr2=0x7fbc4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc6a000640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc44068380 0x7fbc4406a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbc54007fd0 tx=0x7fbc54007d60 comp rx=0 tx=0).stop 2024-04-24T08:26:38.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc6a000640 1 -- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc64073010 msgr2=0x7fbc640acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc6a000640 1 --2- 172.21.15.88:0/1092101795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc64073010 0x7fbc640acbf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00b970 tx=0x7fbc5c00be30 comp rx=0 tx=0).stop 2024-04-24T08:26:38.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc63e00640 1 -- 172.21.15.88:0/1092101795 reap_dead start 2024-04-24T08:26:38.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc6a000640 1 -- 172.21.15.88:0/1092101795 shutdown_connections 2024-04-24T08:26:38.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc6a000640 1 -- 172.21.15.88:0/1092101795 >> 172.21.15.88:0/1092101795 conn(0x7fbc640bb4d0 msgr2=0x7fbc640b8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:38.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc6a000640 1 -- 172.21.15.88:0/1092101795 shutdown_connections 2024-04-24T08:26:38.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.076+0000 7fbc6a000640 1 -- 172.21.15.88:0/1092101795 wait complete. 2024-04-24T08:26:38.098 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-24T08:26:38.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.228+0000 7f8a46800640 1 Processor -- start 2024-04-24T08:26:38.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.228+0000 7f8a46800640 1 -- start start 2024-04-24T08:26:38.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a46800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a4009b620 0x7f8a4009ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a46800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4009d430 con 0x7f8a4009c4d0 2024-04-24T08:26:38.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a46800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4009dea0 con 0x7f8a4009e2d0 2024-04-24T08:26:38.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a46800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8a4006eb30 con 0x7f8a4009b620 2024-04-24T08:26:38.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a36a00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8a4009c4d0 0x7f8a401492b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33380/0 (socket says 172.21.15.88:33380) 2024-04-24T08:26:38.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a36a00640 1 -- 172.21.15.88:0/1539213517 learned_addr learned my addr 172.21.15.88:0/1539213517 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:38.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3f400640 1 --2- 172.21.15.88:0/1539213517 >> v2:172.21.15.142:3300/0 conn(0x7f8a4009b620 0x7f8a4009ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3480576033 0 0) 0x7f8a4009d430 con 0x7f8a4009c4d0 2024-04-24T08:26:38.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a24003530 con 0x7f8a4009c4d0 2024-04-24T08:26:38.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 488825842 0 0) 0x7f8a24003530 con 0x7f8a4009c4d0 2024-04-24T08:26:38.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 >> v2:172.21.15.142:3300/0 conn(0x7f8a4009b620 msgr2=0x7f8a4009ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:38.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 --2- 172.21.15.88:0/1539213517 >> v2:172.21.15.142:3300/0 conn(0x7f8a4009b620 0x7f8a4009ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 >> v1:172.21.15.142:6789/0 conn(0x7f8a4009e2d0 legacy=0x7f8a40142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4009d6a0 con 0x7f8a4009c4d0 2024-04-24T08:26:38.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f8a28001680 con 0x7f8a4009c4d0 2024-04-24T08:26:38.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 >> v1:172.21.15.88:6789/0 conn(0x7f8a4009c4d0 legacy=0x7f8a401492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 --2- 172.21.15.88:0/1539213517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a240039c0 0x7f8a24003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 --2- 172.21.15.88:0/1539213517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 0x7f8a24004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 --2- 172.21.15.88:0/1539213517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a240051d0 0x7f8a2400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2400c140 con 0x7f8a24004810 2024-04-24T08:26:38.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2400c2f0 con 0x7f8a240039c0 2024-04-24T08:26:38.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2400c4f0 con 0x7f8a240051d0 2024-04-24T08:26:38.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a36a00640 1 --2- 172.21.15.88:0/1539213517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 0x7f8a24004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3f400640 1 --2- 172.21.15.88:0/1539213517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a240039c0 0x7f8a24003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3fe00640 1 --2- 172.21.15.88:0/1539213517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a240051d0 0x7f8a2400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a36a00640 1 -- 172.21.15.88:0/1539213517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a240051d0 msgr2=0x7f8a2400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:38.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a36a00640 1 --2- 172.21.15.88:0/1539213517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a240051d0 0x7f8a2400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a36a00640 1 -- 172.21.15.88:0/1539213517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a240039c0 msgr2=0x7f8a24003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:38.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a36a00640 1 --2- 172.21.15.88:0/1539213517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a240039c0 0x7f8a24003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a36a00640 1 -- 172.21.15.88:0/1539213517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a24003530 con 0x7f8a24004810 2024-04-24T08:26:38.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3f400640 1 --2- 172.21.15.88:0/1539213517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a240039c0 0x7f8a24003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:38.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.232+0000 7f8a3fe00640 1 -- 172.21.15.88:0/1539213517 reap_dead start 2024-04-24T08:26:38.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a36a00640 1 --2- 172.21.15.88:0/1539213517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 0x7f8a24004c90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8a40146e70 tx=0x7f8a2801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829af2ae0afb81cf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28007d20 con 0x7f8a24004810 2024-04-24T08:26:38.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a280a9070 con 0x7f8a24004810 2024-04-24T08:26:38.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a3ea00640 1 -- 172.21.15.88:0/1539213517 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28005d80 con 0x7f8a24004810 2024-04-24T08:26:38.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a46800640 1 -- 172.21.15.88:0/1539213517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 msgr2=0x7f8a24004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a46800640 1 --2- 172.21.15.88:0/1539213517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 0x7f8a24004c90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8a40146e70 tx=0x7f8a2801cc20 comp rx=0 tx=0).stop 2024-04-24T08:26:38.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a46800640 1 -- 172.21.15.88:0/1539213517 shutdown_connections 2024-04-24T08:26:38.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a46800640 1 --2- 172.21.15.88:0/1539213517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 0x7f8a24004c90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a46800640 1 -- 172.21.15.88:0/1539213517 >> 172.21.15.88:0/1539213517 conn(0x7f8a400b9420 msgr2=0x7f8a400b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:38.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a46800640 1 -- 172.21.15.88:0/1539213517 shutdown_connections 2024-04-24T08:26:38.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a46800640 1 -- 172.21.15.88:0/1539213517 wait complete. 2024-04-24T08:26:38.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a46800640 1 Processor -- start 2024-04-24T08:26:38.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.236+0000 7f8a46800640 1 -- start start 2024-04-24T08:26:38.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a46800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 0x7f8a4013f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a46800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a4013f820 0x7f8a401e0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a46800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a401e0fc0 0x7f8a401e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a46800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4006d600 con 0x7f8a24004810 2024-04-24T08:26:38.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a46800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4006d480 con 0x7f8a4013f820 2024-04-24T08:26:38.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a46800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4006d780 con 0x7f8a401e0fc0 2024-04-24T08:26:38.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a3f400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 0x7f8a4013f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a3f400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 0x7f8a4013f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51016/0 (socket says 172.21.15.88:51016) 2024-04-24T08:26:38.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a3f400640 1 -- 172.21.15.88:0/4093325722 learned_addr learned my addr 172.21.15.88:0/4093325722 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:38.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a3fe00640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a401e0fc0 0x7f8a401e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a36a00640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a4013f820 0x7f8a401e0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a3f400640 1 -- 172.21.15.88:0/4093325722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a401e0fc0 msgr2=0x7f8a401e3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a3f400640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a401e0fc0 0x7f8a401e3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a3f400640 1 -- 172.21.15.88:0/4093325722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a4013f820 msgr2=0x7f8a401e0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a3f400640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a4013f820 0x7f8a401e0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a3f400640 1 -- 172.21.15.88:0/4093325722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a400ae440 con 0x7f8a24004810 2024-04-24T08:26:38.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a3f400640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 0x7f8a4013f2e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8a30011900 tx=0x7f8a30011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a37e00640 1 -- 172.21.15.88:0/4093325722 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30004220 con 0x7f8a24004810 2024-04-24T08:26:38.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a37e00640 1 -- 172.21.15.88:0/4093325722 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a300043c0 con 0x7f8a24004810 2024-04-24T08:26:38.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a46800640 1 -- 172.21.15.88:0/4093325722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a400ae700 con 0x7f8a24004810 2024-04-24T08:26:38.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a37e00640 1 -- 172.21.15.88:0/4093325722 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3000fb70 con 0x7f8a24004810 2024-04-24T08:26:38.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a46800640 1 -- 172.21.15.88:0/4093325722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a400b0350 con 0x7f8a24004810 2024-04-24T08:26:38.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a46800640 1 -- 172.21.15.88:0/4093325722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4013fc00 con 0x7f8a24004810 2024-04-24T08:26:38.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.240+0000 7f8a37e00640 1 -- 172.21.15.88:0/4093325722 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a3000fd10 con 0x7f8a24004810 2024-04-24T08:26:38.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.244+0000 7f8a37e00640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8a1c068380 0x7f8a1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.244+0000 7f8a37e00640 1 -- 172.21.15.88:0/4093325722 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f8a300872f0 con 0x7f8a24004810 2024-04-24T08:26:38.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.244+0000 7f8a36a00640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8a1c068380 0x7f8a1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.244+0000 7f8a36a00640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8a1c068380 0x7f8a1c06a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8a280ab000 tx=0x7f8a280b0040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.248+0000 7f8a37e00640 1 -- 172.21.15.88:0/4093325722 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8a30019030 con 0x7f8a24004810 2024-04-24T08:26:38.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.404+0000 7f8a46800640 1 -- 172.21.15.88:0/4093325722 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f8a40068b20 con 0x7f8a1c068380 2024-04-24T08:26:38.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.404+0000 7f8a37e00640 1 -- 172.21.15.88:0/4093325722 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8a40068b20 con 0x7f8a1c068380 2024-04-24T08:26:38.408 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 3 to deep-scrub 2024-04-24T08:26:38.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.408+0000 7f8a46800640 1 -- 172.21.15.88:0/4093325722 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8a1c068380 msgr2=0x7f8a1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.408+0000 7f8a46800640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8a1c068380 0x7f8a1c06a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8a280ab000 tx=0x7f8a280b0040 comp rx=0 tx=0).stop 2024-04-24T08:26:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.408+0000 7f8a46800640 1 -- 172.21.15.88:0/4093325722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 msgr2=0x7f8a4013f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.408+0000 7f8a46800640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 0x7f8a4013f2e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8a30011900 tx=0x7f8a30011dc0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.408+0000 7f8a46800640 1 -- 172.21.15.88:0/4093325722 shutdown_connections 2024-04-24T08:26:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.408+0000 7f8a46800640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f8a1c068380 0x7f8a1c06a840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.408+0000 7f8a46800640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a401e0fc0 0x7f8a401e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.408+0000 7f8a46800640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a4013f820 0x7f8a401e0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.408+0000 7f8a46800640 1 --2- 172.21.15.88:0/4093325722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a24004810 0x7f8a4013f2e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.408+0000 7f8a46800640 1 -- 172.21.15.88:0/4093325722 >> 172.21.15.88:0/4093325722 conn(0x7f8a400b9420 msgr2=0x7f8a400b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.408+0000 7f8a46800640 1 -- 172.21.15.88:0/4093325722 shutdown_connections 2024-04-24T08:26:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.408+0000 7f8a46800640 1 -- 172.21.15.88:0/4093325722 wait complete. 2024-04-24T08:26:38.429 INFO:tasks.ceph:Scrubbing osd.4 2024-04-24T08:26:38.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-24T08:26:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.564+0000 7fd51a600640 1 Processor -- start 2024-04-24T08:26:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.564+0000 7fd51a600640 1 -- start start 2024-04-24T08:26:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd51a600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd5140af970 0x7fd5141535c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd51a600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5140b1040 con 0x7fd51406bd30 2024-04-24T08:26:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd51a600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd51406c110 con 0x7fd5140af4f0 2024-04-24T08:26:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd51a600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd51406c400 con 0x7fd5140af970 2024-04-24T08:26:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd513400640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd51406bd30 0x7fd5140b6610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33394/0 (socket says 172.21.15.88:33394) 2024-04-24T08:26:38.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd513400640 1 -- 172.21.15.88:0/1850833558 learned_addr learned my addr 172.21.15.88:0/1850833558 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:38.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd513e00640 1 --2- 172.21.15.88:0/1850833558 >> v2:172.21.15.142:3300/0 conn(0x7fd5140af970 0x7fd5141535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd512a00640 1 -- 172.21.15.88:0/1850833558 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428176598 0 0) 0x7fd5140b1040 con 0x7fd51406bd30 2024-04-24T08:26:38.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd512a00640 1 -- 172.21.15.88:0/1850833558 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4f8003530 con 0x7fd51406bd30 2024-04-24T08:26:38.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd513e00640 1 -- 172.21.15.88:0/1850833558 >> v1:172.21.15.142:6789/0 conn(0x7fd5140af4f0 legacy=0x7fd514141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd512a00640 1 -- 172.21.15.88:0/1850833558 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746385943 0 0) 0x7fd51406c110 con 0x7fd5140af4f0 2024-04-24T08:26:38.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd513e00640 1 -- 172.21.15.88:0/1850833558 >> v1:172.21.15.88:6789/0 conn(0x7fd51406bd30 legacy=0x7fd5140b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.568+0000 7fd513e00640 1 -- 172.21.15.88:0/1850833558 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5140b12e0 con 0x7fd5140af970 2024-04-24T08:26:38.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd513e00640 1 --2- 172.21.15.88:0/1850833558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5140af970 0x7fd5141535c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd51406c580 tx=0x7fd50c01c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e897bc86e1624e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd512a00640 1 -- 172.21.15.88:0/1850833558 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0a6630 con 0x7fd5140af970 2024-04-24T08:26:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd512a00640 1 -- 172.21.15.88:0/1850833558 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c0a67d0 con 0x7fd5140af970 2024-04-24T08:26:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd512a00640 1 -- 172.21.15.88:0/1850833558 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0a6ba0 con 0x7fd5140af970 2024-04-24T08:26:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 -- 172.21.15.88:0/1850833558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5140af970 msgr2=0x7fd5141535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 --2- 172.21.15.88:0/1850833558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5140af970 0x7fd5141535c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd51406c580 tx=0x7fd50c01c7e0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 -- 172.21.15.88:0/1850833558 shutdown_connections 2024-04-24T08:26:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 --2- 172.21.15.88:0/1850833558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5140af970 0x7fd5141535c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 -- 172.21.15.88:0/1850833558 >> 172.21.15.88:0/1850833558 conn(0x7fd5140b6fd0 msgr2=0x7fd5140b73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 -- 172.21.15.88:0/1850833558 shutdown_connections 2024-04-24T08:26:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 -- 172.21.15.88:0/1850833558 wait complete. 2024-04-24T08:26:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 Processor -- start 2024-04-24T08:26:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 -- start start 2024-04-24T08:26:38.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51406bd30 0x7fd5140b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5140af4f0 0x7fd5141e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5140af970 0x7fd5141e1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd5141568b0 con 0x7fd51406bd30 2024-04-24T08:26:38.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd514156730 con 0x7fd5140af970 2024-04-24T08:26:38.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd51a600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd514156a30 con 0x7fd5140af4f0 2024-04-24T08:26:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd513400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51406bd30 0x7fd5140b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd513400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51406bd30 0x7fd5140b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51020/0 (socket says 172.21.15.88:51020) 2024-04-24T08:26:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.572+0000 7fd513400640 1 -- 172.21.15.88:0/2743890322 learned_addr learned my addr 172.21.15.88:0/2743890322 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd50aa00640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5140af4f0 0x7fd5141e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd513e00640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5140af970 0x7fd5141e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd513400640 1 -- 172.21.15.88:0/2743890322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5140af4f0 msgr2=0x7fd5141e0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd513400640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5140af4f0 0x7fd5141e0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd513400640 1 -- 172.21.15.88:0/2743890322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5140af970 msgr2=0x7fd5141e1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd513400640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5140af970 0x7fd5141e1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd513400640 1 -- 172.21.15.88:0/2743890322 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5140b2690 con 0x7fd51406bd30 2024-04-24T08:26:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd513e00640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5140af970 0x7fd5141e1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:26:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd513400640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51406bd30 0x7fd5140b3850 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd50400c730 tx=0x7fd50400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd50be00640 1 -- 172.21.15.88:0/2743890322 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504017070 con 0x7fd51406bd30 2024-04-24T08:26:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd50be00640 1 -- 172.21.15.88:0/2743890322 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd504005cf0 con 0x7fd51406bd30 2024-04-24T08:26:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd51a600640 1 -- 172.21.15.88:0/2743890322 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51409d410 con 0x7fd51406bd30 2024-04-24T08:26:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd50be00640 1 -- 172.21.15.88:0/2743890322 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5040072b0 con 0x7fd51406bd30 2024-04-24T08:26:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd51a600640 1 -- 172.21.15.88:0/2743890322 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5140b2900 con 0x7fd51406bd30 2024-04-24T08:26:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd51a600640 1 -- 172.21.15.88:0/2743890322 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5140b2ce0 con 0x7fd51406bd30 2024-04-24T08:26:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd50be00640 1 -- 172.21.15.88:0/2743890322 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd50401a070 con 0x7fd51406bd30 2024-04-24T08:26:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd50be00640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd4f00683b0 0x7fd4f006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd50be00640 1 -- 172.21.15.88:0/2743890322 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7fd504086450 con 0x7fd51406bd30 2024-04-24T08:26:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.576+0000 7fd50aa00640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd4f00683b0 0x7fd4f006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.580+0000 7fd50be00640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] conn(0x7fd4f006e270 0x7fd4f0070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.580+0000 7fd50be00640 1 -- 172.21.15.88:0/2743890322 --> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd50400ae50 con 0x7fd4f006e270 2024-04-24T08:26:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.580+0000 7fd50be00640 1 -- 172.21.15.88:0/2743890322 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd504086800 con 0x7fd51406bd30 2024-04-24T08:26:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.580+0000 7fd513e00640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] conn(0x7fd4f006e270 0x7fd4f0070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.580+0000 7fd50aa00640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd4f00683b0 0x7fd4f006a870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd514145930 tx=0x7fd4fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.580+0000 7fd513e00640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] conn(0x7fd4f006e270 0x7fd4f0070690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.580+0000 7fd50be00640 1 -- 172.21.15.88:0/2743890322 <== osd.4 v2:172.21.15.142:6800/1785360205 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd50400ae50 con 0x7fd4f006e270 2024-04-24T08:26:38.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.592+0000 7fd51a600640 1 -- 172.21.15.88:0/2743890322 --> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd514068ca0 con 0x7fd4f006e270 2024-04-24T08:26:38.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.592+0000 7fd50be00640 1 -- 172.21.15.88:0/2743890322 <== osd.4 v2:172.21.15.142:6800/1785360205 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd514068ca0 con 0x7fd4f006e270 2024-04-24T08:26:38.597 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:26:38.597 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T08:26:38.597 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:26:38.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.592+0000 7fd51a600640 1 -- 172.21.15.88:0/2743890322 >> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] conn(0x7fd4f006e270 msgr2=0x7fd4f0070690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.592+0000 7fd51a600640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.142:6800/1785360205,v1:172.21.15.142:6801/1785360205] conn(0x7fd4f006e270 0x7fd4f0070690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.592+0000 7fd51a600640 1 -- 172.21.15.88:0/2743890322 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd4f00683b0 msgr2=0x7fd4f006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.592+0000 7fd51a600640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fd4f00683b0 0x7fd4f006a870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd514145930 tx=0x7fd4fc009040 comp rx=0 tx=0).stop 2024-04-24T08:26:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.592+0000 7fd51a600640 1 -- 172.21.15.88:0/2743890322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51406bd30 msgr2=0x7fd5140b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.592+0000 7fd51a600640 1 --2- 172.21.15.88:0/2743890322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51406bd30 0x7fd5140b3850 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd50400c730 tx=0x7fd50400cbf0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.592+0000 7fd513e00640 1 -- 172.21.15.88:0/2743890322 reap_dead start 2024-04-24T08:26:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.592+0000 7fd51a600640 1 -- 172.21.15.88:0/2743890322 shutdown_connections 2024-04-24T08:26:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.592+0000 7fd51a600640 1 -- 172.21.15.88:0/2743890322 >> 172.21.15.88:0/2743890322 conn(0x7fd5140b6fd0 msgr2=0x7fd51406ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:38.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.596+0000 7fd51a600640 1 -- 172.21.15.88:0/2743890322 shutdown_connections 2024-04-24T08:26:38.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.596+0000 7fd51a600640 1 -- 172.21.15.88:0/2743890322 wait complete. 2024-04-24T08:26:38.615 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-24T08:26:38.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc46400640 1 Processor -- start 2024-04-24T08:26:38.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc46400640 1 -- start start 2024-04-24T08:26:38.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc46400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc4009b620 0x7fbc4009ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc46400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc4009c4d0 0x7fbc401492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc46400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc4009d430 con 0x7fbc401497f0 2024-04-24T08:26:38.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc46400640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbc4006eb30 con 0x7fbc4009b620 2024-04-24T08:26:38.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc46400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4009dea0 con 0x7fbc4009c4d0 2024-04-24T08:26:38.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc3f400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc4009b620 0x7fbc4009ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc3f400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc4009b620 0x7fbc4009ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51024/0 (socket says 172.21.15.88:51024) 2024-04-24T08:26:38.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc3f400640 1 -- 172.21.15.88:0/878176017 learned_addr learned my addr 172.21.15.88:0/878176017 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:38.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc36a00640 1 --2- 172.21.15.88:0/878176017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc4009c4d0 0x7fbc401492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc3f400640 1 -- 172.21.15.88:0/878176017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc4009c4d0 msgr2=0x7fbc401492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:38.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc3f400640 1 --2- 172.21.15.88:0/878176017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc4009c4d0 0x7fbc401492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc3f400640 1 -- 172.21.15.88:0/878176017 >> v1:172.21.15.142:6789/0 conn(0x7fbc401497f0 legacy=0x7fbc4006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.748+0000 7fbc3f400640 1 -- 172.21.15.88:0/878176017 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4009d6a0 con 0x7fbc4009b620 2024-04-24T08:26:38.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.752+0000 7fbc3f400640 1 --2- 172.21.15.88:0/878176017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc4009b620 0x7fbc4009ba00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009870 tx=0x7fbc3001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc929390c3e54da8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.752+0000 7fbc3ea00640 1 -- 172.21.15.88:0/878176017 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc300b0070 con 0x7fbc4009b620 2024-04-24T08:26:38.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.752+0000 7fbc3ea00640 1 -- 172.21.15.88:0/878176017 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc300ab600 con 0x7fbc4009b620 2024-04-24T08:26:38.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.752+0000 7fbc3ea00640 1 -- 172.21.15.88:0/878176017 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc300ab9d0 con 0x7fbc4009b620 2024-04-24T08:26:38.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.752+0000 7fbc46400640 1 -- 172.21.15.88:0/878176017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc4009b620 msgr2=0x7fbc4009ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.752+0000 7fbc46400640 1 --2- 172.21.15.88:0/878176017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc4009b620 0x7fbc4009ba00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009870 tx=0x7fbc3001c4d0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.752+0000 7fbc46400640 1 -- 172.21.15.88:0/878176017 shutdown_connections 2024-04-24T08:26:38.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.752+0000 7fbc46400640 1 --2- 172.21.15.88:0/878176017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc4009c4d0 0x7fbc401492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.752+0000 7fbc46400640 1 --2- 172.21.15.88:0/878176017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc4009b620 0x7fbc4009ba00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.752+0000 7fbc46400640 1 -- 172.21.15.88:0/878176017 >> 172.21.15.88:0/878176017 conn(0x7fbc400b9420 msgr2=0x7fbc400b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:38.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.752+0000 7fbc46400640 1 -- 172.21.15.88:0/878176017 shutdown_connections 2024-04-24T08:26:38.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.752+0000 7fbc46400640 1 -- 172.21.15.88:0/878176017 wait complete. 2024-04-24T08:26:38.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc46400640 1 Processor -- start 2024-04-24T08:26:38.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc46400640 1 -- start start 2024-04-24T08:26:38.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc46400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc4009b620 0x7fbc400b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc46400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4009c4d0 0x7fbc401e4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc46400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc401497f0 0x7fbc401e45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc46400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbc40152c40 con 0x7fbc401497f0 2024-04-24T08:26:38.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc46400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbc40152ac0 con 0x7fbc4009c4d0 2024-04-24T08:26:38.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc46400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbc40152dc0 con 0x7fbc4009b620 2024-04-24T08:26:38.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc3fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc401497f0 0x7fbc401e45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc3fe00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc401497f0 0x7fbc401e45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51026/0 (socket says 172.21.15.88:51026) 2024-04-24T08:26:38.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc3f400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc4009b620 0x7fbc400b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc3fe00640 1 -- 172.21.15.88:0/4203865540 learned_addr learned my addr 172.21.15.88:0/4203865540 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:38.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc36a00640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4009c4d0 0x7fbc401e4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc3fe00640 1 -- 172.21.15.88:0/4203865540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc4009b620 msgr2=0x7fbc400b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc3fe00640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc4009b620 0x7fbc400b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc3fe00640 1 -- 172.21.15.88:0/4203865540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4009c4d0 msgr2=0x7fbc401e4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc3fe00640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4009c4d0 0x7fbc401e4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc3fe00640 1 -- 172.21.15.88:0/4203865540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4013f300 con 0x7fbc401497f0 2024-04-24T08:26:38.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc3fe00640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc401497f0 0x7fbc401e45b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800c3c0 tx=0x7fbc3800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc37e00640 1 -- 172.21.15.88:0/4203865540 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38005220 con 0x7fbc401497f0 2024-04-24T08:26:38.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc37e00640 1 -- 172.21.15.88:0/4203865540 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc380053c0 con 0x7fbc401497f0 2024-04-24T08:26:38.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc46400640 1 -- 172.21.15.88:0/4203865540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4013e000 con 0x7fbc401497f0 2024-04-24T08:26:38.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc37e00640 1 -- 172.21.15.88:0/4203865540 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38007270 con 0x7fbc401497f0 2024-04-24T08:26:38.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc46400640 1 -- 172.21.15.88:0/4203865540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc4013f5e0 con 0x7fbc401497f0 2024-04-24T08:26:38.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.756+0000 7fbc46400640 1 -- 172.21.15.88:0/4203865540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc40068b20 con 0x7fbc401497f0 2024-04-24T08:26:38.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.760+0000 7fbc37e00640 1 -- 172.21.15.88:0/4203865540 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbc38019020 con 0x7fbc401497f0 2024-04-24T08:26:38.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.760+0000 7fbc37e00640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc1c0683b0 0x7fbc1c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:38.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.760+0000 7fbc37e00640 1 -- 172.21.15.88:0/4203865540 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7fbc38085820 con 0x7fbc401497f0 2024-04-24T08:26:38.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.760+0000 7fbc3f400640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc1c0683b0 0x7fbc1c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:38.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.760+0000 7fbc3f400640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc1c0683b0 0x7fbc1c06a870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbc300ad000 tx=0x7fbc300a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:38.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.764+0000 7fbc37e00640 1 -- 172.21.15.88:0/4203865540 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbc38055a80 con 0x7fbc401497f0 2024-04-24T08:26:38.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 -- 172.21.15.88:0/4203865540 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fbc400b3850 con 0x7fbc1c0683b0 2024-04-24T08:26:38.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc37e00640 1 -- 172.21.15.88:0/4203865540 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbc400b3850 con 0x7fbc1c0683b0 2024-04-24T08:26:38.927 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 4 to deep-scrub 2024-04-24T08:26:38.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 -- 172.21.15.88:0/4203865540 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc1c0683b0 msgr2=0x7fbc1c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc1c0683b0 0x7fbc1c06a870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbc300ad000 tx=0x7fbc300a6000 comp rx=0 tx=0).stop 2024-04-24T08:26:38.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 -- 172.21.15.88:0/4203865540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc401497f0 msgr2=0x7fbc401e45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:38.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc401497f0 0x7fbc401e45b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800c3c0 tx=0x7fbc3800c880 comp rx=0 tx=0).stop 2024-04-24T08:26:38.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 -- 172.21.15.88:0/4203865540 shutdown_connections 2024-04-24T08:26:38.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fbc1c0683b0 0x7fbc1c06a870 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc401497f0 0x7fbc401e45b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4009c4d0 0x7fbc401e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 --2- 172.21.15.88:0/4203865540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc4009b620 0x7fbc400b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:38.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 -- 172.21.15.88:0/4203865540 >> 172.21.15.88:0/4203865540 conn(0x7fbc400b9420 msgr2=0x7fbc400b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:38.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 -- 172.21.15.88:0/4203865540 shutdown_connections 2024-04-24T08:26:38.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:38.924+0000 7fbc46400640 1 -- 172.21.15.88:0/4203865540 wait complete. 2024-04-24T08:26:38.947 INFO:tasks.ceph:Scrubbing osd.5 2024-04-24T08:26:38.947 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-24T08:26:39.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.084+0000 7f2cde400640 1 Processor -- start 2024-04-24T08:26:39.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.084+0000 7f2cde400640 1 -- start start 2024-04-24T08:26:39.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.084+0000 7f2cde400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80b6500 0x7f2cd80b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.084+0000 7f2cde400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2cd80b29d0 0x7f2cd813fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.084+0000 7f2cde400640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cd80b68e0 con 0x7f2cd813ff50 2024-04-24T08:26:39.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.084+0000 7f2cde400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2cd80b44e0 con 0x7f2cd80b29d0 2024-04-24T08:26:39.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.084+0000 7f2cde400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd80b3a00 con 0x7f2cd80b6500 2024-04-24T08:26:39.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.084+0000 7f2cd7e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2cd813ff50 0x7f2cd8149090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33410/0 (socket says 172.21.15.88:33410) 2024-04-24T08:26:39.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.084+0000 7f2cd7e00640 1 -- 172.21.15.88:0/213067784 learned_addr learned my addr 172.21.15.88:0/213067784 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:39.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.084+0000 7f2ccea00640 1 --2- 172.21.15.88:0/213067784 >> v2:172.21.15.142:3300/0 conn(0x7f2cd80b29d0 0x7f2cd813fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.084+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1666506199 0 0) 0x7f2cd80b68e0 con 0x7f2cd813ff50 2024-04-24T08:26:39.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.084+0000 7f2cd7400640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80b6500 0x7f2cd80b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cbc003530 con 0x7f2cd813ff50 2024-04-24T08:26:39.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 61482893 0 0) 0x7f2cbc003530 con 0x7f2cd813ff50 2024-04-24T08:26:39.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80b6500 msgr2=0x7f2cd80b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:39.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80b6500 0x7f2cd80b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 >> v2:172.21.15.142:3300/0 conn(0x7f2cd80b29d0 msgr2=0x7f2cd813fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:39.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 --2- 172.21.15.88:0/213067784 >> v2:172.21.15.142:3300/0 conn(0x7f2cd80b29d0 0x7f2cd813fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd80b7c50 con 0x7f2cd813ff50 2024-04-24T08:26:39.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7f2cd0001a00 con 0x7f2cd813ff50 2024-04-24T08:26:39.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 >> v1:172.21.15.88:6789/0 conn(0x7f2cd813ff50 legacy=0x7f2cd8149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cbc0039c0 0x7f2cbc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80b6500 0x7f2cbc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cbc004d50 0x7f2cbc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd80b44e0 con 0x7f2cbc004d50 2024-04-24T08:26:39.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd80b3a00 con 0x7f2cbc0039c0 2024-04-24T08:26:39.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2cbc00b9d0 con 0x7f2cd80b6500 2024-04-24T08:26:39.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd7e00640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cbc004d50 0x7f2cbc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd7400640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cbc0039c0 0x7f2cbc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2ccea00640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80b6500 0x7f2cbc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd7e00640 1 -- 172.21.15.88:0/213067784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80b6500 msgr2=0x7f2cbc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:39.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd7e00640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80b6500 0x7f2cbc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd7e00640 1 -- 172.21.15.88:0/213067784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cbc0039c0 msgr2=0x7f2cbc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd7e00640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cbc0039c0 0x7f2cbc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2cd7e00640 1 -- 172.21.15.88:0/213067784 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cbc003530 con 0x7f2cbc004d50 2024-04-24T08:26:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.088+0000 7f2ccea00640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80b6500 0x7f2cbc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:39.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cd7e00640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cbc004d50 0x7f2cbc0051d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000a880 tx=0x7f2cd001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb0e8d7124c6389 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd000a4a0 con 0x7f2cbc004d50 2024-04-24T08:26:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd00ad630 con 0x7f2cbc004d50 2024-04-24T08:26:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cd6a00640 1 -- 172.21.15.88:0/213067784 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd00ada20 con 0x7f2cbc004d50 2024-04-24T08:26:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 -- 172.21.15.88:0/213067784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cbc004d50 msgr2=0x7f2cbc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 --2- 172.21.15.88:0/213067784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cbc004d50 0x7f2cbc0051d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000a880 tx=0x7f2cd001d3a0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cd7e00640 1 -- 172.21.15.88:0/213067784 reap_dead start 2024-04-24T08:26:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 -- 172.21.15.88:0/213067784 shutdown_connections 2024-04-24T08:26:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 -- 172.21.15.88:0/213067784 >> 172.21.15.88:0/213067784 conn(0x7f2cd80bb4d0 msgr2=0x7f2cd80bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:39.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 -- 172.21.15.88:0/213067784 shutdown_connections 2024-04-24T08:26:39.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 -- 172.21.15.88:0/213067784 wait complete. 2024-04-24T08:26:39.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 Processor -- start 2024-04-24T08:26:39.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 -- start start 2024-04-24T08:26:39.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cbc004d50 0x7f2cd8140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd81e1000 0x7f2cd81e0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80ae6e0 0x7f2cd80aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd80b7220 con 0x7f2cd81e1000 2024-04-24T08:26:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd80b78c0 con 0x7f2cbc004d50 2024-04-24T08:26:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cde400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd80b73a0 con 0x7f2cd80ae6e0 2024-04-24T08:26:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2ccea00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd81e1000 0x7f2cd81e0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2ccea00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd81e1000 0x7f2cd81e0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51042/0 (socket says 172.21.15.88:51042) 2024-04-24T08:26:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2ccea00640 1 -- 172.21.15.88:0/1002035998 learned_addr learned my addr 172.21.15.88:0/1002035998 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cd7400640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cbc004d50 0x7f2cd8140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.092+0000 7f2cd7e00640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80ae6e0 0x7f2cd80aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccea00640 1 -- 172.21.15.88:0/1002035998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80ae6e0 msgr2=0x7f2cd80aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccea00640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80ae6e0 0x7f2cd80aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccea00640 1 -- 172.21.15.88:0/1002035998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cbc004d50 msgr2=0x7f2cd8140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccea00640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cbc004d50 0x7f2cd8140490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccea00640 1 -- 172.21.15.88:0/1002035998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd80adae0 con 0x7f2cd81e1000 2024-04-24T08:26:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2cd7e00640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd80ae6e0 0x7f2cd80aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccea00640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd81e1000 0x7f2cd81e0690 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0011650 tx=0x7f2cc0011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccfe00640 1 -- 172.21.15.88:0/1002035998 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0004220 con 0x7f2cd81e1000 2024-04-24T08:26:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccfe00640 1 -- 172.21.15.88:0/1002035998 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc00043c0 con 0x7f2cd81e1000 2024-04-24T08:26:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2cde400640 1 -- 172.21.15.88:0/1002035998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd80af180 con 0x7f2cd81e1000 2024-04-24T08:26:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccfe00640 1 -- 172.21.15.88:0/1002035998 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0015870 con 0x7f2cd81e1000 2024-04-24T08:26:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2cde400640 1 -- 172.21.15.88:0/1002035998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd8142690 con 0x7f2cd81e1000 2024-04-24T08:26:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2cde400640 1 -- 172.21.15.88:0/1002035998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2cd80ade70 con 0x7f2cd81e1000 2024-04-24T08:26:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccfe00640 1 -- 172.21.15.88:0/1002035998 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2cc0015a10 con 0x7f2cd81e1000 2024-04-24T08:26:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccfe00640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2cb40683b0 0x7f2cb406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccfe00640 1 -- 172.21.15.88:0/1002035998 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f2cc0086ca0 con 0x7f2cd81e1000 2024-04-24T08:26:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2cd7400640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2cb40683b0 0x7f2cb406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccfe00640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] conn(0x7f2cb406e270 0x7f2cb4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccfe00640 1 -- 172.21.15.88:0/1002035998 --> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cb4070d40 con 0x7f2cb406e270 2024-04-24T08:26:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.096+0000 7f2ccfe00640 1 -- 172.21.15.88:0/1002035998 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2cc00892c0 con 0x7f2cd81e1000 2024-04-24T08:26:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.100+0000 7f2cd7e00640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] conn(0x7f2cb406e270 0x7f2cb4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.100+0000 7f2cd7400640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2cb40683b0 0x7f2cb406a870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009b60 tx=0x7f2cc8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.100+0000 7f2cd7e00640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] conn(0x7f2cb406e270 0x7f2cb4070690 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.100+0000 7f2ccfe00640 1 -- 172.21.15.88:0/1002035998 <== osd.5 v2:172.21.15.142:6824/912007372 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2cb4070d40 con 0x7f2cb406e270 2024-04-24T08:26:39.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.112+0000 7f2cde400640 1 -- 172.21.15.88:0/1002035998 --> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2cd8068ca0 con 0x7f2cb406e270 2024-04-24T08:26:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.112+0000 7f2ccfe00640 1 -- 172.21.15.88:0/1002035998 <== osd.5 v2:172.21.15.142:6824/912007372 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2cd8068ca0 con 0x7f2cb406e270 2024-04-24T08:26:39.117 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:26:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T08:26:39.118 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:26:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.112+0000 7f2cde400640 1 -- 172.21.15.88:0/1002035998 >> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] conn(0x7f2cb406e270 msgr2=0x7f2cb4070690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.112+0000 7f2cde400640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.142:6824/912007372,v1:172.21.15.142:6825/912007372] conn(0x7f2cb406e270 0x7f2cb4070690 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.116+0000 7f2cde400640 1 -- 172.21.15.88:0/1002035998 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2cb40683b0 msgr2=0x7f2cb406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.116+0000 7f2cde400640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f2cb40683b0 0x7f2cb406a870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009b60 tx=0x7f2cc8009190 comp rx=0 tx=0).stop 2024-04-24T08:26:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.116+0000 7f2cde400640 1 -- 172.21.15.88:0/1002035998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd81e1000 msgr2=0x7f2cd81e0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.116+0000 7f2cde400640 1 --2- 172.21.15.88:0/1002035998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cd81e1000 0x7f2cd81e0690 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0011650 tx=0x7f2cc0011a50 comp rx=0 tx=0).stop 2024-04-24T08:26:39.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.116+0000 7f2cd7e00640 1 -- 172.21.15.88:0/1002035998 reap_dead start 2024-04-24T08:26:39.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.116+0000 7f2cde400640 1 -- 172.21.15.88:0/1002035998 shutdown_connections 2024-04-24T08:26:39.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.116+0000 7f2cde400640 1 -- 172.21.15.88:0/1002035998 >> 172.21.15.88:0/1002035998 conn(0x7f2cd80bb4d0 msgr2=0x7f2cd8074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:39.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.116+0000 7f2cde400640 1 -- 172.21.15.88:0/1002035998 shutdown_connections 2024-04-24T08:26:39.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.116+0000 7f2cde400640 1 -- 172.21.15.88:0/1002035998 wait complete. 2024-04-24T08:26:39.136 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-24T08:26:39.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.268+0000 7fe80e800640 1 Processor -- start 2024-04-24T08:26:39.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.268+0000 7fe80e800640 1 -- start start 2024-04-24T08:26:39.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe80e800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe80809c730 0x7fe808148130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe80e800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80806d920 0x7fe80814f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe80e800640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8080b4fd0 con 0x7fe8080b5760 2024-04-24T08:26:39.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe80e800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe8080b52d0 con 0x7fe80809c730 2024-04-24T08:26:39.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe80e800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe8080aeb30 con 0x7fe80806d920 2024-04-24T08:26:39.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe7fea00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe8080b5760 0x7fe80806d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33426/0 (socket says 172.21.15.88:33426) 2024-04-24T08:26:39.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe7fea00640 1 -- 172.21.15.88:0/3438180432 learned_addr learned my addr 172.21.15.88:0/3438180432 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:39.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe807e00640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80806d920 0x7fe80814f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe807400640 1 --2- 172.21.15.88:0/3438180432 >> v2:172.21.15.142:3300/0 conn(0x7fe80809c730 0x7fe808148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452648411 0 0) 0x7fe8080b4fd0 con 0x7fe8080b5760 2024-04-24T08:26:39.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7ec003530 con 0x7fe8080b5760 2024-04-24T08:26:39.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4112805787 0 0) 0x7fe7ec003530 con 0x7fe8080b5760 2024-04-24T08:26:39.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80806d920 msgr2=0x7fe80814f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:39.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80806d920 0x7fe80814f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 >> v2:172.21.15.142:3300/0 conn(0x7fe80809c730 msgr2=0x7fe808148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:39.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 --2- 172.21.15.88:0/3438180432 >> v2:172.21.15.142:3300/0 conn(0x7fe80809c730 0x7fe808148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe808148670 con 0x7fe8080b5760 2024-04-24T08:26:39.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4248019637 0 0) 0x7fe7f0001680 con 0x7fe8080b5760 2024-04-24T08:26:39.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 >> v1:172.21.15.88:6789/0 conn(0x7fe8080b5760 legacy=0x7fe80806d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7ec0039c0 0x7fe7ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7ec004810 0x7fe7ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80806d920 0x7fe7ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe8080b52d0 con 0x7fe7ec004810 2024-04-24T08:26:39.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe8080aeb30 con 0x7fe7ec0039c0 2024-04-24T08:26:39.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ec00b9d0 con 0x7fe80806d920 2024-04-24T08:26:39.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe7fea00640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7ec004810 0x7fe7ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe807400640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7ec0039c0 0x7fe7ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe807e00640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80806d920 0x7fe7ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe7fea00640 1 -- 172.21.15.88:0/3438180432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80806d920 msgr2=0x7fe7ec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:39.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe7fea00640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80806d920 0x7fe7ec0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe7fea00640 1 -- 172.21.15.88:0/3438180432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7ec0039c0 msgr2=0x7fe7ec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:39.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe7fea00640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7ec0039c0 0x7fe7ec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe7fea00640 1 -- 172.21.15.88:0/3438180432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec003530 con 0x7fe7ec004810 2024-04-24T08:26:39.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.272+0000 7fe807e00640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80806d920 0x7fe7ec0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:39.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe7fea00640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7ec004810 0x7fe7ec004c90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000c270 tx=0x7fe7f001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d24151a433bbd3d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0007d40 con 0x7fe7ec004810 2024-04-24T08:26:39.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f00a9020 con 0x7fe7ec004810 2024-04-24T08:26:39.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe806a00640 1 -- 172.21.15.88:0/3438180432 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0005ae0 con 0x7fe7ec004810 2024-04-24T08:26:39.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe80e800640 1 -- 172.21.15.88:0/3438180432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7ec004810 msgr2=0x7fe7ec004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe80e800640 1 --2- 172.21.15.88:0/3438180432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7ec004810 0x7fe7ec004c90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000c270 tx=0x7fe7f001cca0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe807e00640 1 -- 172.21.15.88:0/3438180432 reap_dead start 2024-04-24T08:26:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe80e800640 1 -- 172.21.15.88:0/3438180432 shutdown_connections 2024-04-24T08:26:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe80e800640 1 -- 172.21.15.88:0/3438180432 >> 172.21.15.88:0/3438180432 conn(0x7fe8080b9420 msgr2=0x7fe8080b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe80e800640 1 -- 172.21.15.88:0/3438180432 shutdown_connections 2024-04-24T08:26:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe80e800640 1 -- 172.21.15.88:0/3438180432 wait complete. 2024-04-24T08:26:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe80e800640 1 Processor -- start 2024-04-24T08:26:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.276+0000 7fe80e800640 1 -- start start 2024-04-24T08:26:39.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe80e800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7ec004810 0x7fe808072d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe80e800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe808071f40 0x7fe8080710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe80e800640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe808071630 0x7fe8081e3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe80e800640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe80809dbe0 con 0x7fe808071630 2024-04-24T08:26:39.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe80e800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe80809d3d0 con 0x7fe7ec004810 2024-04-24T08:26:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe80e800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe80809dd60 con 0x7fe808071f40 2024-04-24T08:26:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe807e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe808071630 0x7fe8081e3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe807e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe808071630 0x7fe8081e3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51056/0 (socket says 172.21.15.88:51056) 2024-04-24T08:26:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe807e00640 1 -- 172.21.15.88:0/1614776056 learned_addr learned my addr 172.21.15.88:0/1614776056 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe807400640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7ec004810 0x7fe808072d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe7fea00640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe808071f40 0x7fe8080710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe807e00640 1 -- 172.21.15.88:0/1614776056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe808071f40 msgr2=0x7fe8080710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe807e00640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe808071f40 0x7fe8080710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe807e00640 1 -- 172.21.15.88:0/1614776056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7ec004810 msgr2=0x7fe808072d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe807e00640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7ec004810 0x7fe808072d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe807e00640 1 -- 172.21.15.88:0/1614776056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe808073280 con 0x7fe808071630 2024-04-24T08:26:39.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe807400640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7ec004810 0x7fe808072d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:39.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe807e00640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe808071630 0x7fe8081e3530 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe8080703e0 tx=0x7fe800010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe7ffe00640 1 -- 172.21.15.88:0/1614776056 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80001a030 con 0x7fe808071630 2024-04-24T08:26:39.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe7ffe00640 1 -- 172.21.15.88:0/1614776056 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8000039a0 con 0x7fe808071630 2024-04-24T08:26:39.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe7ffe00640 1 -- 172.21.15.88:0/1614776056 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800003d90 con 0x7fe808071630 2024-04-24T08:26:39.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe80e800640 1 -- 172.21.15.88:0/1614776056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8080b0820 con 0x7fe808071630 2024-04-24T08:26:39.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe80e800640 1 -- 172.21.15.88:0/1614776056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8080b2390 con 0x7fe808071630 2024-04-24T08:26:39.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.280+0000 7fe80e800640 1 -- 172.21.15.88:0/1614776056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8080709e0 con 0x7fe808071630 2024-04-24T08:26:39.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.284+0000 7fe7ffe00640 1 -- 172.21.15.88:0/1614776056 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe80001d070 con 0x7fe808071630 2024-04-24T08:26:39.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.284+0000 7fe7ffe00640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe7e4068380 0x7fe7e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.284+0000 7fe7ffe00640 1 -- 172.21.15.88:0/1614776056 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7fe800087010 con 0x7fe808071630 2024-04-24T08:26:39.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.284+0000 7fe807400640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe7e4068380 0x7fe7e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.284+0000 7fe807400640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe7e4068380 0x7fe7e406a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe8081e45f0 tx=0x7fe7f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.288+0000 7fe7ffe00640 1 -- 172.21.15.88:0/1614776056 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe800024070 con 0x7fe808071630 2024-04-24T08:26:39.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.448+0000 7fe80e800640 1 -- 172.21.15.88:0/1614776056 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fe808068b20 con 0x7fe7e4068380 2024-04-24T08:26:39.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.448+0000 7fe7ffe00640 1 -- 172.21.15.88:0/1614776056 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe808068b20 con 0x7fe7e4068380 2024-04-24T08:26:39.453 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 5 to deep-scrub 2024-04-24T08:26:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.452+0000 7fe80e800640 1 -- 172.21.15.88:0/1614776056 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe7e4068380 msgr2=0x7fe7e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.452+0000 7fe80e800640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe7e4068380 0x7fe7e406a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe8081e45f0 tx=0x7fe7f8008040 comp rx=0 tx=0).stop 2024-04-24T08:26:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.452+0000 7fe80e800640 1 -- 172.21.15.88:0/1614776056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe808071630 msgr2=0x7fe8081e3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.452+0000 7fe80e800640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe808071630 0x7fe8081e3530 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe8080703e0 tx=0x7fe800010590 comp rx=0 tx=0).stop 2024-04-24T08:26:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.452+0000 7fe80e800640 1 -- 172.21.15.88:0/1614776056 shutdown_connections 2024-04-24T08:26:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.452+0000 7fe80e800640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe7e4068380 0x7fe7e406a840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.452+0000 7fe80e800640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe808071630 0x7fe8081e3530 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.452+0000 7fe80e800640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe808071f40 0x7fe8080710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.452+0000 7fe80e800640 1 --2- 172.21.15.88:0/1614776056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7ec004810 0x7fe808072d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.452+0000 7fe80e800640 1 -- 172.21.15.88:0/1614776056 >> 172.21.15.88:0/1614776056 conn(0x7fe8080b9420 msgr2=0x7fe8080af370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:39.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.452+0000 7fe80e800640 1 -- 172.21.15.88:0/1614776056 shutdown_connections 2024-04-24T08:26:39.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.452+0000 7fe80e800640 1 -- 172.21.15.88:0/1614776056 wait complete. 2024-04-24T08:26:39.473 INFO:tasks.ceph:Scrubbing osd.6 2024-04-24T08:26:39.474 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-24T08:26:39.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.608+0000 7fc4f4600640 1 Processor -- start 2024-04-24T08:26:39.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.608+0000 7fc4f4600640 1 -- start start 2024-04-24T08:26:39.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.608+0000 7fc4f4600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc4ec06d5b0 0x7fc4ec14a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.608+0000 7fc4f4600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4ec14a860 0x7fc4ec14ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.608+0000 7fc4f4600640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4ec0b26e0 con 0x7fc4ec06e670 2024-04-24T08:26:39.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.608+0000 7fc4f4600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc4ec14b1b0 con 0x7fc4ec14a860 2024-04-24T08:26:39.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.608+0000 7fc4f4600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc4ec06ea50 con 0x7fc4ec06d5b0 2024-04-24T08:26:39.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4f1c00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc4ec06e670 0x7fc4ec0b5170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33442/0 (socket says 172.21.15.88:33442) 2024-04-24T08:26:39.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4f1c00640 1 -- 172.21.15.88:0/1306187661 learned_addr learned my addr 172.21.15.88:0/1306187661 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:39.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4f2600640 1 --2- 172.21.15.88:0/1306187661 >> v2:172.21.15.88:3300/0 conn(0x7fc4ec14a860 0x7fc4ec14ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4f1200640 1 --2- 172.21.15.88:0/1306187661 >> v2:172.21.15.142:3300/0 conn(0x7fc4ec06d5b0 0x7fc4ec14a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4ebe00640 1 -- 172.21.15.88:0/1306187661 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1407506547 0 0) 0x7fc4ec0b26e0 con 0x7fc4ec06e670 2024-04-24T08:26:39.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4ebe00640 1 -- 172.21.15.88:0/1306187661 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4d4003530 con 0x7fc4ec06e670 2024-04-24T08:26:39.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4f2600640 1 -- 172.21.15.88:0/1306187661 >> v2:172.21.15.142:3300/0 conn(0x7fc4ec06d5b0 msgr2=0x7fc4ec14a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:39.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4f2600640 1 --2- 172.21.15.88:0/1306187661 >> v2:172.21.15.142:3300/0 conn(0x7fc4ec06d5b0 0x7fc4ec14a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4f2600640 1 -- 172.21.15.88:0/1306187661 >> v1:172.21.15.88:6789/0 conn(0x7fc4ec06e670 legacy=0x7fc4ec0b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4f2600640 1 -- 172.21.15.88:0/1306187661 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ec06dc10 con 0x7fc4ec14a860 2024-04-24T08:26:39.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4f2600640 1 --2- 172.21.15.88:0/1306187661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec14a860 0x7fc4ec14ac70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0b6e80 tx=0x7fc4e401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61dd0a3c665b7f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4ebe00640 1 -- 172.21.15.88:0/1306187661 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e40a66e0 con 0x7fc4ec14a860 2024-04-24T08:26:39.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4ebe00640 1 -- 172.21.15.88:0/1306187661 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e40a6880 con 0x7fc4ec14a860 2024-04-24T08:26:39.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.612+0000 7fc4ebe00640 1 -- 172.21.15.88:0/1306187661 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e40a6c50 con 0x7fc4ec14a860 2024-04-24T08:26:39.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 -- 172.21.15.88:0/1306187661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec14a860 msgr2=0x7fc4ec14ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 --2- 172.21.15.88:0/1306187661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec14a860 0x7fc4ec14ac70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0b6e80 tx=0x7fc4e401c810 comp rx=0 tx=0).stop 2024-04-24T08:26:39.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 -- 172.21.15.88:0/1306187661 shutdown_connections 2024-04-24T08:26:39.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 --2- 172.21.15.88:0/1306187661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec14a860 0x7fc4ec14ac70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 --2- 172.21.15.88:0/1306187661 >> v2:172.21.15.142:3300/0 conn(0x7fc4ec06d5b0 0x7fc4ec14a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 -- 172.21.15.88:0/1306187661 >> 172.21.15.88:0/1306187661 conn(0x7fc4ec0bb4d0 msgr2=0x7fc4ec0bb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:39.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 -- 172.21.15.88:0/1306187661 shutdown_connections 2024-04-24T08:26:39.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 -- 172.21.15.88:0/1306187661 wait complete. 2024-04-24T08:26:39.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 Processor -- start 2024-04-24T08:26:39.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 -- start start 2024-04-24T08:26:39.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4ec06d5b0 0x7fc4ec142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec06e670 0x7fc4ec1e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4ec14a860 0x7fc4ec13f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec06d380 con 0x7fc4ec06e670 2024-04-24T08:26:39.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec06d200 con 0x7fc4ec06d5b0 2024-04-24T08:26:39.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f4600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ec155170 con 0x7fc4ec14a860 2024-04-24T08:26:39.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f1200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec06e670 0x7fc4ec1e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f1200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec06e670 0x7fc4ec1e3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51072/0 (socket says 172.21.15.88:51072) 2024-04-24T08:26:39.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f1200640 1 -- 172.21.15.88:0/2513126826 learned_addr learned my addr 172.21.15.88:0/2513126826 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:39.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f1c00640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4ec06d5b0 0x7fc4ec142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f2600640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4ec14a860 0x7fc4ec13f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f1200640 1 -- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4ec14a860 msgr2=0x7fc4ec13f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f1200640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4ec14a860 0x7fc4ec13f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f1200640 1 -- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4ec06d5b0 msgr2=0x7fc4ec142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f1200640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4ec06d5b0 0x7fc4ec142a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f1200640 1 -- 172.21.15.88:0/2513126826 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ec0adc50 con 0x7fc4ec06e670 2024-04-24T08:26:39.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f2600640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4ec14a860 0x7fc4ec13f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:39.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f1c00640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4ec06d5b0 0x7fc4ec142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:39.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.616+0000 7fc4f1200640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec06e670 0x7fc4ec1e3aa0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800e960 tx=0x7fc4d800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4e9600640 1 -- 172.21.15.88:0/2513126826 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8017070 con 0x7fc4ec06e670 2024-04-24T08:26:39.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4e9600640 1 -- 172.21.15.88:0/2513126826 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d800ca00 con 0x7fc4ec06e670 2024-04-24T08:26:39.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4e9600640 1 -- 172.21.15.88:0/2513126826 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800cdb0 con 0x7fc4ec06e670 2024-04-24T08:26:39.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4f4600640 1 -- 172.21.15.88:0/2513126826 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ec147c00 con 0x7fc4ec06e670 2024-04-24T08:26:39.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4f4600640 1 -- 172.21.15.88:0/2513126826 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ec148be0 con 0x7fc4ec06e670 2024-04-24T08:26:39.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4f4600640 1 -- 172.21.15.88:0/2513126826 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4ec1499c0 con 0x7fc4ec06e670 2024-04-24T08:26:39.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4e9600640 1 -- 172.21.15.88:0/2513126826 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4d801a070 con 0x7fc4ec06e670 2024-04-24T08:26:39.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4e9600640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc4cc0683b0 0x7fc4cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4e9600640 1 -- 172.21.15.88:0/2513126826 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7fc4d80866b0 con 0x7fc4ec06e670 2024-04-24T08:26:39.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4f1c00640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc4cc0683b0 0x7fc4cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4e9600640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] conn(0x7fc4cc06e270 0x7fc4cc070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4e9600640 1 -- 172.21.15.88:0/2513126826 --> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4d800be50 con 0x7fc4cc06e270 2024-04-24T08:26:39.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4e9600640 1 -- 172.21.15.88:0/2513126826 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc4d808d050 con 0x7fc4ec06e670 2024-04-24T08:26:39.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4f2600640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] conn(0x7fc4cc06e270 0x7fc4cc070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.620+0000 7fc4f1c00640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc4cc0683b0 0x7fc4cc06a870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0005890 tx=0x7fc4e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.624+0000 7fc4f2600640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] conn(0x7fc4cc06e270 0x7fc4cc070690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.624+0000 7fc4e9600640 1 -- 172.21.15.88:0/2513126826 <== osd.6 v2:172.21.15.142:6802/3754014946 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4d800be50 con 0x7fc4cc06e270 2024-04-24T08:26:39.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4f4600640 1 -- 172.21.15.88:0/2513126826 --> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc4ec068ca0 con 0x7fc4cc06e270 2024-04-24T08:26:39.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4e9600640 1 -- 172.21.15.88:0/2513126826 <== osd.6 v2:172.21.15.142:6802/3754014946 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc4ec068ca0 con 0x7fc4cc06e270 2024-04-24T08:26:39.641 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:26:39.641 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T08:26:39.641 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:26:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4f4600640 1 -- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] conn(0x7fc4cc06e270 msgr2=0x7fc4cc070690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4f4600640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.142:6802/3754014946,v1:172.21.15.142:6804/3754014946] conn(0x7fc4cc06e270 0x7fc4cc070690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4f4600640 1 -- 172.21.15.88:0/2513126826 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc4cc0683b0 msgr2=0x7fc4cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4f4600640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc4cc0683b0 0x7fc4cc06a870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0005890 tx=0x7fc4e0009040 comp rx=0 tx=0).stop 2024-04-24T08:26:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4f4600640 1 -- 172.21.15.88:0/2513126826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec06e670 msgr2=0x7fc4ec1e3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4f4600640 1 --2- 172.21.15.88:0/2513126826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec06e670 0x7fc4ec1e3aa0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800e960 tx=0x7fc4d800ee20 comp rx=0 tx=0).stop 2024-04-24T08:26:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4f2600640 1 -- 172.21.15.88:0/2513126826 reap_dead start 2024-04-24T08:26:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4f4600640 1 -- 172.21.15.88:0/2513126826 shutdown_connections 2024-04-24T08:26:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4f4600640 1 -- 172.21.15.88:0/2513126826 >> 172.21.15.88:0/2513126826 conn(0x7fc4ec0bb4d0 msgr2=0x7fc4ec074a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4f4600640 1 -- 172.21.15.88:0/2513126826 shutdown_connections 2024-04-24T08:26:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.636+0000 7fc4f4600640 1 -- 172.21.15.88:0/2513126826 wait complete. 2024-04-24T08:26:39.659 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-24T08:26:39.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e9a00640 1 Processor -- start 2024-04-24T08:26:39.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e9a00640 1 -- start start 2024-04-24T08:26:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e9a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2e4073b00 0x7fc2e4071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e9a00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2e4073ee0 con 0x7fc2e40b0a20 2024-04-24T08:26:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e9a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2e4071a90 con 0x7fc2e40b6510 2024-04-24T08:26:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e9a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e4071d70 con 0x7fc2e4073b00 2024-04-24T08:26:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e2000640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc2e40b0a20 0x7fc2e4141ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33446/0 (socket says 172.21.15.88:33446) 2024-04-24T08:26:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e2000640 1 -- 172.21.15.88:0/2161756943 learned_addr learned my addr 172.21.15.88:0/2161756943 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e2a00640 1 --2- 172.21.15.88:0/2161756943 >> v2:172.21.15.142:3300/0 conn(0x7fc2e4073b00 0x7fc2e4071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e1600640 1 -- 172.21.15.88:0/2161756943 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 416532081 0 0) 0x7fc2e4073ee0 con 0x7fc2e40b0a20 2024-04-24T08:26:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e1600640 1 -- 172.21.15.88:0/2161756943 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2c8003530 con 0x7fc2e40b0a20 2024-04-24T08:26:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e1600640 1 -- 172.21.15.88:0/2161756943 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2534742958 0 0) 0x7fc2c8003530 con 0x7fc2e40b0a20 2024-04-24T08:26:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e2a00640 1 -- 172.21.15.88:0/2161756943 >> v1:172.21.15.142:6789/0 conn(0x7fc2e40b6510 legacy=0x7fc2e41525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e2a00640 1 -- 172.21.15.88:0/2161756943 >> v1:172.21.15.88:6789/0 conn(0x7fc2e40b0a20 legacy=0x7fc2e4141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.792+0000 7fc2e2a00640 1 -- 172.21.15.88:0/2161756943 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e4072050 con 0x7fc2e4073b00 2024-04-24T08:26:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.796+0000 7fc2e2a00640 1 --2- 172.21.15.88:0/2161756943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e4073b00 0x7fc2e4071490 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009d90 tx=0x7fc2d401c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c604dd28ba9702d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.796+0000 7fc2e1600640 1 -- 172.21.15.88:0/2161756943 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40b2070 con 0x7fc2e4073b00 2024-04-24T08:26:39.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.796+0000 7fc2e1600640 1 -- 172.21.15.88:0/2161756943 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d40a5580 con 0x7fc2e4073b00 2024-04-24T08:26:39.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.796+0000 7fc2e1600640 1 -- 172.21.15.88:0/2161756943 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0001680 con 0x7fc2e4073b00 2024-04-24T08:26:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.796+0000 7fc2e9a00640 1 -- 172.21.15.88:0/2161756943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e4073b00 msgr2=0x7fc2e4071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.796+0000 7fc2e9a00640 1 --2- 172.21.15.88:0/2161756943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e4073b00 0x7fc2e4071490 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009d90 tx=0x7fc2d401c7a0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.796+0000 7fc2e9a00640 1 -- 172.21.15.88:0/2161756943 shutdown_connections 2024-04-24T08:26:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.796+0000 7fc2e9a00640 1 --2- 172.21.15.88:0/2161756943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e4073b00 0x7fc2e4071490 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.796+0000 7fc2e9a00640 1 -- 172.21.15.88:0/2161756943 >> 172.21.15.88:0/2161756943 conn(0x7fc2e40ba4c0 msgr2=0x7fc2e40ba8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.796+0000 7fc2e9a00640 1 -- 172.21.15.88:0/2161756943 shutdown_connections 2024-04-24T08:26:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.796+0000 7fc2e9a00640 1 -- 172.21.15.88:0/2161756943 wait complete. 2024-04-24T08:26:39.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e9a00640 1 Processor -- start 2024-04-24T08:26:39.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e9a00640 1 -- start start 2024-04-24T08:26:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e9a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e4073b00 0x7fc2e4131b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e9a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e40b0a20 0x7fc2e41e3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e9a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e40b6510 0x7fc2e4145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e9a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e4156690 con 0x7fc2e40b0a20 2024-04-24T08:26:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e9a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e4156510 con 0x7fc2e40b6510 2024-04-24T08:26:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e9a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e4156810 con 0x7fc2e4073b00 2024-04-24T08:26:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e2000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e40b0a20 0x7fc2e41e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e2000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e40b0a20 0x7fc2e41e3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51076/0 (socket says 172.21.15.88:51076) 2024-04-24T08:26:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e2000640 1 -- 172.21.15.88:0/1957762993 learned_addr learned my addr 172.21.15.88:0/1957762993 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e2a00640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e4073b00 0x7fc2e4131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e3400640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e40b6510 0x7fc2e4145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e2000640 1 -- 172.21.15.88:0/1957762993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e4073b00 msgr2=0x7fc2e4131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e2000640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e4073b00 0x7fc2e4131b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e2000640 1 -- 172.21.15.88:0/1957762993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e40b6510 msgr2=0x7fc2e4145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e2000640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e40b6510 0x7fc2e4145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e2000640 1 -- 172.21.15.88:0/1957762993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e4146e80 con 0x7fc2e40b0a20 2024-04-24T08:26:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e3400640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e40b6510 0x7fc2e4145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e2000640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e40b0a20 0x7fc2e41e3890 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000c700 tx=0x7fc2d000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2daa00640 1 -- 172.21.15.88:0/1957762993 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0017070 con 0x7fc2e40b0a20 2024-04-24T08:26:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2daa00640 1 -- 172.21.15.88:0/1957762993 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d0005ae0 con 0x7fc2e40b0a20 2024-04-24T08:26:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e9a00640 1 -- 172.21.15.88:0/1957762993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e4132510 con 0x7fc2e40b0a20 2024-04-24T08:26:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2daa00640 1 -- 172.21.15.88:0/1957762993 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0007070 con 0x7fc2e40b0a20 2024-04-24T08:26:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e9a00640 1 -- 172.21.15.88:0/1957762993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e40b1d50 con 0x7fc2e40b0a20 2024-04-24T08:26:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.800+0000 7fc2e9a00640 1 -- 172.21.15.88:0/1957762993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e4068b20 con 0x7fc2e40b0a20 2024-04-24T08:26:39.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.804+0000 7fc2daa00640 1 -- 172.21.15.88:0/1957762993 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc2d001a070 con 0x7fc2e40b0a20 2024-04-24T08:26:39.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.804+0000 7fc2daa00640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc2c4068380 0x7fc2c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:39.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.804+0000 7fc2daa00640 1 -- 172.21.15.88:0/1957762993 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7fc2d0085b00 con 0x7fc2e40b0a20 2024-04-24T08:26:39.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.804+0000 7fc2e2a00640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc2c4068380 0x7fc2c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:39.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.804+0000 7fc2e2a00640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc2c4068380 0x7fc2c406a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40af000 tx=0x7fc2d40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:39.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.808+0000 7fc2daa00640 1 -- 172.21.15.88:0/1957762993 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc2d0055d60 con 0x7fc2e40b0a20 2024-04-24T08:26:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.960+0000 7fc2e9a00640 1 -- 172.21.15.88:0/1957762993 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fc2e40b9450 con 0x7fc2c4068380 2024-04-24T08:26:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2daa00640 1 -- 172.21.15.88:0/1957762993 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc2e40b9450 con 0x7fc2c4068380 2024-04-24T08:26:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 6 to deep-scrub 2024-04-24T08:26:39.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2e9a00640 1 -- 172.21.15.88:0/1957762993 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc2c4068380 msgr2=0x7fc2c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2e9a00640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc2c4068380 0x7fc2c406a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40af000 tx=0x7fc2d40a7070 comp rx=0 tx=0).stop 2024-04-24T08:26:39.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2e9a00640 1 -- 172.21.15.88:0/1957762993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e40b0a20 msgr2=0x7fc2e41e3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:39.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2e9a00640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e40b0a20 0x7fc2e41e3890 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000c700 tx=0x7fc2d000cbc0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2e9a00640 1 -- 172.21.15.88:0/1957762993 shutdown_connections 2024-04-24T08:26:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2e9a00640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fc2c4068380 0x7fc2c406a840 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2e9a00640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e40b6510 0x7fc2e4145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2e9a00640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e40b0a20 0x7fc2e41e3890 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2e9a00640 1 --2- 172.21.15.88:0/1957762993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e4073b00 0x7fc2e4131b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2e9a00640 1 -- 172.21.15.88:0/1957762993 >> 172.21.15.88:0/1957762993 conn(0x7fc2e40ba4c0 msgr2=0x7fc2e4140d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2e9a00640 1 -- 172.21.15.88:0/1957762993 shutdown_connections 2024-04-24T08:26:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:39.964+0000 7fc2e9a00640 1 -- 172.21.15.88:0/1957762993 wait complete. 2024-04-24T08:26:39.986 INFO:tasks.ceph:Scrubbing osd.7 2024-04-24T08:26:39.987 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-24T08:26:40.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.124+0000 7fe26c000640 1 Processor -- start 2024-04-24T08:26:40.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.124+0000 7fe26c000640 1 -- start start 2024-04-24T08:26:40.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe26c000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b9d90 0x7fe26406d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe26c000640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe2640b3e20 0x7fe26406d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe26c000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe26406dc90 0x7fe2641451d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe26c000640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fe2640ba170 con 0x7fe2640b3e20 2024-04-24T08:26:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe26c000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe26409cca0 con 0x7fe26406dc90 2024-04-24T08:26:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe26c000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe264149930 con 0x7fe2640b9d90 2024-04-24T08:26:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe268c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe2640b3e20 0x7fe26406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe268c00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe2640b3e20 0x7fe26406d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51092/0 (socket says 172.21.15.88:51092) 2024-04-24T08:26:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe268c00640 1 -- 172.21.15.88:0/196570248 learned_addr learned my addr 172.21.15.88:0/196570248 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe269600640 1 --2- 172.21.15.88:0/196570248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b9d90 0x7fe26406d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe26a000640 1 --2- 172.21.15.88:0/196570248 >> v2:172.21.15.142:3300/0 conn(0x7fe26406dc90 0x7fe2641451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe268c00640 1 -- 172.21.15.88:0/196570248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b9d90 msgr2=0x7fe26406d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe268c00640 1 --2- 172.21.15.88:0/196570248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b9d90 0x7fe26406d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe268c00640 1 -- 172.21.15.88:0/196570248 >> v2:172.21.15.142:3300/0 conn(0x7fe26406dc90 msgr2=0x7fe2641451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe268c00640 1 --2- 172.21.15.88:0/196570248 >> v2:172.21.15.142:3300/0 conn(0x7fe26406dc90 0x7fe2641451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.128+0000 7fe268c00640 1 -- 172.21.15.88:0/196570248 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe264149c10 con 0x7fe2640b3e20 2024-04-24T08:26:40.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe268c00640 1 --2- 172.21.15.88:0/196570248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2640b3e20 0x7fe26406d750 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe2640b3ae0 tx=0x7fe25001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed86505163f0b1d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:40.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe263e00640 1 -- 172.21.15.88:0/196570248 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2500b0070 con 0x7fe2640b3e20 2024-04-24T08:26:40.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe263e00640 1 -- 172.21.15.88:0/196570248 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2500ab600 con 0x7fe2640b3e20 2024-04-24T08:26:40.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe263e00640 1 -- 172.21.15.88:0/196570248 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2500ab9d0 con 0x7fe2640b3e20 2024-04-24T08:26:40.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 -- 172.21.15.88:0/196570248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2640b3e20 msgr2=0x7fe26406d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 --2- 172.21.15.88:0/196570248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2640b3e20 0x7fe26406d750 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe2640b3ae0 tx=0x7fe25001c470 comp rx=0 tx=0).stop 2024-04-24T08:26:40.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 -- 172.21.15.88:0/196570248 shutdown_connections 2024-04-24T08:26:40.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 --2- 172.21.15.88:0/196570248 >> v2:172.21.15.142:3300/0 conn(0x7fe26406dc90 0x7fe2641451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 --2- 172.21.15.88:0/196570248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2640b3e20 0x7fe26406d750 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 --2- 172.21.15.88:0/196570248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b9d90 0x7fe26406d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 -- 172.21.15.88:0/196570248 >> 172.21.15.88:0/196570248 conn(0x7fe26406c0d0 msgr2=0x7fe2640b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:40.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 -- 172.21.15.88:0/196570248 shutdown_connections 2024-04-24T08:26:40.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 -- 172.21.15.88:0/196570248 wait complete. 2024-04-24T08:26:40.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 Processor -- start 2024-04-24T08:26:40.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 -- start start 2024-04-24T08:26:40.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe26406dc90 0x7fe264148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b3e20 0x7fe2640719c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2640b9d90 0x7fe264071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe264146130 con 0x7fe2640b9d90 2024-04-24T08:26:40.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe26406e0a0 con 0x7fe26406dc90 2024-04-24T08:26:40.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26c000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe2641462b0 con 0x7fe2640b3e20 2024-04-24T08:26:40.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26a000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2640b9d90 0x7fe264071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26a000640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2640b9d90 0x7fe264071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51106/0 (socket says 172.21.15.88:51106) 2024-04-24T08:26:40.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe26a000640 1 -- 172.21.15.88:0/125436449 learned_addr learned my addr 172.21.15.88:0/125436449 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:40.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe269600640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe26406dc90 0x7fe264148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.132+0000 7fe268c00640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b3e20 0x7fe2640719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe26a000640 1 -- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b3e20 msgr2=0x7fe2640719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe26a000640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b3e20 0x7fe2640719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe26a000640 1 -- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe26406dc90 msgr2=0x7fe264148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe26a000640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe26406dc90 0x7fe264148110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe26a000640 1 -- 172.21.15.88:0/125436449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe264070e90 con 0x7fe2640b9d90 2024-04-24T08:26:40.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe269600640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe26406dc90 0x7fe264148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:40.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe268c00640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b3e20 0x7fe2640719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:40.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe26a000640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2640b9d90 0x7fe264071f00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00d830 tx=0x7fe25c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:40.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe261600640 1 -- 172.21.15.88:0/125436449 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c018020 con 0x7fe2640b9d90 2024-04-24T08:26:40.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe261600640 1 -- 172.21.15.88:0/125436449 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25c0096c0 con 0x7fe2640b9d90 2024-04-24T08:26:40.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe26c000640 1 -- 172.21.15.88:0/125436449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe264071150 con 0x7fe2640b9d90 2024-04-24T08:26:40.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe261600640 1 -- 172.21.15.88:0/125436449 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c009ab0 con 0x7fe2640b9d90 2024-04-24T08:26:40.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe26c000640 1 -- 172.21.15.88:0/125436449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe264073350 con 0x7fe2640b9d90 2024-04-24T08:26:40.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe26c000640 1 -- 172.21.15.88:0/125436449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe264068ca0 con 0x7fe2640b9d90 2024-04-24T08:26:40.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe261600640 1 -- 172.21.15.88:0/125436449 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe25c01b020 con 0x7fe2640b9d90 2024-04-24T08:26:40.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe261600640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe244068380 0x7fe24406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe261600640 1 -- 172.21.15.88:0/125436449 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7fe25c087450 con 0x7fe2640b9d90 2024-04-24T08:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe269600640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe244068380 0x7fe24406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe261600640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] conn(0x7fe24406e240 0x7fe244070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe261600640 1 -- 172.21.15.88:0/125436449 --> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe25c00cfb0 con 0x7fe24406e240 2024-04-24T08:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.136+0000 7fe261600640 1 -- 172.21.15.88:0/125436449 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe25c087800 con 0x7fe2640b9d90 2024-04-24T08:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.140+0000 7fe269600640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe244068380 0x7fe24406a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe258003fd0 tx=0x7fe2580039e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.140+0000 7fe268c00640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] conn(0x7fe24406e240 0x7fe244070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.140+0000 7fe268c00640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] conn(0x7fe24406e240 0x7fe244070660 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:40.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.140+0000 7fe261600640 1 -- 172.21.15.88:0/125436449 <== osd.7 v2:172.21.15.142:6816/1975061608 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe25c00cfb0 con 0x7fe24406e240 2024-04-24T08:26:40.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.152+0000 7fe26c000640 1 -- 172.21.15.88:0/125436449 --> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe2640afaa0 con 0x7fe24406e240 2024-04-24T08:26:40.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.152+0000 7fe261600640 1 -- 172.21.15.88:0/125436449 <== osd.7 v2:172.21.15.142:6816/1975061608 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe2640afaa0 con 0x7fe24406e240 2024-04-24T08:26:40.158 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-24T08:26:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T08:26:40.158 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-24T08:26:40.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.156+0000 7fe26c000640 1 -- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] conn(0x7fe24406e240 msgr2=0x7fe244070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.156+0000 7fe26c000640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.142:6816/1975061608,v1:172.21.15.142:6817/1975061608] conn(0x7fe24406e240 0x7fe244070660 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.156+0000 7fe26c000640 1 -- 172.21.15.88:0/125436449 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe244068380 msgr2=0x7fe24406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.156+0000 7fe26c000640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fe244068380 0x7fe24406a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe258003fd0 tx=0x7fe2580039e0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.156+0000 7fe26c000640 1 -- 172.21.15.88:0/125436449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2640b9d90 msgr2=0x7fe264071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.156+0000 7fe26c000640 1 --2- 172.21.15.88:0/125436449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2640b9d90 0x7fe264071f00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00d830 tx=0x7fe25c00dcf0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.156+0000 7fe26a000640 1 -- 172.21.15.88:0/125436449 reap_dead start 2024-04-24T08:26:40.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.156+0000 7fe26c000640 1 -- 172.21.15.88:0/125436449 shutdown_connections 2024-04-24T08:26:40.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.156+0000 7fe26c000640 1 -- 172.21.15.88:0/125436449 >> 172.21.15.88:0/125436449 conn(0x7fe26406c0d0 msgr2=0x7fe2640b6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:40.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.156+0000 7fe26c000640 1 -- 172.21.15.88:0/125436449 shutdown_connections 2024-04-24T08:26:40.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.156+0000 7fe26c000640 1 -- 172.21.15.88:0/125436449 wait complete. 2024-04-24T08:26:40.175 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-24T08:26:40.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d28600640 1 Processor -- start 2024-04-24T08:26:40.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d28600640 1 -- start start 2024-04-24T08:26:40.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d28600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d200b5760 0x7f6d20143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d28600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d201440f0 0x7f6d20144540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d28600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d200b4fd0 con 0x7f6d2009c730 2024-04-24T08:26:40.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d28600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6d200b52d0 con 0x7f6d201440f0 2024-04-24T08:26:40.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d28600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6d20144a80 con 0x7f6d200b5760 2024-04-24T08:26:40.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d26600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d201440f0 0x7f6d20144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d26600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d201440f0 0x7f6d20144540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51108/0 (socket says 172.21.15.88:51108) 2024-04-24T08:26:40.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d26600640 1 -- 172.21.15.88:0/369481961 learned_addr learned my addr 172.21.15.88:0/369481961 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:40.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d25200640 1 --2- 172.21.15.88:0/369481961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d200b5760 0x7f6d20143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d26600640 1 -- 172.21.15.88:0/369481961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d200b5760 msgr2=0x7f6d20143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:40.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d26600640 1 --2- 172.21.15.88:0/369481961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d200b5760 0x7f6d20143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d26600640 1 -- 172.21.15.88:0/369481961 >> v1:172.21.15.142:6789/0 conn(0x7f6d2009c730 legacy=0x7f6d20148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.308+0000 7f6d26600640 1 -- 172.21.15.88:0/369481961 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2009cb10 con 0x7f6d201440f0 2024-04-24T08:26:40.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.312+0000 7f6d26600640 1 --2- 172.21.15.88:0/369481961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d201440f0 0x7f6d20144540 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009870 tx=0x7f6d1801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861a4779362de913 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:40.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.312+0000 7f6d1fe00640 1 -- 172.21.15.88:0/369481961 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d180b1070 con 0x7f6d201440f0 2024-04-24T08:26:40.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.312+0000 7f6d1fe00640 1 -- 172.21.15.88:0/369481961 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d180ac620 con 0x7f6d201440f0 2024-04-24T08:26:40.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.312+0000 7f6d1fe00640 1 -- 172.21.15.88:0/369481961 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d180ac9f0 con 0x7f6d201440f0 2024-04-24T08:26:40.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.312+0000 7f6d28600640 1 -- 172.21.15.88:0/369481961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d201440f0 msgr2=0x7f6d20144540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.312+0000 7f6d28600640 1 --2- 172.21.15.88:0/369481961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d201440f0 0x7f6d20144540 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009870 tx=0x7f6d1801c4d0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.312+0000 7f6d28600640 1 -- 172.21.15.88:0/369481961 shutdown_connections 2024-04-24T08:26:40.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.312+0000 7f6d28600640 1 --2- 172.21.15.88:0/369481961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d201440f0 0x7f6d20144540 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.312+0000 7f6d28600640 1 --2- 172.21.15.88:0/369481961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d200b5760 0x7f6d20143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.312+0000 7f6d28600640 1 -- 172.21.15.88:0/369481961 >> 172.21.15.88:0/369481961 conn(0x7f6d200b9420 msgr2=0x7f6d200b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:40.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.312+0000 7f6d28600640 1 -- 172.21.15.88:0/369481961 shutdown_connections 2024-04-24T08:26:40.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.312+0000 7f6d28600640 1 -- 172.21.15.88:0/369481961 wait complete. 2024-04-24T08:26:40.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d28600640 1 Processor -- start 2024-04-24T08:26:40.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d28600640 1 -- start start 2024-04-24T08:26:40.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d28600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2009c730 0x7f6d200b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d28600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d200b5760 0x7f6d20145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d28600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d201440f0 0x7f6d20147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d28600640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2009dd60 con 0x7f6d200b5760 2024-04-24T08:26:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d28600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2009dbe0 con 0x7f6d201440f0 2024-04-24T08:26:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d28600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6d20151f00 con 0x7f6d2009c730 2024-04-24T08:26:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d25200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d200b5760 0x7f6d20145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d25200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d200b5760 0x7f6d20145d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51118/0 (socket says 172.21.15.88:51118) 2024-04-24T08:26:40.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d25200640 1 -- 172.21.15.88:0/781229884 learned_addr learned my addr 172.21.15.88:0/781229884 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:40.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d25c00640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2009c730 0x7f6d200b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d26600640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d201440f0 0x7f6d20147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d25200640 1 -- 172.21.15.88:0/781229884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2009c730 msgr2=0x7f6d200b8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d25200640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2009c730 0x7f6d200b8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d25200640 1 -- 172.21.15.88:0/781229884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d201440f0 msgr2=0x7f6d20147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d25200640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d201440f0 0x7f6d20147170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d25200640 1 -- 172.21.15.88:0/781229884 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d20146480 con 0x7f6d200b5760 2024-04-24T08:26:40.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d25200640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d200b5760 0x7f6d20145d20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00d800 tx=0x7f6d0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:40.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d1d600640 1 -- 172.21.15.88:0/781229884 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c00b6c0 con 0x7f6d200b5760 2024-04-24T08:26:40.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d1d600640 1 -- 172.21.15.88:0/781229884 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0c019070 con 0x7f6d200b5760 2024-04-24T08:26:40.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d28600640 1 -- 172.21.15.88:0/781229884 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2013e320 con 0x7f6d200b5760 2024-04-24T08:26:40.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d1d600640 1 -- 172.21.15.88:0/781229884 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c00ba60 con 0x7f6d200b5760 2024-04-24T08:26:40.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.316+0000 7f6d28600640 1 -- 172.21.15.88:0/781229884 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d2014f240 con 0x7f6d200b5760 2024-04-24T08:26:40.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.320+0000 7f6d28600640 1 -- 172.21.15.88:0/781229884 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d20068b20 con 0x7f6d200b5760 2024-04-24T08:26:40.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.320+0000 7f6d1d600640 1 -- 172.21.15.88:0/781229884 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6d0c00bc00 con 0x7f6d200b5760 2024-04-24T08:26:40.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.320+0000 7f6d1d600640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6d00068380 0x7f6d0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.320+0000 7f6d1d600640 1 -- 172.21.15.88:0/781229884 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f6d0c086a00 con 0x7f6d200b5760 2024-04-24T08:26:40.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.320+0000 7f6d25c00640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6d00068380 0x7f6d0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.320+0000 7f6d25c00640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6d00068380 0x7f6d0006a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d14001ea0 tx=0x7f6d14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:40.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.324+0000 7f6d1d600640 1 -- 172.21.15.88:0/781229884 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6d0c056c60 con 0x7f6d200b5760 2024-04-24T08:26:40.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.480+0000 7f6d28600640 1 -- 172.21.15.88:0/781229884 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f6d200af7b0 con 0x7f6d00068380 2024-04-24T08:26:40.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.480+0000 7f6d1d600640 1 -- 172.21.15.88:0/781229884 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6d200af7b0 con 0x7f6d00068380 2024-04-24T08:26:40.485 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 7 to deep-scrub 2024-04-24T08:26:40.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.484+0000 7f6d28600640 1 -- 172.21.15.88:0/781229884 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6d00068380 msgr2=0x7f6d0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.484+0000 7f6d28600640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6d00068380 0x7f6d0006a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d14001ea0 tx=0x7f6d14009040 comp rx=0 tx=0).stop 2024-04-24T08:26:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.484+0000 7f6d28600640 1 -- 172.21.15.88:0/781229884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d200b5760 msgr2=0x7f6d20145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.484+0000 7f6d28600640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d200b5760 0x7f6d20145d20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00d800 tx=0x7f6d0c00dcc0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.484+0000 7f6d28600640 1 -- 172.21.15.88:0/781229884 shutdown_connections 2024-04-24T08:26:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.484+0000 7f6d28600640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f6d00068380 0x7f6d0006a840 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.484+0000 7f6d28600640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d201440f0 0x7f6d20147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.484+0000 7f6d28600640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d200b5760 0x7f6d20145d20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.484+0000 7f6d28600640 1 --2- 172.21.15.88:0/781229884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2009c730 0x7f6d200b8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.484+0000 7f6d28600640 1 -- 172.21.15.88:0/781229884 >> 172.21.15.88:0/781229884 conn(0x7f6d200b9420 msgr2=0x7f6d20148140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.484+0000 7f6d28600640 1 -- 172.21.15.88:0/781229884 shutdown_connections 2024-04-24T08:26:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.484+0000 7f6d28600640 1 -- 172.21.15.88:0/781229884 wait complete. 2024-04-24T08:26:40.505 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:26:40.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.636+0000 7fa7ef200640 1 Processor -- start 2024-04-24T08:26:40.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.636+0000 7fa7ef200640 1 -- start start 2024-04-24T08:26:40.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.636+0000 7fa7ef200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b44e0 0x7fa7e80b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.636+0000 7fa7ef200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7e8143bb0 0x7fa7e8144040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.636+0000 7fa7ef200640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7e80ba170 con 0x7fa7e80b9d90 2024-04-24T08:26:40.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.636+0000 7fa7ef200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa7e8145b80 con 0x7fa7e8143bb0 2024-04-24T08:26:40.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.636+0000 7fa7ef200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa7e81458a0 con 0x7fa7e80b44e0 2024-04-24T08:26:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.636+0000 7fa7e7e00640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa7e80b9d90 0x7fa7e81450e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33456/0 (socket says 172.21.15.88:33456) 2024-04-24T08:26:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.636+0000 7fa7e7e00640 1 -- 172.21.15.88:0/1095982365 learned_addr learned my addr 172.21.15.88:0/1095982365 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:26:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.636+0000 7fa7ed200640 1 --2- 172.21.15.88:0/1095982365 >> v2:172.21.15.88:3300/0 conn(0x7fa7e8143bb0 0x7fa7e8144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.636+0000 7fa7e7400640 1 --2- 172.21.15.88:0/1095982365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b44e0 0x7fa7e80b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7e6a00640 1 -- 172.21.15.88:0/1095982365 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 497206811 0 0) 0x7fa7e80ba170 con 0x7fa7e80b9d90 2024-04-24T08:26:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7e6a00640 1 -- 172.21.15.88:0/1095982365 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7cc005740 con 0x7fa7e80b9d90 2024-04-24T08:26:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7ed200640 1 -- 172.21.15.88:0/1095982365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b44e0 msgr2=0x7fa7e80b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:26:40.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7ed200640 1 --2- 172.21.15.88:0/1095982365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b44e0 0x7fa7e80b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7ed200640 1 -- 172.21.15.88:0/1095982365 >> v1:172.21.15.88:6789/0 conn(0x7fa7e80b9d90 legacy=0x7fa7e81450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7ed200640 1 -- 172.21.15.88:0/1095982365 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e80b3fc0 con 0x7fa7e8143bb0 2024-04-24T08:26:40.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7ed200640 1 --2- 172.21.15.88:0/1095982365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e8143bb0 0x7fa7e8144040 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00097c0 tx=0x7fa7e001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b56bdc10a30b27 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:40.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7e6a00640 1 -- 172.21.15.88:0/1095982365 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00b0070 con 0x7fa7e8143bb0 2024-04-24T08:26:40.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7e6a00640 1 -- 172.21.15.88:0/1095982365 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e00ab600 con 0x7fa7e8143bb0 2024-04-24T08:26:40.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7e6a00640 1 -- 172.21.15.88:0/1095982365 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00ab9d0 con 0x7fa7e8143bb0 2024-04-24T08:26:40.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7ef200640 1 -- 172.21.15.88:0/1095982365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e8143bb0 msgr2=0x7fa7e8144040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7ef200640 1 --2- 172.21.15.88:0/1095982365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e8143bb0 0x7fa7e8144040 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00097c0 tx=0x7fa7e001c410 comp rx=0 tx=0).stop 2024-04-24T08:26:40.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7ef200640 1 -- 172.21.15.88:0/1095982365 shutdown_connections 2024-04-24T08:26:40.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7ef200640 1 --2- 172.21.15.88:0/1095982365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e8143bb0 0x7fa7e8144040 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7ef200640 1 --2- 172.21.15.88:0/1095982365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b44e0 0x7fa7e80b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.640+0000 7fa7ef200640 1 -- 172.21.15.88:0/1095982365 >> 172.21.15.88:0/1095982365 conn(0x7fa7e806c0d0 msgr2=0x7fa7e80b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:40.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ef200640 1 -- 172.21.15.88:0/1095982365 shutdown_connections 2024-04-24T08:26:40.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ef200640 1 -- 172.21.15.88:0/1095982365 wait complete. 2024-04-24T08:26:40.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ef200640 1 Processor -- start 2024-04-24T08:26:40.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ef200640 1 -- start start 2024-04-24T08:26:40.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ef200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b44e0 0x7fa7e81404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ef200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b9d90 0x7fa7e80713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ef200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e8143bb0 0x7fa7e809b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ef200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e806dba0 con 0x7fa7e80b9d90 2024-04-24T08:26:40.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ef200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e806da20 con 0x7fa7e8143bb0 2024-04-24T08:26:40.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ef200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa7e806dd20 con 0x7fa7e80b44e0 2024-04-24T08:26:40.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7e7400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b9d90 0x7fa7e80713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7e7400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b9d90 0x7fa7e80713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51146/0 (socket says 172.21.15.88:51146) 2024-04-24T08:26:40.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7e7400640 1 -- 172.21.15.88:0/3681304443 learned_addr learned my addr 172.21.15.88:0/3681304443 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:26:40.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ed200640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e8143bb0 0x7fa7e809b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7e7e00640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b44e0 0x7fa7e81404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7e7400640 1 -- 172.21.15.88:0/3681304443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b44e0 msgr2=0x7fa7e81404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7e7400640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b44e0 0x7fa7e81404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7e7400640 1 -- 172.21.15.88:0/3681304443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e8143bb0 msgr2=0x7fa7e809b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7e7400640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e8143bb0 0x7fa7e809b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7e7400640 1 -- 172.21.15.88:0/3681304443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e813f510 con 0x7fa7e80b9d90 2024-04-24T08:26:40.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ed200640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e8143bb0 0x7fa7e809b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:26:40.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7e7400640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b9d90 0x7fa7e80713a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400e930 tx=0x7fa7d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:40.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7dfe00640 1 -- 172.21.15.88:0/3681304443 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4017070 con 0x7fa7e80b9d90 2024-04-24T08:26:40.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7dfe00640 1 -- 172.21.15.88:0/3681304443 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d400c9a0 con 0x7fa7e80b9d90 2024-04-24T08:26:40.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7dfe00640 1 -- 172.21.15.88:0/3681304443 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d400cd50 con 0x7fa7e80b9d90 2024-04-24T08:26:40.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ef200640 1 -- 172.21.15.88:0/3681304443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e8140c20 con 0x7fa7e80b9d90 2024-04-24T08:26:40.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.644+0000 7fa7ef200640 1 -- 172.21.15.88:0/3681304443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e81dfae0 con 0x7fa7e80b9d90 2024-04-24T08:26:40.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.648+0000 7fa7ef200640 1 -- 172.21.15.88:0/3681304443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e8068b90 con 0x7fa7e80b9d90 2024-04-24T08:26:40.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.648+0000 7fa7dfe00640 1 -- 172.21.15.88:0/3681304443 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa7d401a070 con 0x7fa7e80b9d90 2024-04-24T08:26:40.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.648+0000 7fa7dfe00640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7c8068380 0x7fa7c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:26:40.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.648+0000 7fa7dfe00640 1 -- 172.21.15.88:0/3681304443 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7fa7d40866b0 con 0x7fa7e80b9d90 2024-04-24T08:26:40.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.648+0000 7fa7e7e00640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7c8068380 0x7fa7c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:26:40.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.648+0000 7fa7e7e00640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7c8068380 0x7fa7c806a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8005c10 tx=0x7fa7d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:26:40.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.652+0000 7fa7dfe00640 1 -- 172.21.15.88:0/3681304443 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa7d4057020 con 0x7fa7e80b9d90 2024-04-24T08:26:40.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.804+0000 7fa7ef200640 1 -- 172.21.15.88:0/3681304443 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7e809cfd0 con 0x7fa7c8068380 2024-04-24T08:26:40.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.804+0000 7fa7dfe00640 1 -- 172.21.15.88:0/3681304443 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13480 (secure 0 0 0) 0x7fa7e809cfd0 con 0x7fa7c8068380 2024-04-24T08:26:40.810 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:26:40.810 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:26:40.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.808+0000 7fa7ef200640 1 -- 172.21.15.88:0/3681304443 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7c8068380 msgr2=0x7fa7c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.808+0000 7fa7ef200640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7c8068380 0x7fa7c806a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8005c10 tx=0x7fa7d8009040 comp rx=0 tx=0).stop 2024-04-24T08:26:40.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.808+0000 7fa7ef200640 1 -- 172.21.15.88:0/3681304443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b9d90 msgr2=0x7fa7e80713a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:26:40.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.808+0000 7fa7ef200640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b9d90 0x7fa7e80713a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400e930 tx=0x7fa7d400edf0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.808+0000 7fa7ef200640 1 -- 172.21.15.88:0/3681304443 shutdown_connections 2024-04-24T08:26:40.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.808+0000 7fa7ef200640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7fa7c8068380 0x7fa7c806a840 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.808+0000 7fa7ef200640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e8143bb0 0x7fa7e809b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.808+0000 7fa7ef200640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7e80b9d90 0x7fa7e80713a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.808+0000 7fa7ef200640 1 --2- 172.21.15.88:0/3681304443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b44e0 0x7fa7e81404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:26:40.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.808+0000 7fa7ef200640 1 -- 172.21.15.88:0/3681304443 >> 172.21.15.88:0/3681304443 conn(0x7fa7e806c0d0 msgr2=0x7fa7e80b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:26:40.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.808+0000 7fa7ef200640 1 -- 172.21.15.88:0/3681304443 shutdown_connections 2024-04-24T08:26:40.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:26:40.808+0000 7fa7ef200640 1 -- 172.21.15.88:0/3681304443 wait complete. 2024-04-24T08:26:40.830 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-04-24T08:26:39.002098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220164,"kb_used_data":3992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754556,"statfs":{"total":773094113280,"available":772868665344,"internally_reserved":0,"allocated":4087808,"data_stored":2299695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15078,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-61,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001305"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T08:26:34.188132+0000","last_change":"2024-04-24T08:25:16.507394+0000","last_active":"2024-04-24T08:26:34.188132+0000","last_peered":"2024-04-24T08:26:34.188132+0000","last_clean":"2024-04-24T08:26:34.188132+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:26:34.188132+0000","last_undegraded":"2024-04-24T08:26:34.188132+0000","last_fullsized":"2024-04-24T08:26:34.188132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T08:25:15.202230+0000","last_clean_scrub_stamp":"2024-04-24T08:25:15.202230+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:07:01.826166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":726464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":130163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":144395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":732029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:26:40.832 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T08:25:15.202230+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=8, tm_min=25, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=8, tm_min=26, tm_sec=35, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T08:26:40.832 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T08:26:56.522 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T08:26:56.526 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T08:27:00.834 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T08:27:00.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.975+0000 7f64e5a00640 1 Processor -- start 2024-04-24T08:27:00.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.975+0000 7f64e5a00640 1 -- start start 2024-04-24T08:27:00.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.975+0000 7f64e5a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64e00b9d90 0x7f64e006d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.975+0000 7f64e5a00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64e0145f20 0x7f64e01504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.975+0000 7f64e5a00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e00ba170 con 0x7f64e009be30 2024-04-24T08:27:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.975+0000 7f64e5a00640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f64e009cd30 con 0x7f64e0145f20 2024-04-24T08:27:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.975+0000 7f64e5a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f64e014a060 con 0x7f64e00b9d90 2024-04-24T08:27:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64de000640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f64e009be30 0x7f64e006d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42370/0 (socket says 172.21.15.88:42370) 2024-04-24T08:27:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64df400640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64e0145f20 0x7f64e01504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64de000640 1 -- 172.21.15.88:0/1696157396 learned_addr learned my addr 172.21.15.88:0/1696157396 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T08:27:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64dea00640 1 --2- 172.21.15.88:0/1696157396 >> v2:172.21.15.142:3300/0 conn(0x7f64e00b9d90 0x7f64e006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64df400640 1 -- 172.21.15.88:0/1696157396 >> v2:172.21.15.142:3300/0 conn(0x7f64e00b9d90 msgr2=0x7f64e006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:27:00.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64df400640 1 --2- 172.21.15.88:0/1696157396 >> v2:172.21.15.142:3300/0 conn(0x7f64e00b9d90 0x7f64e006d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:00.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64df400640 1 -- 172.21.15.88:0/1696157396 >> v1:172.21.15.88:6789/0 conn(0x7f64e009be30 legacy=0x7f64e006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:00.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64dd600640 1 -- 172.21.15.88:0/1696157396 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 274126322 0 0) 0x7f64e00ba170 con 0x7f64e009be30 2024-04-24T08:27:00.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64df400640 1 -- 172.21.15.88:0/1696157396 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e0149860 con 0x7f64e0145f20 2024-04-24T08:27:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64df400640 1 --2- 172.21.15.88:0/1696157396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e0145f20 0x7f64e01504e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f64e006c9d0 tx=0x7f64d801c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd4bc4207d4e156 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:27:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64dd600640 1 -- 172.21.15.88:0/1696157396 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d80b2070 con 0x7f64e0145f20 2024-04-24T08:27:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64dd600640 1 -- 172.21.15.88:0/1696157396 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d80a57a0 con 0x7f64e0145f20 2024-04-24T08:27:00.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.979+0000 7f64dd600640 1 -- 172.21.15.88:0/1696157396 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d80a5b70 con 0x7f64e0145f20 2024-04-24T08:27:00.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 -- 172.21.15.88:0/1696157396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e0145f20 msgr2=0x7f64e01504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:00.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 --2- 172.21.15.88:0/1696157396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e0145f20 0x7f64e01504e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f64e006c9d0 tx=0x7f64d801c810 comp rx=0 tx=0).stop 2024-04-24T08:27:00.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 -- 172.21.15.88:0/1696157396 shutdown_connections 2024-04-24T08:27:00.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 --2- 172.21.15.88:0/1696157396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e0145f20 0x7f64e01504e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:00.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 --2- 172.21.15.88:0/1696157396 >> v2:172.21.15.142:3300/0 conn(0x7f64e00b9d90 0x7f64e006d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:00.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 -- 172.21.15.88:0/1696157396 >> 172.21.15.88:0/1696157396 conn(0x7f64e006c0d0 msgr2=0x7f64e00b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:27:00.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 -- 172.21.15.88:0/1696157396 shutdown_connections 2024-04-24T08:27:00.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 -- 172.21.15.88:0/1696157396 wait complete. 2024-04-24T08:27:00.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 Processor -- start 2024-04-24T08:27:00.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 -- start start 2024-04-24T08:27:00.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64e009be30 0x7f64e013d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64e00b9d90 0x7f64e01e37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e0145f20 0x7f64e014e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f64e00b3fa0 con 0x7f64e0145f20 2024-04-24T08:27:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f64e00b3e20 con 0x7f64e00b9d90 2024-04-24T08:27:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64e5a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f64e006de60 con 0x7f64e009be30 2024-04-24T08:27:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64df400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e0145f20 0x7f64e014e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64df400640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e0145f20 0x7f64e014e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45222/0 (socket says 172.21.15.88:45222) 2024-04-24T08:27:01.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64df400640 1 -- 172.21.15.88:0/2548757986 learned_addr learned my addr 172.21.15.88:0/2548757986 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:27:01.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64de000640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64e00b9d90 0x7f64e01e37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64dea00640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64e009be30 0x7f64e013d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64df400640 1 -- 172.21.15.88:0/2548757986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64e009be30 msgr2=0x7f64e013d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64df400640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64e009be30 0x7f64e013d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64df400640 1 -- 172.21.15.88:0/2548757986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64e00b9d90 msgr2=0x7f64e01e37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64df400640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64e00b9d90 0x7f64e01e37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64df400640 1 -- 172.21.15.88:0/2548757986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e0143020 con 0x7f64e0145f20 2024-04-24T08:27:01.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64dea00640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64e009be30 0x7f64e013d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:27:01.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64df400640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e0145f20 0x7f64e014e6b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f64d80b0040 tx=0x7f64d80195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:27:01.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.983+0000 7f64d6a00640 1 -- 172.21.15.88:0/2548757986 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d80b2050 con 0x7f64e0145f20 2024-04-24T08:27:01.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.987+0000 7f64d6a00640 1 -- 172.21.15.88:0/2548757986 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d80be070 con 0x7f64e0145f20 2024-04-24T08:27:01.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.987+0000 7f64e5a00640 1 -- 172.21.15.88:0/2548757986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e00b90e0 con 0x7f64e0145f20 2024-04-24T08:27:01.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.987+0000 7f64d6a00640 1 -- 172.21.15.88:0/2548757986 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d80ad890 con 0x7f64e0145f20 2024-04-24T08:27:01.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.987+0000 7f64e5a00640 1 -- 172.21.15.88:0/2548757986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e00b7f00 con 0x7f64e0145f20 2024-04-24T08:27:01.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.987+0000 7f64e5a00640 1 -- 172.21.15.88:0/2548757986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e00b4290 con 0x7f64e0145f20 2024-04-24T08:27:01.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.987+0000 7f64d6a00640 1 -- 172.21.15.88:0/2548757986 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f64d80ada30 con 0x7f64e0145f20 2024-04-24T08:27:01.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.987+0000 7f64d6a00640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f64c0068380 0x7f64c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.987+0000 7f64d6a00640 1 -- 172.21.15.88:0/2548757986 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f64d8121940 con 0x7f64e0145f20 2024-04-24T08:27:01.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.987+0000 7f64dea00640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f64c0068380 0x7f64c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.987+0000 7f64dea00640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f64c0068380 0x7f64c006a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009bb0 tx=0x7f64d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:27:01.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:00.991+0000 7f64d6a00640 1 -- 172.21.15.88:0/2548757986 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f64e0143020 con 0x7f64e0145f20 2024-04-24T08:27:01.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.151+0000 7f64e5a00640 1 -- 172.21.15.88:0/2548757986 --> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64e0068b90 con 0x7f64c0068380 2024-04-24T08:27:01.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.151+0000 7f64d6a00640 1 -- 172.21.15.88:0/2548757986 <== mgr.4104 v2:172.21.15.88:6832/1577478747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13354 (secure 0 0 0) 0x7f64e0068b90 con 0x7f64c0068380 2024-04-24T08:27:01.158 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:27:01.160 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-24T08:27:01.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.155+0000 7f64e5a00640 1 -- 172.21.15.88:0/2548757986 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f64c0068380 msgr2=0x7f64c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.155+0000 7f64e5a00640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f64c0068380 0x7f64c006a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009bb0 tx=0x7f64d0008040 comp rx=0 tx=0).stop 2024-04-24T08:27:01.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.155+0000 7f64e5a00640 1 -- 172.21.15.88:0/2548757986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e0145f20 msgr2=0x7f64e014e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.155+0000 7f64e5a00640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e0145f20 0x7f64e014e6b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f64d80b0040 tx=0x7f64d80195b0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.155+0000 7f64e5a00640 1 -- 172.21.15.88:0/2548757986 shutdown_connections 2024-04-24T08:27:01.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.155+0000 7f64e5a00640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f64c0068380 0x7f64c006a840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.155+0000 7f64e5a00640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64e0145f20 0x7f64e014e6b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.155+0000 7f64e5a00640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64e00b9d90 0x7f64e01e37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.155+0000 7f64e5a00640 1 --2- 172.21.15.88:0/2548757986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64e009be30 0x7f64e013d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.155+0000 7f64e5a00640 1 -- 172.21.15.88:0/2548757986 >> 172.21.15.88:0/2548757986 conn(0x7f64e006c0d0 msgr2=0x7f64e00aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:27:01.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.155+0000 7f64e5a00640 1 -- 172.21.15.88:0/2548757986 shutdown_connections 2024-04-24T08:27:01.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.155+0000 7f64e5a00640 1 -- 172.21.15.88:0/2548757986 wait complete. 2024-04-24T08:27:01.177 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-24T08:27:01.005788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220204,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754516,"statfs":{"total":773094113280,"available":772868624384,"internally_reserved":0,"allocated":4136960,"data_stored":2314024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002124"},"pg_stats":[{"pgid":"1.0","version":"32'119","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T08:26:41.121156+0000","last_change":"2024-04-24T08:26:41.121190+0000","last_active":"2024-04-24T08:26:41.121156+0000","last_peered":"2024-04-24T08:26:41.121156+0000","last_clean":"2024-04-24T08:26:41.121156+0000","last_became_active":"2024-04-24T08:25:16.506357+0000","last_became_peered":"2024-04-24T08:25:16.506357+0000","last_unstale":"2024-04-24T08:26:41.121156+0000","last_undegraded":"2024-04-24T08:26:41.121156+0000","last_fullsized":"2024-04-24T08:26:41.121156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-04-24T08:26:41.121054+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-04-24T08:26:41.121054+0000","last_clean_scrub_stamp":"2024-04-24T08:26:41.121054+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:24:33.575162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":962560,"data_stored":732029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":962560,"data_stored":732029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T08:27:01.179 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-24T08:27:01.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2504200640 1 Processor -- start 2024-04-24T08:27:01.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2504200640 1 -- start start 2024-04-24T08:27:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2504200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24fc146690 0x7f24fc09e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2504200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24fc06e490 0x7f24fc09e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2504200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24fc06d4f0 con 0x7f24fc0b4c90 2024-04-24T08:27:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2504200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f24fc06d2a0 con 0x7f24fc06e490 2024-04-24T08:27:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2504200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f24fc06d7d0 con 0x7f24fc146690 2024-04-24T08:27:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2502200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24fc06e490 0x7f24fc09e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2502200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24fc06e490 0x7f24fc09e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45226/0 (socket says 172.21.15.88:45226) 2024-04-24T08:27:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2502200640 1 -- 172.21.15.88:0/4006317190 learned_addr learned my addr 172.21.15.88:0/4006317190 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:27:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2500e00640 1 --2- 172.21.15.88:0/4006317190 >> v2:172.21.15.142:3300/0 conn(0x7f24fc146690 0x7f24fc09e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2502200640 1 -- 172.21.15.88:0/4006317190 >> v2:172.21.15.142:3300/0 conn(0x7f24fc146690 msgr2=0x7f24fc09e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:27:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2502200640 1 --2- 172.21.15.88:0/4006317190 >> v2:172.21.15.142:3300/0 conn(0x7f24fc146690 0x7f24fc09e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2502200640 1 -- 172.21.15.88:0/4006317190 >> v1:172.21.15.142:6789/0 conn(0x7f24fc0b4c90 legacy=0x7f24fc145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:27:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2502200640 1 -- 172.21.15.88:0/4006317190 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc09c570 con 0x7f24fc06e490 2024-04-24T08:27:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.311+0000 7f2500e00640 1 --2- 172.21.15.88:0/4006317190 >> v2:172.21.15.142:3300/0 conn(0x7f24fc146690 0x7f24fc09e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T08:27:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f2502200640 1 --2- 172.21.15.88:0/4006317190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc06e490 0x7f24fc09e5d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f24fc09be20 tx=0x7f24f401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05b079f6f3a493a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:27:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f24fbe00640 1 -- 172.21.15.88:0/4006317190 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f40a5620 con 0x7f24fc06e490 2024-04-24T08:27:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f24fbe00640 1 -- 172.21.15.88:0/4006317190 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f40a57c0 con 0x7f24fc06e490 2024-04-24T08:27:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f24fbe00640 1 -- 172.21.15.88:0/4006317190 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f40a5b90 con 0x7f24fc06e490 2024-04-24T08:27:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f2504200640 1 -- 172.21.15.88:0/4006317190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc06e490 msgr2=0x7f24fc09e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f2504200640 1 --2- 172.21.15.88:0/4006317190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc06e490 0x7f24fc09e5d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f24fc09be20 tx=0x7f24f401c960 comp rx=0 tx=0).stop 2024-04-24T08:27:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f2504200640 1 -- 172.21.15.88:0/4006317190 shutdown_connections 2024-04-24T08:27:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f2504200640 1 --2- 172.21.15.88:0/4006317190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc06e490 0x7f24fc09e5d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f2504200640 1 --2- 172.21.15.88:0/4006317190 >> v2:172.21.15.142:3300/0 conn(0x7f24fc146690 0x7f24fc09e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f2504200640 1 -- 172.21.15.88:0/4006317190 >> 172.21.15.88:0/4006317190 conn(0x7f24fc0b9690 msgr2=0x7f24fc0b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:27:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f2504200640 1 -- 172.21.15.88:0/4006317190 shutdown_connections 2024-04-24T08:27:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f2504200640 1 -- 172.21.15.88:0/4006317190 wait complete. 2024-04-24T08:27:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f2504200640 1 Processor -- start 2024-04-24T08:27:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.315+0000 7f2504200640 1 -- start start 2024-04-24T08:27:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2504200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24fc06e490 0x7f24fc0aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2504200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0b4c90 0x7f24fc1e0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2504200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24fc146690 0x7f24fc0af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2504200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc152fc0 con 0x7f24fc0b4c90 2024-04-24T08:27:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2504200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc152e40 con 0x7f24fc06e490 2024-04-24T08:27:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2504200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f24fc153140 con 0x7f24fc146690 2024-04-24T08:27:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2500e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0b4c90 0x7f24fc1e0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2500e00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0b4c90 0x7f24fc1e0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45242/0 (socket says 172.21.15.88:45242) 2024-04-24T08:27:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2500e00640 1 -- 172.21.15.88:0/4029136523 learned_addr learned my addr 172.21.15.88:0/4029136523 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:27:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2501800640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24fc06e490 0x7f24fc0aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2502200640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24fc146690 0x7f24fc0af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2500e00640 1 -- 172.21.15.88:0/4029136523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24fc146690 msgr2=0x7f24fc0af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2500e00640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24fc146690 0x7f24fc0af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2500e00640 1 -- 172.21.15.88:0/4029136523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24fc06e490 msgr2=0x7f24fc0aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2500e00640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24fc06e490 0x7f24fc0aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2500e00640 1 -- 172.21.15.88:0/4029136523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc070a10 con 0x7f24fc0b4c90 2024-04-24T08:27:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2502200640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24fc146690 0x7f24fc0af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T08:27:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2500e00640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0b4c90 0x7f24fc1e0440 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f24e800d830 tx=0x7f24e800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:27:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f24f9600640 1 -- 172.21.15.88:0/4029136523 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e8018020 con 0x7f24fc0b4c90 2024-04-24T08:27:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f24f9600640 1 -- 172.21.15.88:0/4029136523 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e80096c0 con 0x7f24fc0b4c90 2024-04-24T08:27:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f24f9600640 1 -- 172.21.15.88:0/4029136523 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e8009ab0 con 0x7f24fc0b4c90 2024-04-24T08:27:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2504200640 1 -- 172.21.15.88:0/4029136523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24fc1490d0 con 0x7f24fc0b4c90 2024-04-24T08:27:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2504200640 1 -- 172.21.15.88:0/4029136523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24fc14ff70 con 0x7f24fc0b4c90 2024-04-24T08:27:01.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f2504200640 1 -- 172.21.15.88:0/4029136523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24fc068c00 con 0x7f24fc0b4c90 2024-04-24T08:27:01.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.319+0000 7f24f9600640 1 -- 172.21.15.88:0/4029136523 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f24e801b020 con 0x7f24fc0b4c90 2024-04-24T08:27:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.323+0000 7f24f9600640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f24dc068380 0x7f24dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.323+0000 7f24f9600640 1 -- 172.21.15.88:0/4029136523 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f24e8086e40 con 0x7f24fc0b4c90 2024-04-24T08:27:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.323+0000 7f2501800640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f24dc068380 0x7f24dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.323+0000 7f2501800640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f24dc068380 0x7f24dc06a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f24f0001650 tx=0x7f24f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:27:01.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.327+0000 7f24f9600640 1 -- 172.21.15.88:0/4029136523 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f24e8022020 con 0x7f24fc0b4c90 2024-04-24T08:27:01.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.483+0000 7f2504200640 1 -- 172.21.15.88:0/4029136523 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f24fc0b44c0 con 0x7f24fc0b4c90 2024-04-24T08:27:01.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f24f9600640 1 -- 172.21.15.88:0/4029136523 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f24e8057790 con 0x7f24fc0b4c90 2024-04-24T08:27:01.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f24f9600640 1 -- 172.21.15.88:0/4029136523 <== mon.0 v2:172.21.15.88:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f24e8057090 con 0x7f24fc0b4c90 2024-04-24T08:27:01.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f2504200640 1 -- 172.21.15.88:0/4029136523 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f24dc068380 msgr2=0x7f24dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f2504200640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f24dc068380 0x7f24dc06a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f24f0001650 tx=0x7f24f0009040 comp rx=0 tx=0).stop 2024-04-24T08:27:01.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f2504200640 1 -- 172.21.15.88:0/4029136523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0b4c90 msgr2=0x7f24fc1e0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f2504200640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0b4c90 0x7f24fc1e0440 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f24e800d830 tx=0x7f24e800dcf0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f2504200640 1 -- 172.21.15.88:0/4029136523 shutdown_connections 2024-04-24T08:27:01.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f2504200640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f24dc068380 0x7f24dc06a840 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f2504200640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24fc146690 0x7f24fc0af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f2504200640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24fc0b4c90 0x7f24fc1e0440 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f2504200640 1 --2- 172.21.15.88:0/4029136523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24fc06e490 0x7f24fc0aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f2504200640 1 -- 172.21.15.88:0/4029136523 >> 172.21.15.88:0/4029136523 conn(0x7f24fc0b9690 msgr2=0x7f24fc0b6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:27:01.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f2504200640 1 -- 172.21.15.88:0/4029136523 shutdown_connections 2024-04-24T08:27:01.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.487+0000 7f2504200640 1 -- 172.21.15.88:0/4029136523 wait complete. 2024-04-24T08:27:01.513 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T08:27:01.513 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T08:27:01.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.643+0000 7f72f0200640 1 Processor -- start 2024-04-24T08:27:01.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.643+0000 7f72f0200640 1 -- start start 2024-04-24T08:27:01.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72f0200640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f72e80b44e0 0x7f72e80b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72f0200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f72e8143bb0 0x7f72e8144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72f0200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e80ba170 con 0x7f72e80b9d90 2024-04-24T08:27:01.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72f0200640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f72e8145b80 con 0x7f72e80b44e0 2024-04-24T08:27:01.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72f0200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f72e81458a0 con 0x7f72e8143bb0 2024-04-24T08:27:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72ece00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f72e80b44e0 0x7f72e80b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72ece00640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f72e80b44e0 0x7f72e80b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45246/0 (socket says 172.21.15.88:45246) 2024-04-24T08:27:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72ece00640 1 -- 172.21.15.88:0/1682552624 learned_addr learned my addr 172.21.15.88:0/1682552624 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:27:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72ee200640 1 --2- 172.21.15.88:0/1682552624 >> v2:172.21.15.142:3300/0 conn(0x7f72e8143bb0 0x7f72e8144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72ece00640 1 -- 172.21.15.88:0/1682552624 >> v2:172.21.15.142:3300/0 conn(0x7f72e8143bb0 msgr2=0x7f72e8144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:27:01.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72ece00640 1 --2- 172.21.15.88:0/1682552624 >> v2:172.21.15.142:3300/0 conn(0x7f72e8143bb0 0x7f72e8144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72ece00640 1 -- 172.21.15.88:0/1682552624 >> v1:172.21.15.142:6789/0 conn(0x7f72e80b9d90 legacy=0x7f72e81450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T08:27:01.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72ece00640 1 -- 172.21.15.88:0/1682552624 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e80b3fc0 con 0x7f72e80b44e0 2024-04-24T08:27:01.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.647+0000 7f72ece00640 1 --2- 172.21.15.88:0/1682552624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e80b44e0 0x7f72e80b4970 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f72e809e160 tx=0x7f72d401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d04223180c5139 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:27:01.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72e7e00640 1 -- 172.21.15.88:0/1682552624 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d40b0070 con 0x7f72e80b44e0 2024-04-24T08:27:01.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72e7e00640 1 -- 172.21.15.88:0/1682552624 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f72d40ab600 con 0x7f72e80b44e0 2024-04-24T08:27:01.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72e7e00640 1 -- 172.21.15.88:0/1682552624 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d40ab9f0 con 0x7f72e80b44e0 2024-04-24T08:27:01.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 -- 172.21.15.88:0/1682552624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e80b44e0 msgr2=0x7f72e80b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 --2- 172.21.15.88:0/1682552624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e80b44e0 0x7f72e80b4970 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f72e809e160 tx=0x7f72d401c450 comp rx=0 tx=0).stop 2024-04-24T08:27:01.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 -- 172.21.15.88:0/1682552624 shutdown_connections 2024-04-24T08:27:01.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 --2- 172.21.15.88:0/1682552624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e80b44e0 0x7f72e80b4970 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 --2- 172.21.15.88:0/1682552624 >> v2:172.21.15.142:3300/0 conn(0x7f72e8143bb0 0x7f72e8144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 -- 172.21.15.88:0/1682552624 >> 172.21.15.88:0/1682552624 conn(0x7f72e806c0d0 msgr2=0x7f72e80b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:27:01.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 -- 172.21.15.88:0/1682552624 shutdown_connections 2024-04-24T08:27:01.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 -- 172.21.15.88:0/1682552624 wait complete. 2024-04-24T08:27:01.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 Processor -- start 2024-04-24T08:27:01.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 -- start start 2024-04-24T08:27:01.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72e80b44e0 0x7f72e814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e80b9d90 0x7f72e80b7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72e8143bb0 0x7f72e80b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f72e8152010 con 0x7f72e80b9d90 2024-04-24T08:27:01.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f72e8151e90 con 0x7f72e8143bb0 2024-04-24T08:27:01.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72f0200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f72e8152190 con 0x7f72e80b44e0 2024-04-24T08:27:01.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72ece00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e80b9d90 0x7f72e80b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72ece00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e80b9d90 0x7f72e80b7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45260/0 (socket says 172.21.15.88:45260) 2024-04-24T08:27:01.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72ece00640 1 -- 172.21.15.88:0/24836453 learned_addr learned my addr 172.21.15.88:0/24836453 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T08:27:01.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72ee200640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72e8143bb0 0x7f72e80b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72ed800640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72e80b44e0 0x7f72e814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72ece00640 1 -- 172.21.15.88:0/24836453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72e80b44e0 msgr2=0x7f72e814cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72ece00640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72e80b44e0 0x7f72e814cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72ece00640 1 -- 172.21.15.88:0/24836453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72e8143bb0 msgr2=0x7f72e80b7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72ece00640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72e8143bb0 0x7f72e80b7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.651+0000 7f72ece00640 1 -- 172.21.15.88:0/24836453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e808c2a0 con 0x7f72e80b9d90 2024-04-24T08:27:01.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.655+0000 7f72ece00640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e80b9d90 0x7f72e80b7740 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f72d401a080 tx=0x7f72d40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:27:01.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.655+0000 7f72e5600640 1 -- 172.21.15.88:0/24836453 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d40b0040 con 0x7f72e80b9d90 2024-04-24T08:27:01.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.655+0000 7f72e5600640 1 -- 172.21.15.88:0/24836453 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f72d40b9070 con 0x7f72e80b9d90 2024-04-24T08:27:01.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.655+0000 7f72f0200640 1 -- 172.21.15.88:0/24836453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e808c510 con 0x7f72e80b9d90 2024-04-24T08:27:01.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.655+0000 7f72e5600640 1 -- 172.21.15.88:0/24836453 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d40b4880 con 0x7f72e80b9d90 2024-04-24T08:27:01.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.655+0000 7f72f0200640 1 -- 172.21.15.88:0/24836453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e814e370 con 0x7f72e80b9d90 2024-04-24T08:27:01.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.655+0000 7f72f0200640 1 -- 172.21.15.88:0/24836453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e8068b90 con 0x7f72e80b9d90 2024-04-24T08:27:01.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.655+0000 7f72e5600640 1 -- 172.21.15.88:0/24836453 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72d40ab4c0 con 0x7f72e80b9d90 2024-04-24T08:27:01.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.655+0000 7f72e5600640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72c8068380 0x7f72c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T08:27:01.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.655+0000 7f72e5600640 1 -- 172.21.15.88:0/24836453 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4943+0+0 (secure 0 0 0) 0x7f72d4120520 con 0x7f72e80b9d90 2024-04-24T08:27:01.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.655+0000 7f72ed800640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72c8068380 0x7f72c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T08:27:01.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.659+0000 7f72ed800640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72c8068380 0x7f72c806a840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f72dc004e30 tx=0x7f72dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T08:27:01.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.659+0000 7f72e5600640 1 -- 172.21.15.88:0/24836453 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f72d40160d0 con 0x7f72e80b9d90 2024-04-24T08:27:01.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.847+0000 7f72f0200640 1 -- 172.21.15.88:0/24836453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72e80718b0 con 0x7f72e80b9d90 2024-04-24T08:27:01.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72e5600640 1 -- 172.21.15.88:0/24836453 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+2222 (secure 0 0 0) 0x7f72d40f0dd0 con 0x7f72e80b9d90 2024-04-24T08:27:01.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T08:27:01.854 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1471179990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1471179990},{"type":"v1","addr":"172.21.15.142:6833","nonce":1471179990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1404374497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1404374497},{"type":"v1","addr":"172.21.15.88:6835","nonce":1404374497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-04-24T08:27:01.855 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 18 2024-04-24T08:27:01.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72f0200640 1 -- 172.21.15.88:0/24836453 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72c8068380 msgr2=0x7f72c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72f0200640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72c8068380 0x7f72c806a840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f72dc004e30 tx=0x7f72dc009040 comp rx=0 tx=0).stop 2024-04-24T08:27:01.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72f0200640 1 -- 172.21.15.88:0/24836453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e80b9d90 msgr2=0x7f72e80b7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T08:27:01.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72f0200640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e80b9d90 0x7f72e80b7740 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f72d401a080 tx=0x7f72d40191f0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72f0200640 1 -- 172.21.15.88:0/24836453 shutdown_connections 2024-04-24T08:27:01.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72f0200640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.88:6832/1577478747,v1:172.21.15.88:6833/1577478747] conn(0x7f72c8068380 0x7f72c806a840 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72f0200640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72e8143bb0 0x7f72e80b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72f0200640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e80b9d90 0x7f72e80b7740 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72f0200640 1 --2- 172.21.15.88:0/24836453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72e80b44e0 0x7f72e814cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T08:27:01.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72f0200640 1 -- 172.21.15.88:0/24836453 >> 172.21.15.88:0/24836453 conn(0x7f72e806c0d0 msgr2=0x7f72e80720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T08:27:01.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72f0200640 1 -- 172.21.15.88:0/24836453 shutdown_connections 2024-04-24T08:27:01.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T08:27:01.851+0000 7f72f0200640 1 -- 172.21.15.88:0/24836453 wait complete. 2024-04-24T08:27:01.875 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-24T08:27:01.875 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-24T08:27:01.875 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-24T08:27:01.875 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:01.889 INFO:tasks.ceph.mds.a:Stopped 2024-04-24T08:27:01.889 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-24T08:27:01.889 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:01.905 INFO:tasks.ceph.mds.b:Stopped 2024-04-24T08:27:01.905 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-24T08:27:01.905 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-24T08:27:01.905 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:04.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-24T08:27:08.007 INFO:tasks.ceph.osd.0:Stopped 2024-04-24T08:27:08.008 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-24T08:27:08.008 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:08.094 INFO:tasks.ceph.osd.1:Stopped 2024-04-24T08:27:08.095 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-24T08:27:08.095 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:08.193 INFO:tasks.ceph.osd.2:Stopped 2024-04-24T08:27:08.194 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-24T08:27:08.194 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:08.293 INFO:tasks.ceph.osd.3:Stopped 2024-04-24T08:27:08.294 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-24T08:27:08.294 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:10.749 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-24T08:27:10.749 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-24T08:27:14.396 INFO:tasks.ceph.osd.4:Stopped 2024-04-24T08:27:14.396 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-24T08:27:14.397 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:14.482 INFO:tasks.ceph.osd.5:Stopped 2024-04-24T08:27:14.483 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-24T08:27:14.483 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:16.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-24T08:27:16.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-24T08:27:20.585 INFO:tasks.ceph.osd.6:Stopped 2024-04-24T08:27:20.585 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-24T08:27:20.585 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:20.649 INFO:tasks.ceph.osd.7:Stopped 2024-04-24T08:27:20.649 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-24T08:27:20.650 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-24T08:27:20.650 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:20.708 INFO:tasks.ceph.mgr.y:Stopped 2024-04-24T08:27:20.708 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-24T08:27:20.709 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:20.763 INFO:tasks.ceph.mgr.x:Stopped 2024-04-24T08:27:20.764 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-24T08:27:20.764 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-24T08:27:20.764 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:20.782 INFO:tasks.ceph.mon.a:Stopped 2024-04-24T08:27:20.782 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-24T08:27:20.782 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:20.797 INFO:tasks.ceph.mon.b:Stopped 2024-04-24T08:27:20.798 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-24T08:27:20.798 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T08:27:20.860 INFO:tasks.ceph.mon.c:Stopped 2024-04-24T08:27:20.860 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-24T08:27:20.861 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-24T08:27:20.892 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:27:20.892 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-24T08:27:21.174 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:27:21.174 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-24T08:27:21.336 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:27:21.336 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-24T08:27:21.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-24T08:27:21.477 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:27:21.477 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-24T08:27:21.627 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T08:27:21.627 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-24T08:27:21.822 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T08:27:21.823 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-24T08:27:22.048 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T08:27:22.049 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-24T08:27:22.234 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T08:27:22.234 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-24T08:27:22.400 INFO:tasks.ceph:Archiving mon data... 2024-04-24T08:27:22.401 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215/data/mon.a.tgz 2024-04-24T08:27:22.402 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-04-24T08:27:22.411 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.86QURxQTMf 2024-04-24T08:27:22.411 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.86QURxQTMf 2024-04-24T08:27:22.525 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.86QURxQTMf 2024-04-24T08:27:22.602 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.86QURxQTMf is 279KB 2024-04-24T08:27:22.664 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.86QURxQTMf 2024-04-24T08:27:22.672 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215/data/mon.b.tgz 2024-04-24T08:27:22.672 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-04-24T08:27:22.680 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.2JIqB9ghOI 2024-04-24T08:27:22.681 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2JIqB9ghOI 2024-04-24T08:27:22.813 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.2JIqB9ghOI 2024-04-24T08:27:22.888 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.2JIqB9ghOI is 374KB 2024-04-24T08:27:22.950 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.2JIqB9ghOI 2024-04-24T08:27:22.958 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215/data/mon.c.tgz 2024-04-24T08:27:22.959 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-04-24T08:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.i82I0551B5 2024-04-24T08:27:23.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.i82I0551B5 2024-04-24T08:27:23.136 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.i82I0551B5 2024-04-24T08:27:23.212 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.i82I0551B5 is 374KB 2024-04-24T08:27:23.275 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.i82I0551B5 2024-04-24T08:27:23.283 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-24T08:27:23.283 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T08:27:23.286 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T08:27:23.354 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T08:27:23.391 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T08:27:23.392 INFO:tasks.ceph:Archiving crash dumps... 2024-04-24T08:27:23.394 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215/remote/smithi088/crash 2024-04-24T08:27:23.394 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T08:27:23.417 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215/remote/smithi142/crash 2024-04-24T08:27:23.418 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T08:27:23.450 INFO:tasks.ceph:Shutting down logrotate 2024-04-24T08:27:23.450 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T08:27:23.464 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T08:27:23.540 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-24T08:27:23.561 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-24T08:27:23.602 INFO:tasks.ceph:Compressing logs... 2024-04-24T08:27:23.602 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T08:27:23.605 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T08:27:23.630 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36942.log 2024-04-24T08:27:23.631 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33631.log 2024-04-24T08:27:23.632 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34740.log 2024-04-24T08:27:23.632 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36942.log.gz 2024-04-24T08:27:23.633 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34610.log 2024-04-24T08:27:23.633 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33631.log.gz 2024-04-24T08:27:23.634 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34014.log 2024-04-24T08:27:23.634 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34740.log.gz 2024-04-24T08:27:23.635 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34402.log 2024-04-24T08:27:23.636 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34610.log.gz 2024-04-24T08:27:23.636 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34014.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-24T08:27:23.636 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34014.log.gz 2024-04-24T08:27:23.637 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33401.log 2024-04-24T08:27:23.637 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34402.log.gz 2024-04-24T08:27:23.637 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35992.log 2024-04-24T08:27:23.638 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37390.log 2024-04-24T08:27:23.638 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33401.log.gz 2024-04-24T08:27:23.639 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33577.log 2024-04-24T08:27:23.639 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35992.log.gz 2024-04-24T08:27:23.640 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35334.log 2024-04-24T08:27:23.640 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37390.log.gz 2024-04-24T08:27:23.641 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34206.log 2024-04-24T08:27:23.641 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33577.log.gz 2024-04-24T08:27:23.642 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35334.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-24T08:27:23.642 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35334.log.gz 2024-04-24T08:27:23.642 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38289.log 2024-04-24T08:27:23.643 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34206.log.gz 2024-04-24T08:27:23.643 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35913.log 2024-04-24T08:27:23.644 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34008.log 2024-04-24T08:27:23.644 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38289.log.gz 2024-04-24T08:27:23.645 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38081.log 2024-04-24T08:27:23.645 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35913.log.gz 2024-04-24T08:27:23.646 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37790.log 2024-04-24T08:27:23.646 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34008.log.gz 2024-04-24T08:27:23.647 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36337.log 2024-04-24T08:27:23.648 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38081.log.gz 2024-04-24T08:27:23.648 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33447.log 2024-04-24T08:27:23.648 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37790.log.gz 2024-04-24T08:27:23.649 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36337.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36337.log.gz 2024-04-24T08:27:23.649 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36535.log 2024-04-24T08:27:23.650 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33856.log 2024-04-24T08:27:23.651 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33447.log.gz 2024-04-24T08:27:23.652 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35672.log 2024-04-24T08:27:23.653 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36535.log.gz 2024-04-24T08:27:23.653 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37446.log 2024-04-24T08:27:23.653 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33856.log.gz 2024-04-24T08:27:23.654 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36994.log 2024-04-24T08:27:23.654 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35672.log.gz 2024-04-24T08:27:23.654 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36665.log 2024-04-24T08:27:23.654 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37446.log.gz 2024-04-24T08:27:23.655 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37472.log 2024-04-24T08:27:23.655 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36994.log.gz 2024-04-24T08:27:23.656 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35360.log 2024-04-24T08:27:23.656 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36665.log.gz 2024-04-24T08:27:23.657 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35516.log 2024-04-24T08:27:23.657 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37472.log.gz 2024-04-24T08:27:23.658 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37072.log 2024-04-24T08:27:23.658 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35360.log.gz 2024-04-24T08:27:23.659 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37020.log 2024-04-24T08:27:23.659 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35516.log.gz 2024-04-24T08:27:23.660 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37712.log 2024-04-24T08:27:23.660 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37072.log.gz 2024-04-24T08:27:23.661 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38237.log 2024-04-24T08:27:23.661 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37020.log.gz 2024-04-24T08:27:23.661 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37046.log 2024-04-24T08:27:23.662 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37712.log.gz 2024-04-24T08:27:23.662 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35412.log 2024-04-24T08:27:23.662 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38237.log.gz 2024-04-24T08:27:23.664 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35256.log 2024-04-24T08:27:23.664 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37046.log.gz 2024-04-24T08:27:23.664 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37524.log 2024-04-24T08:27:23.664 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35412.log.gz 2024-04-24T08:27:23.665 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35256.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-24T08:27:23.665 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35256.log.gz 2024-04-24T08:27:23.666 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37498.log 2024-04-24T08:27:23.666 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37524.log.gz 2024-04-24T08:27:23.666 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34636.log 2024-04-24T08:27:23.667 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37498.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37498.log.gz 2024-04-24T08:27:23.667 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37335.log 2024-04-24T08:27:23.668 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35835.log 2024-04-24T08:27:23.669 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.37335.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34636.log.gz 2024-04-24T08:27:23.669 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36367.log 2024-04-24T08:27:23.670 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27705.log 2024-04-24T08:27:23.671 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33551.log 2024-04-24T08:27:23.671 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27729.log 2024-04-24T08:27:23.672 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35835.log.gz 2024-04-24T08:27:23.673 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36367.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-24T08:27:23.673 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34429.log 2024-04-24T08:27:23.673 INFO:teuthology.orchestra.run.smithi088.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.37335.log.gz 2024-04-24T08:27:23.673 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36367.log.gz 2024-04-24T08:27:23.673 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34425.log 2024-04-24T08:27:23.677 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33551.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33551.log.gz 2024-04-24T08:27:23.677 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38055.log 2024-04-24T08:27:23.677 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34429.log.gz 2024-04-24T08:27:23.678 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34425.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-24T08:27:23.678 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34425.log.gz 2024-04-24T08:27:23.678 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37634.log 2024-04-24T08:27:23.678 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38055.log.gz 2024-04-24T08:27:23.678 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27503.log 2024-04-24T08:27:23.680 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.27705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27657.log 2024-04-24T08:27:23.680 INFO:teuthology.orchestra.run.smithi142.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27705.log.gz 2024-04-24T08:27:23.680 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.27729.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-24T08:27:23.680 INFO:teuthology.orchestra.run.smithi142.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27729.log.gz 2024-04-24T08:27:23.680 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.27657.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-24T08:27:23.680 INFO:teuthology.orchestra.run.smithi142.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27657.log.gz 2024-04-24T08:27:23.680 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27801.log 2024-04-24T08:27:23.680 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27753.log 2024-04-24T08:27:23.681 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.27801.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-24T08:27:23.681 INFO:teuthology.orchestra.run.smithi142.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27801.log.gz 2024-04-24T08:27:23.681 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.27753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27777.log 2024-04-24T08:27:23.681 INFO:teuthology.orchestra.run.smithi142.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27753.log.gz 2024-04-24T08:27:23.681 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27681.log 2024-04-24T08:27:23.681 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.27777.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27777.log.gz 2024-04-24T08:27:23.681 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-24T08:27:23.681 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.27681.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T08:27:23.685 INFO:teuthology.orchestra.run.smithi142.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27681.log.gz 2024-04-24T08:27:23.685 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27633.log 2024-04-24T08:27:23.685 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-24T08:27:23.686 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.27633.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T08:27:23.686 INFO:teuthology.orchestra.run.smithi142.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T08:27:23.686 INFO:teuthology.orchestra.run.smithi142.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27633.log.gz 2024-04-24T08:27:23.686 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-24T08:27:23.686 INFO:teuthology.orchestra.run.smithi142.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-24T08:27:23.686 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-24T08:27:23.689 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37634.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37634.log.gz 2024-04-24T08:27:23.689 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38419.log 2024-04-24T08:27:23.689 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.27503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34204.log 2024-04-24T08:27:23.690 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38419.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27503.log.gz 2024-04-24T08:27:23.690 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34222.log 2024-04-24T08:27:23.690 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38419.log.gz 2024-04-24T08:27:23.690 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34001.log 2024-04-24T08:27:23.690 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34204.log.gz 2024-04-24T08:27:23.690 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37764.log 2024-04-24T08:27:23.690 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34222.log.gz 2024-04-24T08:27:23.690 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34974.log 2024-04-24T08:27:23.690 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34001.log.gz 2024-04-24T08:27:23.691 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36311.log 2024-04-24T08:27:23.691 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37764.log.gz 2024-04-24T08:27:23.691 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36797.log 2024-04-24T08:27:23.691 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36311.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34974.log.gz 2024-04-24T08:27:23.691 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37554.log 2024-04-24T08:27:23.691 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36311.log.gz 2024-04-24T08:27:23.691 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37420.log 2024-04-24T08:27:23.691 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36797.log.gz 2024-04-24T08:27:23.692 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38551.log 2024-04-24T08:27:23.692 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37420.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37554.log.gz 2024-04-24T08:27:23.692 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-24T08:27:23.692 INFO:teuthology.orchestra.run.smithi142.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T08:27:23.692 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.b.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-24T08:27:23.694 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38471.log 2024-04-24T08:27:23.694 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37420.log.gz 2024-04-24T08:27:23.694 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35542.log 2024-04-24T08:27:23.695 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38551.log.gz 2024-04-24T08:27:23.695 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36968.log 2024-04-24T08:27:23.695 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38471.log.gz 2024-04-24T08:27:23.695 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34896.log 2024-04-24T08:27:23.695 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35542.log.gz 2024-04-24T08:27:23.695 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38263.log 2024-04-24T08:27:23.695 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36968.log.gz 2024-04-24T08:27:23.697 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35698.log 2024-04-24T08:27:23.697 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38263.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34896.log.gz 2024-04-24T08:27:23.697 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34414.log 2024-04-24T08:27:23.697 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38263.log.gz 2024-04-24T08:27:23.697 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34662.log 88.5% 2024-04-24T08:27:23.697 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35698.log.gz 2024-04-24T08:27:23.698 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35000.log 2024-04-24T08:27:23.698 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34414.log.gz 2024-04-24T08:27:23.699 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38575.log 2024-04-24T08:27:23.699 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34662.log.gz 2024-04-24T08:27:23.700 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36207.log 2024-04-24T08:27:23.700 INFO:teuthology.orchestra.run.smithi088.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.35000.log.gz 2024-04-24T08:27:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34428.log 2024-04-24T08:27:23.701 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38575.log.gz 2024-04-24T08:27:23.702 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36207.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36207.log.gz 2024-04-24T08:27:23.702 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37580.log 2024-04-24T08:27:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38393.log 2024-04-24T08:27:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37580.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34428.log.gz 2024-04-24T08:27:23.704 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-24T08:27:23.704 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37580.log.gz 2024-04-24T08:27:23.705 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34430.log 2024-04-24T08:27:23.705 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38393.log.gz 2024-04-24T08:27:23.706 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36129.log 2024-04-24T08:27:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37606.log 2024-04-24T08:27:23.708 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34430.log.gz 2024-04-24T08:27:23.708 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36129.log: gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.36129.log.gz --verbose 2024-04-24T08:27:23.709 INFO:teuthology.orchestra.run.smithi088.stderr: -- /var/log/ceph/ceph-client.admin.36463.log 2024-04-24T08:27:23.709 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33696.log 2024-04-24T08:27:23.710 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37606.log: /var/log/ceph/ceph-client.admin.36463.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37606.log.gz 2024-04-24T08:27:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35308.log 2024-04-24T08:27:23.711 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36463.log.gz 2024-04-24T08:27:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36717.log 2024-04-24T08:27:23.712 INFO:teuthology.orchestra.run.smithi088.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.33696.log.gz 2024-04-24T08:27:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35230.log 2024-04-24T08:27:23.713 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35308.log.gz 2024-04-24T08:27:23.714 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36408.log 2024-04-24T08:27:23.714 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36717.log.gz 2024-04-24T08:27:23.715 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35490.log 2024-04-24T08:27:23.715 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35230.log.gz 2024-04-24T08:27:23.716 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35966.log 2024-04-24T08:27:23.716 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36408.log.gz 2024-04-24T08:27:23.717 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35490.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.35464.log 2024-04-24T08:27:23.717 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35490.log.gz 2024-04-24T08:27:23.718 INFO:teuthology.orchestra.run.smithi088.stderr:gzip/var/log/ceph/ceph-client.admin.35966.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36155.log 2024-04-24T08:27:23.719 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35464.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35966.log.gz 2024-04-24T08:27:23.719 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34416.log 2024-04-24T08:27:23.719 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35464.log.gz 2024-04-24T08:27:23.720 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33804.log 2024-04-24T08:27:23.720 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36155.log.gz 2024-04-24T08:27:23.721 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35386.log 2024-04-24T08:27:23.721 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34416.log.gz 2024-04-24T08:27:23.722 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33748.log 2024-04-24T08:27:23.723 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33804.log.gz 2024-04-24T08:27:23.723 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35386.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-24T08:27:23.724 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35386.log.gz 2024-04-24T08:27:23.725 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36613.log 2024-04-24T08:27:23.725 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33748.log.gz 2024-04-24T08:27:23.726 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37686.log 2024-04-24T08:27:23.727 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33473.log 2024-04-24T08:27:23.727 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36613.log.gz 2024-04-24T08:27:23.728 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34922.log 2024-04-24T08:27:23.728 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37686.log.gz 2024-04-24T08:27:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33778.log 2024-04-24T08:27:23.730 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33473.log.gz 2024-04-24T08:27:23.731 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33882.log 2024-04-24T08:27:23.731 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34922.log.gz 2024-04-24T08:27:23.732 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38185.log 2024-04-24T08:27:23.732 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33778.log.gz 2024-04-24T08:27:23.733 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34714.log 2024-04-24T08:27:23.733 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33882.log.gz 2024-04-24T08:27:23.735 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34220.log 2024-04-24T08:27:23.735 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38185.log.gz 2024-04-24T08:27:23.735 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36233.log 2024-04-24T08:27:23.736 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34714.log.gz 2024-04-24T08:27:23.736 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33603.log 2024-04-24T08:27:23.737 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34220.log.gz 2024-04-24T08:27:23.738 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36587.log 2024-04-24T08:27:23.738 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36233.log.gz 2024-04-24T08:27:23.738 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33603.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33603.log.gz 2024-04-24T08:27:23.739 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38341.log 2024-04-24T08:27:23.740 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36886.log 2024-04-24T08:27:23.741 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36587.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36587.log.gz/var/log/ceph/ceph-client.admin.38341.log: 2024-04-24T08:27:23.741 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38341.log.gz 2024-04-24T08:27:23.742 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33525.log 2024-04-24T08:27:23.742 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36886.log.gz 2024-04-24T08:27:23.743 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35861.log 2024-04-24T08:27:23.744 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33525.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33525.log.gz 2024-04-24T08:27:23.744 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34844.log 2024-04-24T08:27:23.745 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37965.log 2024-04-24T08:27:23.746 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35861.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35861.log.gz 2024-04-24T08:27:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34844.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34844.log.gz 2024-04-24T08:27:23.747 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36018.log 2024-04-24T08:27:23.748 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.4.log: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-24T08:27:23.748 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37965.log.gz 2024-04-24T08:27:23.749 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37738.log 2024-04-24T08:27:23.750 INFO:teuthology.orchestra.run.smithi088.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-24T08:27:23.750 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33303.log 2024-04-24T08:27:23.750 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36018.log.gz 2024-04-24T08:27:23.751 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34427.log 2024-04-24T08:27:23.751 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37738.log.gz 2024-04-24T08:27:23.752 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37842.log 2024-04-24T08:27:23.752 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33303.log.gz 2024-04-24T08:27:23.752 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34818.log 2024-04-24T08:27:23.753 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34427.log.gz 2024-04-24T08:27:23.753 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37177.log 2024-04-24T08:27:23.754 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37842.log.gz 2024-04-24T08:27:23.755 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34818.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T08:27:23.755 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34818.log.gz 2024-04-24T08:27:23.755 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36639.log 2024-04-24T08:27:23.756 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37177.log.gz 2024-04-24T08:27:23.756 INFO:teuthology.orchestra.run.smithi088.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-24T08:27:23.757 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27619.log 2024-04-24T08:27:23.757 INFO:teuthology.orchestra.run.smithi088.stderr: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T08:27:23.758 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27722.log 2024-04-24T08:27:23.758 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36639.log.gz 2024-04-24T08:27:23.759 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.27619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37279.log 2024-04-24T08:27:23.759 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27619.log.gz 2024-04-24T08:27:23.759 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.27722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38159.log 2024-04-24T08:27:23.760 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27722.log.gz 2024-04-24T08:27:23.760 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36691.log 2024-04-24T08:27:23.761 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37279.log.gz 2024-04-24T08:27:23.761 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37887.log 2024-04-24T08:27:23.762 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38159.log.gz 2024-04-24T08:27:23.762 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33661.log 2024-04-24T08:27:23.763 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36691.log.gz 2024-04-24T08:27:23.763 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37229.log 2024-04-24T08:27:23.764 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37887.log.gz 2024-04-24T08:27:23.764 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33661.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.33661.log.gz 2024-04-24T08:27:23.765 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34214.log 2024-04-24T08:27:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38523.log 2024-04-24T08:27:23.766 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34214.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.37229.log.gz 2024-04-24T08:27:23.766 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36075.log 2024-04-24T08:27:23.766 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34214.log.gz 2024-04-24T08:27:23.767 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5/var/log/ceph/ceph-client.admin.38523.log: --verbose -- /var/log/ceph/ceph-client.admin.33960.log 2024-04-24T08:27:23.768 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38523.log.gz 2024-04-24T08:27:23.768 INFO:teuthology.orchestra.run.smithi142.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-24T08:27:23.769 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34221.log 2024-04-24T08:27:23.769 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36075.log.gz 2024-04-24T08:27:23.769 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35438.log 2024-04-24T08:27:23.769 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33960.log.gz 2024-04-24T08:27:23.770 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38497.log 2024-04-24T08:27:23.770 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34221.log.gz 2024-04-24T08:27:23.771 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37151.log 2024-04-24T08:27:23.771 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35438.log.gz 2024-04-24T08:27:23.772 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35776.log 2024-04-24T08:27:23.772 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38497.log.gz 2024-04-24T08:27:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33908.log 2024-04-24T08:27:23.773 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37151.log.gz 2024-04-24T08:27:23.774 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38315.log 2024-04-24T08:27:23.774 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35776.log.gz 2024-04-24T08:27:23.775 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36860.log 2024-04-24T08:27:23.775 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33908.log.gz 2024-04-24T08:27:23.776 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38003.log 2024-04-24T08:27:23.776 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38315.log.gz 2024-04-24T08:27:23.777 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36860.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22736.log 2024-04-24T08:27:23.777 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36860.log.gz 2024-04-24T08:27:23.778 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35594.log 2024-04-24T08:27:23.778 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38003.log.gz 2024-04-24T08:27:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.tmp-client.admin.22736.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22736.log.gz 2024-04-24T08:27:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33934.log 2024-04-24T08:27:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37660.log 2024-04-24T08:27:23.779 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35594.log.gz 2024-04-24T08:27:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37203.log 2024-04-24T08:27:23.780 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33934.log.gz 2024-04-24T08:27:23.781 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34792.log 2024-04-24T08:27:23.782 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37660.log.gz 2024-04-24T08:27:23.782 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34688.log 2024-04-24T08:27:23.783 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37203.log.gz 2024-04-24T08:27:23.783 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34000.log 2024-04-24T08:27:23.784 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34792.log.gz 2024-04-24T08:27:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36912.log 2024-04-24T08:27:23.784 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34688.log.gz 2024-04-24T08:27:23.785 INFO:teuthology.orchestra.run.smithi142.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-24T08:27:23.786 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35750.log 2024-04-24T08:27:23.786 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34000.log.gz 2024-04-24T08:27:23.786 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36769.log 2024-04-24T08:27:23.786 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36912.log.gz 2024-04-24T08:27:23.787 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33722.log 2024-04-24T08:27:23.787 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35750.log.gz 2024-04-24T08:27:23.788 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36769.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T08:27:23.788 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36769.log.gz 2024-04-24T08:27:23.789 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33722.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-24T08:27:23.789 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33722.log.gz 2024-04-24T08:27:23.790 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36825.log 2024-04-24T08:27:23.790 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.a.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T08:27:23.791 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37098.log 2024-04-24T08:27:23.792 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36181.log 2024-04-24T08:27:23.792 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36825.log.gz 2024-04-24T08:27:23.793 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34766.log 2024-04-24T08:27:23.793 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37098.log.gz 2024-04-24T08:27:23.794 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35568.log 2024-04-24T08:27:23.795 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36181.log.gz 2024-04-24T08:27:23.795 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33996.log 2024-04-24T08:27:23.796 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34766.log.gz 2024-04-24T08:27:23.796 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37913.log 2024-04-24T08:27:23.797 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35568.log.gz 2024-04-24T08:27:23.797 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35940.log 2024-04-24T08:27:23.797 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33996.log.gz 2024-04-24T08:27:23.798 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33499.log 2024-04-24T08:27:23.799 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37913.log.gz 2024-04-24T08:27:23.799 INFO:teuthology.orchestra.run.smithi142.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-24T08:27:23.800 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37939.log 2024-04-24T08:27:23.800 INFO:teuthology.orchestra.run.smithi088.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35940.log.gz 2024-04-24T08:27:23.800 INFO:teuthology.orchestra.run.smithi142.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-24T08:27:23.801 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33830.log 2024-04-24T08:27:23.801 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33499.log.gz 2024-04-24T08:27:23.802 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38107.log 2024-04-24T08:27:23.802 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37939.log.gz 2024-04-24T08:27:23.803 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35724.log 2024-04-24T08:27:23.803 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33830.log.gz 2024-04-24T08:27:23.804 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37816.log 2024-04-24T08:27:23.804 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38107.log.gz 2024-04-24T08:27:23.805 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35282.log 2024-04-24T08:27:23.805 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35724.log.gz 2024-04-24T08:27:23.806 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35809.log 2024-04-24T08:27:23.806 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37816.log.gz 2024-04-24T08:27:23.807 INFO:teuthology.orchestra.run.smithi142.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-24T08:27:23.807 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34948.log 2024-04-24T08:27:23.808 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35282.log: /var/log/ceph/ceph-client.admin.35809.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35282.log.gz 2024-04-24T08:27:23.808 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36743.log 2024-04-24T08:27:23.809 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35809.log.gz 2024-04-24T08:27:23.810 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-04-24T08:27:23.810 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m0.155s 2024-04-24T08:27:23.810 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m0.591s 2024-04-24T08:27:23.810 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.102s 2024-04-24T08:27:23.811 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35055.log 2024-04-24T08:27:23.811 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34948.log.gz 2024-04-24T08:27:23.811 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38029.log 2024-04-24T08:27:23.811 INFO:teuthology.orchestra.run.smithi088.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36743.log.gz 2024-04-24T08:27:23.812 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35887.log 2024-04-24T08:27:23.812 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35055.log.gz 2024-04-24T08:27:23.812 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34009.log 2024-04-24T08:27:23.813 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38029.log.gz 2024-04-24T08:27:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36101.log 2024-04-24T08:27:23.814 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35887.log.gz 2024-04-24T08:27:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35183.log 2024-04-24T08:27:23.815 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34009.log.gz 2024-04-24T08:27:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36285.log 2024-04-24T08:27:23.816 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36101.log.gz 2024-04-24T08:27:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.35183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38133.log 2024-04-24T08:27:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36285.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.0.35183.log.gz -5 2024-04-24T08:27:23.818 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38601.log 2024-04-24T08:27:23.818 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36285.log.gz 2024-04-24T08:27:23.822 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34870.log 2024-04-24T08:27:23.822 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38133.log.gz 2024-04-24T08:27:23.824 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34011.log 2024-04-24T08:27:23.824 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38601.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38601.log.gz 2024-04-24T08:27:23.825 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36044.log 2024-04-24T08:27:23.825 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34870.log.gz 2024-04-24T08:27:23.825 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38367.log 2024-04-24T08:27:23.825 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34011.log.gz 2024-04-24T08:27:23.825 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37124.log 2024-04-24T08:27:23.825 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36044.log.gz 2024-04-24T08:27:23.825 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38445.log 2024-04-24T08:27:23.825 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38367.log: /var/log/ceph/ceph-client.admin.37124.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38367.log.gz 2024-04-24T08:27:23.827 INFO:teuthology.orchestra.run.smithi088.stderr:gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.37124.log.gz --verbose 2024-04-24T08:27:23.827 INFO:teuthology.orchestra.run.smithi088.stderr: -- /var/log/ceph/ceph-client.admin.34012.log 2024-04-24T08:27:23.827 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36509.log 2024-04-24T08:27:23.827 INFO:teuthology.orchestra.run.smithi088.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-24T08:27:23.827 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34012.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38445.log.gz 2024-04-24T08:27:23.827 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34209.log 2024-04-24T08:27:23.827 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34012.log.gz 2024-04-24T08:27:23.828 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38211.log 2024-04-24T08:27:23.828 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34209.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36509.log.gz 2024-04-24T08:27:23.828 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36434.log 2024-04-24T08:27:23.829 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34209.log.gz 2024-04-24T08:27:23.829 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35646.log 2024-04-24T08:27:23.829 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38211.log.gz 2024-04-24T08:27:23.830 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33371.log 2024-04-24T08:27:23.830 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36434.log.gz 2024-04-24T08:27:23.831 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36561.log 2024-04-24T08:27:23.831 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35646.log.gz 2024-04-24T08:27:23.832 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36259.log 2024-04-24T08:27:23.832 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33371.log.gz 2024-04-24T08:27:23.833 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34216.log 2024-04-24T08:27:23.833 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36561.log.gz 2024-04-24T08:27:23.834 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35620.log 2024-04-24T08:27:23.834 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36259.log.gz 2024-04-24T08:27:23.835 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34216.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34216.log.gz 2024-04-24T08:27:23.836 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.35620.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35620.log.gz 2024-04-24T08:27:23.837 INFO:teuthology.orchestra.run.smithi088.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-24T08:27:23.863 INFO:teuthology.orchestra.run.smithi088.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-24T08:27:23.885 INFO:teuthology.orchestra.run.smithi088.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-24T08:27:23.887 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-24T08:27:23.887 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m0.279s 2024-04-24T08:27:23.887 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m0.929s 2024-04-24T08:27:23.887 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m0.365s 2024-04-24T08:27:23.888 INFO:tasks.ceph:Archiving logs... 2024-04-24T08:27:23.889 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215/remote/smithi088/log 2024-04-24T08:27:23.890 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T08:27:24.191 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215/remote/smithi142/log 2024-04-24T08:27:24.192 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T08:27:24.291 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-24T08:27:24.314 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-24T08:27:24.314 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T08:27:24.318 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T08:27:24.375 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-24T08:27:24.406 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-24T08:27:24.407 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T08:27:24.410 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T08:27:24.420 INFO:teuthology.orchestra.run.smithi088.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T08:27:24.421 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================== 2024-04-24T08:27:24.421 INFO:teuthology.orchestra.run.smithi088.stdout:*hv01.front.sepi 44.4.53.2 2 u 14 64 77 0.155 -1.889 0.965 2024-04-24T08:27:24.421 INFO:teuthology.orchestra.run.smithi088.stdout:+hv02.front.sepi 63.231.80.2 3 u 15 64 77 0.201 -0.467 1.005 2024-04-24T08:27:24.421 INFO:teuthology.orchestra.run.smithi088.stdout:+hv03.front.sepi 74.6.168.72 3 u 14 64 77 0.129 -0.861 0.975 2024-04-24T08:27:24.421 INFO:teuthology.orchestra.run.smithi088.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T08:27:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T08:27:24.424 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================== 2024-04-24T08:27:24.425 INFO:teuthology.orchestra.run.smithi142.stdout:*hv01.front.sepi 44.4.53.2 2 u 10 64 77 0.128 -1.522 0.760 2024-04-24T08:27:24.425 INFO:teuthology.orchestra.run.smithi142.stdout:+hv02.front.sepi 63.231.80.2 3 u 9 64 77 0.148 -0.125 0.697 2024-04-24T08:27:24.425 INFO:teuthology.orchestra.run.smithi142.stdout:+hv03.front.sepi 74.6.168.72 3 u 14 64 77 0.202 -0.597 0.707 2024-04-24T08:27:24.425 INFO:teuthology.orchestra.run.smithi142.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T08:27:24.426 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-24T08:27:24.436 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-24T08:27:24.436 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-24T08:27:24.458 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-24T08:27:24.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-24T08:27:24.530 INFO:teuthology.task.internal:Duration was 805.063334 seconds 2024-04-24T08:27:24.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-24T08:27:24.559 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-24T08:27:24.559 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T08:27:24.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T08:27:24.655 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-24T08:27:24.655 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T08:27:24.655 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T08:27:24.676 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T08:27:24.676 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T08:27:24.700 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-24T08:27:24.700 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T08:27:24.727 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T08:27:24.784 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-24T08:27:24.784 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T08:27:24.804 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T08:27:24.894 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-24T08:27:24.915 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-24T08:27:24.915 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T08:27:24.935 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T08:27:24.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-24T08:27:24.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T08:27:24.991 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T08:27:25.005 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-04-24T08:27:25.017 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-04-24T08:27:25.049 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T08:27:25.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:27:25.073 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T08:27:25.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T08:27:25.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-24T08:27:25.264 INFO:teuthology.task.internal:Transferring archived files... 2024-04-24T08:27:25.264 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215/remote/smithi088 2024-04-24T08:27:25.265 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T08:27:25.294 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215/remote/smithi142 2024-04-24T08:27:25.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T08:27:25.380 INFO:teuthology.task.internal:Removing archive directory... 2024-04-24T08:27:25.381 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T08:27:25.384 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T08:27:25.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-24T08:27:25.427 INFO:teuthology.task.internal:Not uploading archives. 2024-04-24T08:27:25.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-24T08:27:25.438 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-24T08:27:25.438 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T08:27:25.441 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T08:27:25.447 INFO:teuthology.orchestra.run.smithi088.stdout: 655432 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 08:27 /home/ubuntu/cephtest 2024-04-24T08:27:25.454 INFO:teuthology.orchestra.run.smithi142.stdout: 655427 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 08:27 /home/ubuntu/cephtest 2024-04-24T08:27:25.455 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-24T08:27:25.466 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-24T08:27:25.487 INFO:teuthology.nuke:Checking targets against current locks 2024-04-24T08:27:25.515 DEBUG:teuthology.nuke:shortname: smithi088 2024-04-24T08:27:25.515 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-24T08:27:25.539 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 08:04:31.706671', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7KnOPcHZcxJTfUZiHBPafRwYDiWQ6t/KQSznzuP2z3g3T+5hgDmN2FKhIsGWtisn5RqLj8XbNhanRM5TU/1KU='} 2024-04-24T08:27:25.546 DEBUG:teuthology.nuke:shortname: smithi142 2024-04-24T08:27:25.546 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-24T08:27:25.565 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-24_07:32:23-fs-rishabh-main-apr17-a654945-testing-default-smithi/7671215', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 08:04:31.704844', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDRtOf/tckZAVCMYlgMVPlD+8iO7z9o0CmZkJOZPeGRAR5DDfG+kBXyBP5hJL2JdCMFcgzlRpMfh26NaoDbIYc='} 2024-04-24T08:27:25.593 INFO:teuthology.orchestra.console.smithi088:Power off 2024-04-24T08:27:25.594 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-24T08:27:25.615 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-04-24T08:27:25.615 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-24T08:27:25.633 INFO:teuthology.orchestra.console.smithi142:Power off 2024-04-24T08:27:25.634 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-24T08:27:25.648 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-04-24T08:27:25.656 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-04-24T08:27:25.656 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-24T08:27:25.680 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-24T08:27:29.650 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-24T08:27:29.681 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-24T08:27:29.761 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-04-24T08:27:29.791 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-24T08:27:33.765 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-24T08:27:33.791 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-24T08:27:33.875 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-04-24T08:27:33.900 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-24T08:27:33.977 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-04-24T08:27:37.903 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-24T08:27:38.015 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-04-24T08:27:38.116 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-04-24T08:27:38.221 INFO:teuthology.run:Summary data: description: fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} duration: 805.0633335113525 failure_reason: 'Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD)' flavor: default mon.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4622673fdcf64b2ab13246eda2aa0488 status: fail success: false 2024-04-24T08:27:38.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T08:27:38.301 INFO:teuthology.run:FAIL